Denis AntyukhovinTowards Data ScienceImproving sentence embeddings with BERT and Representation LearningIn this experiment we fine-tune a BERT model to improve it’s capability for encoding short texts. This yields more useful sentence…7 min read·Feb 29, 2020--2--2
Denis AntyukhovinTowards Data ScienceFine-tuning BERT with Keras and tf.ModuleIn this experiment we convert a pre-trained BERT model checkpoint into a trainable Keras layer to solve a text classification problem.7 min read·Nov 30, 2019--3--3
Denis AntyukhovinTowards Data ScienceBuilding a Search Engine with BERT and TensorFlowIn this experiment, we will use a pre-trained BERT model checkpoint to build a text feature extractor and a simple search engine.8 min read·Jun 28, 2019--8--8
Denis AntyukhovinTowards Data SciencePre-training BERT from scratch with cloud TPUIn this experiment, we will be pre-training a state-of-the-art Natural Language Understanding model BERT on arbtrary text data using…7 min read·May 9, 2019--10--10