In 2020, we have trained and open-sourced the first Dutch GPT2 model, in various sizes. Of course we wanted to share this with the world by open-sourcing the models, the code and a nice application that showcases its use. But this nice application comes at a cost, literally… As-is: HuggingFace 🤗 model powering a Python app Currently, a…

Finetuning pretrained English GPT2 models to Dutch with the OSCAR dataset, using Huggingface transformers and fastai. In this blogpost, we outline our process and code on finetuning an existing GPT2 model towards an entirely different language using a large open Dutch corpus. TLDR: you can try out the model for…

An end-to-end pipeline with AI Platform, Apache Beam / DataFlow, BigQuery and Pub/Sub — The final season of Game of Thrones apparently raised a lot of eyebrows, so I wanted to dig deeper on how people felt before, during and after the final episode of Game of Thrones by turning towards the ever non-soft-spoken Twitter community. In this blogpost, we’ll look at how an…

The Learning Rate (LR) is one of the key parameters to tune in your neural net. SGD optimizers with adaptive learning rates have been popular for quite some time now: Adam, Adamax and its older brothers are often the de-facto standard. They take away the pain of having to search…

Continuing on the first part of this blog post, let’s see if we can train an RNN with the input sequences, and use that to generate some new ones. The code for this part can be found here. …

Holidays are a time for family, friends, snow and as far as my wife is concerned: corny holiday movies. To try and help her never-ending Holiday movie appetite, we’re going to check if we can create a new Christmas movie. The blog post is structured in two parts: Part I…

There’s two things you typically love being a Data Scientist at FoodPairing: Machine Learning and food (order up for debate…). So when you see a chance to combine both, it’s fun for the whole family. After watching Xander van Steenbrugge’s video on VAE’s in the past, I’ve always wanted to…