2023 Update: Training GPT2-MEDIUM etc. from scratch and unlimited-length generation with hidden direction of the prompt.
https://youtu.be/_CPDnyUjjWg Training GPT2-MEDIUM from scratch on Colab. UPDATE: 6–5–2023: float32 fix (no mixed precision — error) and Chained-generation with unlimited length with directed prompt injection (see the other video from Todor’s youtube channel) An update for my Youtube tutorial and notebook from 2021, after I discovered the code needed a little tweek to run again. I also added the code for the unlimited-length generation with hidden prompt injection.