PinnedJesse ViginTowards Data ScienceDeconstructing BERT, Part 2: Visualizing the Inner Workings of AttentionA new visualization tool shows how BERT forms its distinctive attention patterns.Jan 7, 20197Jan 7, 20197
Jesse ViginTowards Data ScienceOpenAI GPT-2: Understanding Language Generation through VisualizationHow the super-sized language model is able to finish your thoughts.Mar 5, 20195Mar 5, 20195
Jesse ViginTowards Data ScienceDeconstructing BERT: Distilling 6 Patterns from 100 Million ParametersFrom BERT’s tangled web of attention, some intuitive patterns emerge.Dec 18, 20185Dec 18, 20185
Jesse ViginTowards Data ScienceA.I. Plays Mad Libs and the Results are TerrifyingThe year is 1982. Michael Jackson’s Thriller is the best-selling album in the world. Surgeons recently implanted the world’s first…Nov 28, 20184Nov 28, 20184