PinnedDavid R. WinerinTowards Data ScienceTowards Generative AI for Model ArchitectureHow “MAD” AI will help us discover the next transformerNov 10, 20232Nov 10, 20232
PinnedDavid R. WinerinTowards AIWalkthrough of Graph Attention Network (GAT) with Visual ImplementationUnderstanding Graph Neural Networks (GNNs) is increasingly relevant as transformers continue tackling graph problems like from the Open…Sep 15, 20232Sep 15, 20232
David R. WinerGraphbook takes the pain out of doing “surgery” to AI Models, like BERT, GPT, and T5As language models get larger and more complex, they are also becoming more difficult to understand and edit. In order to convey the effort…Oct 31, 20231Oct 31, 20231
David R. WinerAI Modeling as Diagramming: LucidChart to Cerbrec GraphbookRecently, I was looking around some of my LucidChart diagrams and found some attempts to understand BERT from its original implementation…Oct 30, 2023Oct 30, 2023
David R. WinerinTowards AIAttention Sinks and Where to Cache Them: A Visual Walkthrough for the Streaming LLM ImplementationGPT-2 Rolling Cache Text Generator BlockOct 11, 20232Oct 11, 20232
David R. WinerinTowards AIVisual Walkthrough for Vectorized BERTScore to Evaluate Text GenerationAI-based text generation has clearly entered the mainstream. From automated writing assistants, to legal document generation, marketing…Oct 8, 20232Oct 8, 20232
David R. WinerinTowards AIWalkthrough of LoRA Fine-tuning on GPT and BERT with Visualized ImplementationA visualized walkthrough for how (and where) in transformer architectures to swap dense self attention layers with LoRA layers.Sep 26, 20232Sep 26, 20232
David R. WinerA Fully Visualized GPT2 Implementation and Comparison to BERTGenerative Pre-trained Transformer (GPT) is one of the key transformer architectures revolutionizing generative AI applications. There is a…Sep 21, 20231Sep 21, 20231
David R. WinerA Fully Visualized (And Honest) Implementation Of BERTAs a visual thinker, the first figure I look for in an AI paper (after reading the abstract) is the conceptual diagram. The typical diagram…Sep 14, 2023Sep 14, 2023