Jesus RodriguezinTowards AISynthetic Data Generation in Foundation Models and Differential Privacy: Three Papers from…A reference architecture, security challenges and some recipes are some of the methods outlined in Microsoft’s papers.5 min read·5 days ago--1--1
Jesus RodriguezinTowards AIInside One of the Most Important Papers of the Year: Anthropic’s Dictionary Learning is a…The model builds on research from last year and tries to understand interpretable features in LLMs.6 min read·May 28, 2024--2--2
Jesus RodriguezinTowards AIInside Infini Attention: Google DeepMind’s Technique Powering Gemini 2M Token WindowThe method combines compressive memory and attention mechanisms in a single structure.5 min read·May 20, 2024----
Jesus RodriguezinTowards AIInside AlphaFold 3: A Technical View Into the New Version of Google DeepMind’s BioScience ModelA highly improved architecture drastically expands the capabilities of AlphaFold.4 min read·May 13, 2024----
Jesus RodriguezinTowards AIPredicting Multiple Tokens at the Same Time: Inside Meta AI’s Technique for Faster and More Optimal…The mehod addresses the limitations of the classic next token prediction method.4 min read·May 6, 2024--1--1
Jesus RodriguezinTowards AISome Technical Notes About Phi-3: Microsoft’s Marquee Small Language ModelThe model ius able to outperform much larger alternatives and now run locally on mobile devices.4 min read·Apr 29, 2024----
Jesus RodriguezinTowards AISome Technical Notes About Llama 3New tokenizer, optimized pretraining and some other details about Meta AI’s new model.5 min read·Apr 22, 2024----
Jesus RodriguezinTowards AIInside Ferret-UI: Apple’s Multimodal LLM for Mobile Screen UnderstandingThe new research can have an impact in task automation in mobile apps.5 min read·Apr 15, 2024----
Jesus RodriguezinTowards AIInside Jamba: Mamba, Transformers, and MoEs Together to Power a New Form of LLMsThe new architecture was pioneered by AI21 Labs and brought the best of several architecture paradigms in a single model.5 min read·Apr 8, 2024----
Jesus RodriguezinTowards AIInside DBRX: Databricks’ Impressive Open Source LLMThe model shows a strong perfromance across many industry benchmarks.5 min read·Apr 1, 2024--2--2