🦙Meta’s Llama 3 Dominates Open Source LLMs
Meta releases Llama 3
Meta finally released their much awaited Llama 3 Large Language Model in 8B and 70B parameter model sizes. Mark Zuckerberg also stated in an interview with Dwarkesh Patel that a 400B parameter model version is also still training. Llama 3 is showing itself to perform near similar sized models and even come close to a GPT-4 level experience 🤯
See More: Introducing Meta Llama 3: The most capable openly available LLM to date
Google Next
Google had their Cloud Next 2024 conference and announced a huge list of things. One thats particularly interesting and shows Google wants to take a lead, is their Agent Builder product on Vertex AI. This makes agents easy to build, manage and deploy with a simple interface.
See More:
- Build generative AI experiences with Vertex AI Agent Builder | Google Cloud Blog
- Google Cloud Next 2024 wrap up | Google Cloud Blog
2 Papers on Infinite Length Context Windows
A Paper from a team at Meta and another one from Google are showing ways that LLMs may be able to have an unlimited context window, which would far surpase the largest windows today such as Gemini 1.5’s 1 million token context window.
See More:
- [2404.07143] Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention (arxiv.org)
- [2404.08801v1] Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length (arxiv.org)
- NEW SHORT BIT — 7 Overlooked Edge Browser Features to Improve Productivity | by Robby Boney | Short Bits | Apr, 2024 | Medium
- BOSTON DYNAMICS LAUNCHES A NEW ATLAS MODEL — An Electric New Era for Atlas | Boston Dynamics
- UDIO LAUNCH: ONE OF THE BEST AI AUDIO GENERATORS — Udio | Make your music
- SPLINE LAUNCHES AI 3D OBJECT GENERATION — Spline AI 3D Generation — The power of AI for the 3rd dimension.
- OPENAI LAUNCHES LOTS UPDATES TO THEIR API INCLUDING A BATCH API, PROJECTS, AND ASSISTANT — https://x.com/OpenAIDevs/status/1780640119890047475
- STANFORDS HUMAN-CENTERED AI GROUP RELEASES STATE OF AI 2024 REPORT — Inside The New AI Index: Expensive New Models, Targeted Investments, and More (stanford.edu)
