Nebius

By uncovering surprising links between seemingly unrelated LLM architectures, a way might be paved for effective idea exchange and boosting…

It’s a little quieter now — as is often the case in August — in terms of big AI conferences, announcements, and product launches. Everyone…

The rapid evolution of deep learning models has brought about unprecedented growth in both their size and complexity. This trend, while…

Mixture of Experts (MoE) has become popular as an efficiency-boosting architectural component for LLMs. In this blog post, we’ll explore…

How well can LLMs abstract rules and how to test such ability? Here’s a research by the London Institute for Mathematical Sciences (LIMS).

Donated computing time is helping researchers at the London Institute model the universe and formulate new conjectures.

Severe GPU scarcity and struggles with MLOps are forcing ML engineers to more and more divert focus from model development. Such a shift…

Why are datasets for LLMs so challenging? As with any machine learning task, data is half the battle (the other half being model efficiency…

In the next installment of our series of deep technical articles on AI research, let’s switch our attention to the famous LoRA, a low-rank…

Scaling your machine learning workloads will eventually require resource orchestration. Among the multiple solutions available, the most…

Retrieval-augmented generation (RAG) is a technique that enhances language models by combining generative AI with a retrieval component…

With this article, we are starting a new category on our blog, the one dedicated to AI research. Expect these posts to be very technical…

There are various aspects to optimize when training large models. It often lasts weeks and involves managing billions of rows of data, with…

The global network of ML engineers is divided into two parts: industrial and academic. The flow of information, methods of interaction, and…

The beginning of the year is a good time to make plans, right? If you’re an ML engineer, researcher, or technical manager, now is the…

My name is Igor, I’m the Technical Product Manager for IaaS at Nebius AI. Today, I’m going to break down the differences between NVIDIA’s…

In the ever-evolving landscape of machine learning, the infrastructure that supports it plays a pivotal role, standing out as the key…

The creation of ML models powering intelligent products and services hinges heavily on powerful graphics cards. The ongoing deep learning…