Benjamin Marie – Medium

Benjamin Marie

Pinned

Published in

Run Mixtral-8x7B on Consumer Hardware with Expert Offloading

Finding the right trade-off between memory usage and inference speed

Jan 11, 2024

Run Mixtral-8x7B on Consumer Hardware with Expert Offloading

Jan 11, 2024

Published in

Qwen3-VL Fine-Tuning on Your Computer

Model review, GPU requirements, and code explained step by step

Oct 23

Qwen3-VL Fine-Tuning on Your Computer

Oct 23

LoRA Done Right: Recommendations for Near Full Fine-Tuning Performance

Care about the learning rate, not the alpha, and rank=1 for RL??

Oct 1

LoRA Done Right: Recommendations for Near Full Fine-Tuning Performance

Oct 1

Published in

NVFP4: Same Accuracy with 2.3x Higher Throughput for 4-Bit LLMs

How to quantize LLMs with NVFP4

Aug 27

NVFP4: Same Accuracy with 2.3x Higher Throughput for 4-Bit LLMs

Aug 27

QuTLASS: Efficient Inference with 4-bit Models for Blackwell GPUs

The FP4 wave is coming

Jul 17

QuTLASS: Efficient Inference with 4-bit Models for Blackwell GPUs

Jul 17

Pre-Training Encoders: Bidirectional MLM Remains Important

CLM, MLM, or Both?

Jul 12

Pre-Training Encoders: Bidirectional MLM Remains Important

Jul 12

Supervised Fine-Tuning Improves LLM Reasoning at the Cost of Other Skills

RL vs SFT

Jul 10

Supervised Fine-Tuning Improves LLM Reasoning at the Cost of Other Skills

Jul 10

LLM Recovery without Checkpoints

A breakthrough for multi-GPU settings

Jun 27

LLM Recovery without Checkpoints

Jun 27

RAG with Qwen3 Embedding and Qwen3 Reranker

How to use embedding and reranker models to efficiently retrieve only the most relevant chunks or documents given a user query

Jun 26

RAG with Qwen3 Embedding and Qwen3 Reranker

Jun 26

No Verifier? No Problem: Reinforcement Learning with Reference Probabilities

RLPR: Extrapolating RLVR to General Domains without Verifiers

Jun 25

No Verifier? No Problem: Reinforcement Learning with Reference Probabilities

Jun 25

Benjamin Marie

Benjamin Marie

Ph.D, research scientist in NLP/AI. Exclusive articles and all my AI notebooks on https://kaitchup.substack.com/

Following

Help

Status

About

Careers

Press

Blog

Privacy

Rules

Terms

Text to speech