Gavin Li – Medium

Gavin Li

Pinned

Published in

AI Advances

Unbelievable! Run 70B LLM Inference on a Single 4GB GPU with This NEW Technique

Large language models require huge amounts of GPU memory. Is it possible to run inference on a single GPU? If so, what is the minimum GPU…

Nov 18, 2023

Unbelievable! Run 70B LLM Inference on a Single 4GB GPU with This NEW Technique

Nov 18, 2023

Published in

AI Advances

Breakthrough: Running the New King of Open-Source LLMs QWen2.5 on an Ancient 4GB GPU

New King of Open-Source LLM: QWen 2.5 72B

Sep 21, 2024

Breakthrough: Running the New King of Open-Source LLMs QWen2.5 on an Ancient 4GB GPU

Sep 21, 2024

Two-Person Team $40K MRR in 4 Months: Is There Still a Blue Ocean in AI?

With the AI industry becoming increasingly competitive, is there still a blue ocean opportunity to explore? Take a look at what this small…

Aug 24, 2024

Two-Person Team $40K MRR in 4 Months: Is There Still a Blue Ocean in AI?

Aug 24, 2024

Published in

AI Advances

Crazy Challenge: Run Llama 405B on a 8GB VRAM GPU

I’m taking on the challenge of running the Llama 3.1 405B model on a GPU with only 8GB of VRAM.

Aug 1, 2024

Crazy Challenge: Run Llama 405B on a 8GB VRAM GPU

Aug 1, 2024

Why It’s Extremely Hard to Start an AI Application Business with Large Language Models

The media hype surrounding AI might have you believe it’s soaring high above us, on the brink of rendering all human jobs obsolete and…

May 3, 2024

Why It’s Extremely Hard to Start an AI Application Business with Large Language Models

May 3, 2024

Published in

AI Advances

Run the strongest open-source LLM model: Llama3 70B with just a single 4GB GPU!

The strongest open source LLM model Llama3 has been released, Here is how you can run Llama3 70B locally with just 4GB GPU, even on Macbook

Apr 21, 2024

Run the strongest open-source LLM model: Llama3 70B with just a single 4GB GPU!

Apr 21, 2024

Published in

AI Advances

Open-Source SORA Has Arrived! Training Your Own SORA Model!

To date, the open-source model that comes closest to SORA is Latte, which employs the same Vision Transformer architecture as SORA. What…

Mar 8, 2024

Open-Source SORA Has Arrived! Training Your Own SORA Model!

Mar 8, 2024

Published in

AI Advances

How Your Ordinary 8GB MacBook’s Untapped AI Power Can Run 70B LLM Models That Will Blow Your Mind!

Do you think your Apple MacBook is only good for making PPTs, browsing the web, and streaming shows? If so, you really don’t understand the…

Dec 28, 2023

How Your Ordinary 8GB MacBook’s Untapped AI Power Can Run 70B LLM Models That Will Blow Your Mind!

Dec 28, 2023

$100m AI Product Leader’s Checklist: 5 Key Criteria to Validate Your Next Big AI Idea

Over the years working on various AI products and technologies at top American tech giants, I have unconsciously formed a checklist in my…

Oct 26, 2023

$100m AI Product Leader’s Checklist: 5 Key Criteria to Validate Your Next Big AI Idea

Oct 26, 2023

Exciting update!! Announcing new Anima LLM model, 100k context window!! Fully open source!

We released the new Anima open source 7B model, supporting an input window length of 100K! It’s based on LLama2, so available for…

Sep 17, 2023

Exciting update!! Announcing new Anima LLM model, 100k context window!! Fully open source!

Sep 17, 2023

Gavin Li

Gavin Li

Founder of Anima AI, former Airbnb, Alibaba AI senior leader. Unicorn's AI advisor. Author of AirLLM. X: @lyo_gavin

Following

Help

Status

About

Careers

Press

Blog

Privacy

Rules

Terms

Text to speech