Gavin Li – Medium

Gavin Li

Pinned

Gavin Li
in
AI Advances

Unbelievable! Run 70B LLM Inference on a Single 4GB GPU with This NEW Technique

Large language models require huge amounts of GPU memory. Is it possible to run inference on a single GPU? If so, what is the minimum GPU…

Nov 18, 2023

Unbelievable! Run 70B LLM Inference on a Single 4GB GPU with This NEW Technique

Nov 18, 2023

Gavin Li

Two-Person Team $40K MRR in 4 Months: Is There Still a Blue Ocean in AI?

With the AI industry becoming increasingly competitive, is there still a blue ocean opportunity to explore? Take a look at what this small…

1d ago

Two-Person Team $40K MRR in 4 Months: Is There Still a Blue Ocean in AI?

1d ago

Gavin Li
in
AI Advances

I Trained a 2D Game Animation Generation Model to Create Complex, Cool Game Actions (Fully…

Six months ago, one afternoon, a friend came to me with an AI question.

Aug 18

I Trained a 2D Game Animation Generation Model to Create Complex, Cool Game Actions (Fully…

Aug 18

Gavin Li
in
AI Advances

Crazy Challenge: Run Llama 405B on a 8GB VRAM GPU

I’m taking on the challenge of running the Llama 3.1 405B model on a GPU with only 8GB of VRAM.

Aug 1

Crazy Challenge: Run Llama 405B on a 8GB VRAM GPU

Aug 1

Gavin Li

Why It’s Extremely Hard to Start an AI Application Business with Large Language Models

The media hype surrounding AI might have you believe it’s soaring high above us, on the brink of rendering all human jobs obsolete and…

May 3

Why It’s Extremely Hard to Start an AI Application Business with Large Language Models

May 3

Gavin Li
in
AI Advances

Run the strongest open-source LLM model: Llama3 70B with just a single 4GB GPU!

The strongest open source LLM model Llama3 has been released, Here is how you can run Llama3 70B locally with just 4GB GPU, even on Macbook

Apr 21

Run the strongest open-source LLM model: Llama3 70B with just a single 4GB GPU!

Apr 21

Gavin Li
in
AI Advances

Open-Source SORA Has Arrived! Training Your Own SORA Model!

To date, the open-source model that comes closest to SORA is Latte, which employs the same Vision Transformer architecture as SORA. What…

Mar 8

Open-Source SORA Has Arrived! Training Your Own SORA Model!

Mar 8

Gavin Li
in
AI Advances

How Your Ordinary 8GB MacBook’s Untapped AI Power Can Run 70B LLM Models That Will Blow Your Mind!

Do you think your Apple MacBook is only good for making PPTs, browsing the web, and streaming shows? If so, you really don’t understand the…

Dec 28, 2023

How Your Ordinary 8GB MacBook’s Untapped AI Power Can Run 70B LLM Models That Will Blow Your Mind!

Dec 28, 2023

Gavin Li

$100m AI Product Leader’s Checklist: 5 Key Criteria to Validate Your Next Big AI Idea

Over the years working on various AI products and technologies at top American tech giants, I have unconsciously formed a checklist in my…

Oct 26, 2023

$100m AI Product Leader’s Checklist: 5 Key Criteria to Validate Your Next Big AI Idea

Oct 26, 2023

Gavin Li

Exciting update!! Announcing new Anima LLM model, 100k context window!! Fully open source!

We released the new Anima open source 7B model, supporting an input window length of 100K! It’s based on LLama2, so available for…

Sep 17, 2023

Exciting update!! Announcing new Anima LLM model, 100k context window!! Fully open source!

Sep 17, 2023

Gavin Li

Gavin Li

Founder of Anima AI, former Airbnb, Alibaba AI senior leader. Unicorn's AI advisor. Author of AirLLM. Blog: gavinliblog.com X: @lyo_gavin

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams