PinnedGavin LiinAI AdvancesUnbelievable! Run 70B LLM Inference on a Single 4GB GPU with This NEW TechniqueLarge language models require huge amounts of GPU memory. Is it possible to run inference on a single GPU? If so, what is the minimum GPU…Nov 18, 202337Nov 18, 202337
Gavin LiinAI AdvancesBreakthrough: Running the New King of Open-Source LLMs QWen2.5 on an Ancient 4GB GPUNew King of Open-Source LLM: QWen 2.5 72BSep 2114Sep 2114
Gavin LiTwo-Person Team $40K MRR in 4 Months: Is There Still a Blue Ocean in AI?With the AI industry becoming increasingly competitive, is there still a blue ocean opportunity to explore? Take a look at what this small…Aug 241Aug 241
Gavin LiinAI AdvancesI Trained a 2D Game Animation Generation Model to Create Complex, Cool Game Actions (Fully…Six months ago, one afternoon, a friend came to me with an AI question.Aug 185Aug 185
Gavin LiinAI AdvancesCrazy Challenge: Run Llama 405B on a 8GB VRAM GPUI’m taking on the challenge of running the Llama 3.1 405B model on a GPU with only 8GB of VRAM.Aug 113Aug 113
Gavin LiWhy It’s Extremely Hard to Start an AI Application Business with Large Language ModelsThe media hype surrounding AI might have you believe it’s soaring high above us, on the brink of rendering all human jobs obsolete and…May 318May 318
Gavin LiinAI AdvancesRun the strongest open-source LLM model: Llama3 70B with just a single 4GB GPU!The strongest open source LLM model Llama3 has been released, Here is how you can run Llama3 70B locally with just 4GB GPU, even on MacbookApr 217Apr 217
Gavin LiinAI AdvancesOpen-Source SORA Has Arrived! Training Your Own SORA Model!To date, the open-source model that comes closest to SORA is Latte, which employs the same Vision Transformer architecture as SORA. What…Mar 84Mar 84
Gavin LiinAI AdvancesHow Your Ordinary 8GB MacBook’s Untapped AI Power Can Run 70B LLM Models That Will Blow Your Mind!Do you think your Apple MacBook is only good for making PPTs, browsing the web, and streaming shows? If so, you really don’t understand the…Dec 28, 202315Dec 28, 202315
Gavin Li$100m AI Product Leader’s Checklist: 5 Key Criteria to Validate Your Next Big AI IdeaOver the years working on various AI products and technologies at top American tech giants, I have unconsciously formed a checklist in my…Oct 26, 20231Oct 26, 20231