PinnedGavin LiinAI AdvancesUnbelievable! Run 70B LLM Inference on a Single 4GB GPU with This NEW TechniqueLarge language models require huge amounts of GPU memory. Is it possible to run inference on a single GPU? If so, what is the minimum GPU…Nov 18, 202337Nov 18, 202337
Gavin LiTwo-Person Team $40K MRR in 4 Months: Is There Still a Blue Ocean in AI?With the AI industry becoming increasingly competitive, is there still a blue ocean opportunity to explore? Take a look at what this small…Aug 241Aug 241
Gavin LiinAI AdvancesI Trained a 2D Game Animation Generation Model to Create Complex, Cool Game Actions (Fully…Six months ago, one afternoon, a friend came to me with an AI question.Aug 185Aug 185
Gavin LiinAI AdvancesCrazy Challenge: Run Llama 405B on a 8GB VRAM GPUI’m taking on the challenge of running the Llama 3.1 405B model on a GPU with only 8GB of VRAM.Aug 115Aug 115
Gavin LiWhy It’s Extremely Hard to Start an AI Application Business with Large Language ModelsThe media hype surrounding AI might have you believe it’s soaring high above us, on the brink of rendering all human jobs obsolete and…May 317May 317
Gavin LiinAI AdvancesRun the strongest open-source LLM model: Llama3 70B with just a single 4GB GPU!The strongest open source LLM model Llama3 has been released, Here is how you can run Llama3 70B locally with just 4GB GPU, even on MacbookApr 218Apr 218
Gavin LiinAI AdvancesOpen-Source SORA Has Arrived! Training Your Own SORA Model!To date, the open-source model that comes closest to SORA is Latte, which employs the same Vision Transformer architecture as SORA. What…Mar 84Mar 84
Gavin LiinAI AdvancesHow Your Ordinary 8GB MacBook’s Untapped AI Power Can Run 70B LLM Models That Will Blow Your Mind!Do you think your Apple MacBook is only good for making PPTs, browsing the web, and streaming shows? If so, you really don’t understand the…Dec 28, 202315Dec 28, 202315
Gavin Li$100m AI Product Leader’s Checklist: 5 Key Criteria to Validate Your Next Big AI IdeaOver the years working on various AI products and technologies at top American tech giants, I have unconsciously formed a checklist in my…Oct 26, 20231Oct 26, 20231
Gavin LiExciting update!! Announcing new Anima LLM model, 100k context window!! Fully open source!We released the new Anima open source 7B model, supporting an input window length of 100K! It’s based on LLama2, so available for…Sep 17, 2023Sep 17, 2023
