Yang YouinPyTorchColossal-LLaMA-2: Low Cost and High-quality Domain-specific LLM Solution Using LLaMA and…The most prominent distinction between LLaMA-1 and LLaMA-2 lies in the incorporation of higher-quality corpora, a pivotal factor…11 min read·Jan 29, 2024----
Yang YouinPyTorchColossalChat: An Open-Source Solution for Cloning ChatGPT With a Complete RLHF PipelineLarge AI models and applications like ChatGPT and GPT-4 have become extremely popular worldwide, serving as a foundation for the…10 min read·Mar 29, 2023--6--6
Yang YouinPyTorchLatest Colossal-AI boasts novel automatic parallelism and offers savings up to 46x for Stable…This post is authored by Prof. Yang You, founder of HPC-AI Tech, the company developing Colossal-AI. Yang received his Ph.D. in Computer…2 min read·Jan 31, 2023--1--1
Yang YouDiffusion Pretraining and Hardware Fine-Tuning Can Be Almost 7X Cheaper!Author: Yang You, Presidential Young Professor at the National University of Singapore10 min read·Nov 8, 2022--2--2
Yang YouUse a Laptop to Analyze 90% of Proteins, With a Single-GPU Inference Sequence Exceeding 10,000!Proteins are the basis of almost all functions of life. Evaluating the shape a protein folds — the “protein folding problem” — has been a…8 min read·Oct 27, 2022----
Yang YouEmbedding Training With 1% GPU Memory and 100 Times Less Budget, an Open Source Solution for…Deep recommendation models (DLRMs) have become critical for deep learning applications in IT companies. DLRMs can be used to improve user…12 min read·Oct 18, 2022--1--1
Yang YouColossal-AI Seamlessly Accelerates Large Models at Low Costs with Hugging FaceForbes News, the world’s leading voice, recently declared large AI models as one of six AI trends to watch for in 2022. As large-scale AI…8 min read·Jul 12, 2022----
