pamperherselfFinally Understanding Gradient Descent and Scaling Laws OpenAI Validated It 4 Years AgoRecently, I came across a 2020 paper by OpenAI titled Scaling Laws for Neural Language Models. After reading it, I finally understood the…2d ago
The One Alternative ViewinILLUMINATIONExperts Think Cities Don’t Behave Like Organisms, But I Am of a Different OpinionCities can be considered organismsJun 519
Yu-Cheng TsaiinSage AiDemystify Transformers: A Guide to Scaling LawsUnpacking Transformer Technologies and Scaling StrategiesApr 30Apr 30
LM PoThe Evolution of Scaling Laws for LLMsThis article reviews the evolution of neural scaling laws for large language models (LLMs), from OpenAI’s foundational work (2020) to…Aug 5Aug 5
Derek DaiScaling Laws for Large Language Models (LLMs)As the field of artificial intelligence continues to advance, understanding the scaling laws for large language models (LLMs) has become…May 21May 21
pamperherselfFinally Understanding Gradient Descent and Scaling Laws OpenAI Validated It 4 Years AgoRecently, I came across a 2020 paper by OpenAI titled Scaling Laws for Neural Language Models. After reading it, I finally understood the…2d ago
The One Alternative ViewinILLUMINATIONExperts Think Cities Don’t Behave Like Organisms, But I Am of a Different OpinionCities can be considered organismsJun 519
Yu-Cheng TsaiinSage AiDemystify Transformers: A Guide to Scaling LawsUnpacking Transformer Technologies and Scaling StrategiesApr 30
LM PoThe Evolution of Scaling Laws for LLMsThis article reviews the evolution of neural scaling laws for large language models (LLMs), from OpenAI’s foundational work (2020) to…Aug 5
Derek DaiScaling Laws for Large Language Models (LLMs)As the field of artificial intelligence continues to advance, understanding the scaling laws for large language models (LLMs) has become…May 21
Max David GuptaTubingen (Delayed) Blog 2Last night, I couldn’t sleep and wanted to write, but forgot Medium existed, so didn’t decide to blog until this morning. So here’s the…Jun 7
Checkpoint89Scaling Laws for Neural Language ModelsIn this post I share my notes on Scaling laws for Neural Language Models (Kaplan — OpenAI — 01/2020). This paper has since been challenged…Oct 17, 2023
李垚男Can Large Language Models get worse when becomming bigger?The short answer to this question is yes.Apr 28