PinnedPublished inTheSeriousProgrammerBinary Magic: Building BitNet 1.58bit Using PyTorch from ScratchSpoiler Alert:Mar 128Mar 128
Published inTheSeriousProgrammerJPEG Compression: The Unsung Algorithm That Powers the Web (AAP-1)An appreciation post of the genius algorithm which allows us to power the webSep 12Sep 12
Published inTheSeriousProgrammerAre Transformers secretly just linear layers?This article is a rewrite of a interesting analysis from group of researchers who discovered that a good chunk of transformer blocks in…May 282May 282
Published inTheSeriousProgrammerLLM powered Automatic Text Data Janitor from Microsoft, named Rho-1Recently a team from microsoft research published a paper titled “Not all tokens are what you need”. Wherein they discuss a approach to…Apr 15Apr 15
Published inTheSeriousProgrammerThe Golden Trojan: Exposing Industrial-Scale Telegram ScamsContext:Jun 21, 2023Jun 21, 2023