Google’s PaLM 2 Technical Report Details the New Model Family’s Research Advances

In April 2022, Google unveiled its 540 billion parameter Pathways Language Model (PaLM), which they developed using a novel Pathways (Barham et al., 2022) approach that enables efficient model training across multiple TPU v4 Pods (in PaLM’s case, 6144 TPU v4 chips). With large language models (LLMs) now receiving unprecedented public attention and…