Secrets of DeepMind’s Sparrow: A Big Competitor of ChatGPT
Which one is better? Sparrow or ChatGPT ?
Chatbots have become an increasingly popular tool for businesses and organizations to interact with customers and provide information. However, these chatbots are often powered by large language models (LLMs) that are trained on text scraped from the internet, which can result in them regurgitating offensive, racist, and sexist views, or spreading fake news or conspiracies.
To combat this problem, researchers at DeepMind have developed a new chatbot called Sparrow that is less toxic and more accurate than other systems. Sparrow is based on Chinchilla, DeepMind’s impressive language model that has 70 billion parameters, which makes inference and fine-tuning comparatively lighter tasks.
“Sparrow is a research model and proof of concept, designed with the goal of training dialogue agents to be more helpful, correct, and harmless. By learning these qualities in a general dialogue setting, Sparrow advances our understanding of how we can train agents to be safer and more useful — and ultimately…
