Improved algorithms may be more important for AI performance than faster hardware
MIT researchers have found that 43% of “algorithms families” relating to large computing problems had year-on-year improvements that were equal to, or larger than, the gains from Moore’s Law. …
OpenAI launches Codex, an API for translating natural language into code
OpenAI recently released Codex, an AI system that translates natural language into code. It is able to understand more than a dozen programming languages and can interpret commands in plain English and execute them, making it possible to build…
DeepMind aims to marry deep learning and classic algorithms
DeepMind has recently published a paper about Neural Algorithmic Reasoning (NAR). NAR posits that if deep learning methods were better able to mimic algorithms, we may see deep learning methods achieve the same sort of generalization as algorithms. …
Do neural nets really need to be so big?
Researchers for several decades have shown that with “pruning” they can reduce the number of parameters in a neural net by as much as 90% without impeding the ability of the model to succeed at the tasks it was trained for. The…
AI 21 Labs train a massive language model to rival OpenAI’s GPT-3
AI21 Labs is planning to release its 178 billion parameter language model. …
OpenAI releases Triton, a programming language for AI workload optimization
OpenAI recently announced the release of Triton, an open-source, Python-like language for writing highly efficient GPU code for AI. Triton aims to automate optimizations so that developers can focus on the high-level logic of their code.
DeepMind says it will release the structure of every protein known to science
MIT Tech Review
DeepMind has announced that they will release the structure of over 350,000 proteins — nearly every protein in the human body and the shapes of thousands of other proteins found in the most widely studied organisms…
Data scientists are from Mars and software developers are from Venus
Data scientists and software developers operate in deceivingly disparate ways, and appreciating these differences is vital to integrating best practices into an organization.
AI is harder than we think: 4 key fallacies in AI research
AI has fallen short…