NLP Progress So Fast, New Benchmarks Created

CognitionX
Speaking Naturally
Published in
3 min readJul 29, 2019

Air St Capital released a technical research overview of the state of AI for 2019. One of the NLP highlights we like is about GLUE, a benchmark created just last year to foster competition against researchers into diversity and quality of NLP algorithms.

However, progress towards human-level targets was so rapid that a new benchmark has already been created! SuperGLUE sets even more ambitious goals for the rest of 2019 and beyond.

How is this relevant for businesses? Excitingly, much of this increased performance is directly accessible to small teams without needing the processing power or data sources the big companies have.

Big companies are increasingly providing repositories that hold vast bodies of language in a secure and anonymised way called “pre-trained models” (e.g. BERT, GPT-2, and XLNet).

These pre-trained models are secure to the extent that they don’t store the actual words, and are turning out to be surprisingly versatile. Application-specific enhancements, called “fine-tuning”, are possible for a growing range of use cases (e.g. summarisation, translation, question & answering) involving relatively small changes with very manageable sources of data.

This “leg-up” is making new levels of text intelligence widely available at low cost. Certainly we see some opportunities for our own Knowledge Network that we’re working on fervently — but drop me a line if you would like some guidance for your business.

Read on to learn about Microsoft’s Cortana strategy, chatbots around the world, and more.

Leading the Pack

Microsoft continues to distance Cortana from Windows 10
Microsoft’s decision to slowly extract Cortana from Windows 10 has plenty of individual benefits and gives the company the opportunity to promote the feature as a standalone app on more platforms rather than simply as a part of Windows 10.
Read more

Egypt’s WideBot raises six-figure Pre-Series A for its Arabic chatbot building platform
Founded in late 2016 by Mohamed Nabil and Ahmed Labib, WideBot had first started as an English chatbot building platform but has lately developed an Arabic version as well, which it claims is the first-ever Arabic chatbot builder in the region.
Read more

LINE launches AI business LINE BRAIN
LINE Corporation has announced the launch of its LINE BRAIN business, which will offer AI technologies developed by LINE, such as the Clova AI assistant, to outside companies.
Read more

Making an Impact

How the Indian banking system is changing because of chatbots
Technology is strengthening the Indian banking system for a better tomorrow. Here are 4 great Indian banking chatbots from HDFC Bank, Yes Bank, Kotak Mahindra Bank, and SBI.
Read more

Under the Hood

Counteracting neural disinformation with Grover
Check out this fascinating research where AI2 researchers explore the surprising effectiveness of a fake news generator for fake news detection.
Read more

Learn From the Pros

Facebook Messenger becomes less spammy
Whether you’re tuning in now or need a little refresher about the Facebook Subscription Messaging changes which are coming, here are four articles that will help you navigate through the changes and maintain a strong Messenger Marketing strategy.
Read more

--

--

CognitionX
Speaking Naturally

The most trusted source of personalised advice on All Things AI