Tech in China
Published in

Tech in China

China’s Super Large-scale Al model “WenHui” announced

On January 12, the joint research team of Alibaba, BAAI (Beijing Academy of Artificial Intelligence), Tsinghua University, and other joint research teams released the new super-large-scale pre-training model “Wenhui” for cognition.

This model not only improves the understanding of AI but also recognizes AI creation based on common sense. It will be applied to scenarios such as text understanding, human-computer interaction, and visual Q&A in the future.

Unlike traditional AI training that requires manual labeling of data, the cognitive-oriented pre-training language model provides a new way of learning. Which has the AI automatically learn a large amount of language, text, and image data first, then has it remember and understand the information and human language expressions.

After this regularity, further study professional domain knowledge, so the AI can master both common sense and professional knowledge at the same time.

The “Wenhui” released is currently the largest pre-training model in China, with a parameter of 11.3 billion. It adopts a high-performance distributed framework that unifies multiple parallel strategies developed by Alibaba and uses model parallel, pipeline parallel, and Data parallel training performs distributed training.

“Wenhui” breaks through the two major problems of multi-modal understanding and multi-modal generation, can easily understand text and image information, and can complete creative tasks.

For example, you only need to enter the title, dynasty, and author of the poem and “Wenhui” can automatically generate antique poems.

Currently, “Wenhui” supports multiple natural languages and cross-modal application tasks based on cognitive reasoning, and some applications will be launched soon.

Jingren Zhou, head of the Intelligent Computing Laboratory of the Alibaba DAMO Academy, said,

“The pre-training language model is one of the most innovative natural language models in the past 70 years, and its model design is much more difficult than traditional models. The DAMO Academy research team will continue to overcome algorithm and system engineering problems and accelerate artificial intelligence to cognitive intelligence.”

Source: https://36kr.com/newsflashes/1051028724629256

--

--

--

Stories about China’s tech giants, startups, funding, venture capital, trends, and industries of tomorrow.

Recommended from Medium

Souls Using Android Bodies

Which Country Is Best For Artificial Intelligence?

For or against conversational bots for customer service?

Powerful AI, the new age Genie!

A simple wish to the new age genie — “make my home eco friendly” can lead to a disastrous outcome.

AutoNLP: Sentiment Analysis in 5 Lines of Python Code

Voice Assistant for Fitness and Wellness Apps: Your Personal AI Trainer

Using AI to Automate Robots

CAN WE TRUST AI WITH OUR GUNS

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Tech In China

Tech In China

Stories about China’s tech giants, startups, funding, venture capital, trends, and industries of tomorrow.

More from Medium

ESG: How AI Technology Can Contribute To Improving Renewable Energy

ESG: How AI Technology Can Contribute To Improving Renewable Energy

Collaborative Intelligence — An Artificial Intelligence and Human Initiative

Artificial Intelligence Company Applied XL Raises $3.5 million Led by Hearst Ventures

Human intervention in the GDPR and human oversight in the AI Act