The Transformer Neural Networks Saga is Just Getting Started

There are applications that we cannot even dream about!

TNNs will rule our future.

Scope

I’ve been reading many analyses of Transformer Neural Networks. Most of them are missing the fundamental point.

We understand natural language. The computer does not have innate consciousness to do so.

A GPT-3 transformer is an advanced mathematical model that are just beginning to change the way everything operates.

Architecture

This is the architecture of an GPT-3 TNN(Transformer Neural Network — my personal nomenclature) given below:

From https://dugas.ch/artificial_curiosity/GPT_architecture.html

The Take Away

We see the input and the output. We see that it processs languages. So we say, it understands languages and listens to them accurately and produces coherent output.

All that is fine.

But the computer is unaware that this is a language.

The AI would have to check a dictionary to grasp the meaning of the word.