Implications for classical AI
It was obvious to physicists that light waves MUST have an eather to propagate from one place to the next.
- They thought there was no other possibility.
It was obvious to AI researchers that people MUST use formal rules of inference to propagate implications from one proposition to the next.
- They thought there was no other possibility.
But there are no symbols inside the encoder and decoder neural nets for machine translation.
- The only symbols are at the input and output.
Maybe processing symbol string is not done by manipulating internal symbol strings.
- Processing pixel arrays is certainly not done by manipulating internal pixels.
Very important note: this information is from a slide from a presentation of Prof. Geoffrey Hinton.