GPT-4 is here. An AI researcher’s take.

Prepare to be floored. GPT-4 is out now. As of March 14th 2023. We’re talking virtually alien technology.

I’ve been working on NLU (natural language understanding) off-and-on for 25 years. Trying to build parsers that break the famous Turing Test.

The Turing Test is smashed.

I don’t think anyone needs to bother actually running a test.

It’s self-evident that that measuring stick is irrelevant now. GPT-4 might fail the test because it’s too good at being human. It’s more like: is it super intelligence?

Practical updates? Think 50-page prompts. Incredible. That means you can get GPT to query or summarize a decent proportion of an entire book in one call.

Greg Brockman | COO / Co-founder / President OpenAI

Here’s the summary:

• Yes: 50-page prompts (input text) and 50-page completions (output)
• ‘Factuality’ is 40% up (less hallucination).
• Accuracy is way up. Way better than GPT-3 or 3.5. GPT-4 gets an A or B on almost any exam. This is documented. For a dozen real life exams.
• And GPT . . now accepts images as input, as well as text!
• Working with programming code jumps another level.
• Do not miss the tax accounting demo. Yes, tax. It demonstrates we’re in a…