Apr 29
Does Dalle 2 understands abstraction?
As we all know for the last few week the whole tech side of internet has been talking about Dalle 2 non-stop. From the sources provided by people who have early access from reddit, twitter and etc, We can conclude that that Dalle 2 understands action verbs and nouns to a certain extent. But what about abstract concepts, Let’s put this to little test!
Good Example:
Prompt:
“That Friday feeling, when the sun is shining and the vibe is just right”
Let’s break down this example, the prompt has three main features — ‘Friday feeling’ , ‘shining sun’ and ‘right vibes’. Definitely captures the ‘shining sun’ feature which is a verb + noun. Contrast to this the other two features are a bit ambiguous, but Dalle 2 somehow managed to capture it in a subtle way. Even though we can’t point it out, but the picture as a whole capture the essence pretty well. Not sure about the hanging glass from the tree though???
Flop Example:
Prompt:
“You are not going through a difficult time. A difficult time is going through you” René Magritte style
Dalle 2 kind of flopped this prompt. The features of the prompt are all over the place. The word ‘You’ is mentioned twice, so it acknowledge it by showing a human. The scene on the top of the head look like a melting of an iceberg flowing down. So basically it contemplates the melting iceberg as a ‘difficult time’ and ‘going through you’ as the iceberg following through a human head. But the essence of René Magritte is captured pretty good.
Is this the limitation of the algorithm or the human brain itself? On the ground level neural network only performs as good as the data. We humans are yet to grasp these abstract concepts, perhaps it is too early to except it from AI. The data Dalle 2 has been trained on is produced by humans, so the understanding of the abstraction has a human brain limits. Precisely, in near future we can join forces with AI to conceptualize abstraction and express ourselves better than we ever did before.
Stay tuned for the more case study of Dalle 2…!
