ChatGPT Fails in Rhyme Tests
Despite passing law and business school exams.
What is ChatGPT?
ChatGPT is all the rage right now. It is way too trendy for you to not know about it. But in case, you’re one of those rare souls who haven’t heard of it yet:
“ChatGPT is a conversational language model developed by OpenAI, trained to generate text based on given input. It can perform tasks such as answering questions, generating stories, and more.” — ChatGPT
ChatGPT’s recent success.
ChatGPT recently passed exams from law and business schools. Although not with top scores, but definitely with flying colors.
But at the end of the day, it is still a Natural Language Processing (NLP) model and I wanted to push it to test how it does in rhyming.
What is eye rhyme?
Eye rhyme is a rhyme where words may seem to rhyme based on their spelling, but not based on their pronunciations. For instance, “love” and “move”.
ChatGPT’s Test.
I asked ChatGPT to provide me with a word that rhymes with “ones”. Figure 1 shows its response.
As you can see, it fails to come up with a word that rhymes in sound with the word “ones”. I tried to provide it with some reinforcement and feedback by informing how it does not quite rhyme by sound. Refer to its response in Figure 2.
Notice how it first apologizes and then returns the EXACT SAME response as “correction”.
This establishes 2 things:
- ChatGPT bullsh*ts with confidence.
- It can’t go past eye rhymes for certain words.
Verdict.
It appears that ChatGPT is well-versed in eye rhyme, but not in actual rhymes by sound for certain words.
Thank you for reading my article. If you enjoyed my content, please consider to follow and clap for me to show your support for my work.
Anika Neela is Software Engineer 2 at Microsoft and has 4+ years of experience in the industry. She is also pursuing Masters in Machine Learning at Georgia Tech. She is passionate about technology, education, finance, fitness, fiction, poetry, and more.
