Sep 7, 2018 · 1 min read
It looks like you didn’t run create_lookup_tables() function on YOUR dataset. For the original data used in the tutorial, I have searched for words, “Good”, “Morning”, and “you”, and I couldn’t find those words in the small_vocab_en.txt.
Also, I want to point out two more things.
First, It is better to make strings lower cases. Even though you want the machine handle differently on lower/upper case letters, there are not enough example sentences using upper case letters, and they are not meaningful to understand the sentence itself.
Second, like in your example sentence, “you?” is should be split into two parts, “you” and “?”. Furthermore, it is better making “?” as a special character.
