For those who haven’t heard it yet, NLP’s ImageNet moment has arrived; approaches such as ULMFiT, ELMo, OpenAI GPT, and BERT have gained significant traction in the community in the last year for many language understanding tasks. In his blog, our lab member Jack Koch investigates how to apply the unsupervised pretraining to language generation by using AllenNLP and ELMo for semantic parsing. Check out the blog post at Applying Unsupervised Pretraining to Language Generation: Semantic Parsing + ELMo
