Prompt2model: Create a Large Language Model With Just a Prompt
The easiest way to get an expert LLM
Prompt2Model (Viswanathan et al, 2023) trains small expert models using just a prompt as input. Training datasets and a base model are automatically retrieved given your prompt. Additional training data are also generated.
The chain of components required to achieve this is quite complex but the authors show that prompt2model generates expert models that are very cheap to build and run.
Here is another example:
It looks quite impressive.
This is a work by NeuLab (CMU) so you can expect it to be well-maintained and improved in the future.
The implementation of prompt2model is on GitHub (Apache 2.0 license). You will need an OpenAI API key to run it. They have also published a notebook running prompt2model on Google Colab.
This article is an extract from The Weekly Kaitchup, my newsletter. To receive extensive analysis and tutorials on recent advances in AI, subscribe to The Kaitchup:
