Feb 23
The secret of deploying GPT-3 app
How to deploy GPT-3 app? We will deploy State-of-the-Art NLP model in matter of minutes.
Free tier account
We will use two APIs to deploy GPT-3. Both are available via free tier. Credit card is not required. The source code is hosted in your Github repository. That is all.
The GPT-3 is available via OpenAI API. It will require registration. The free tier will grant you 18 USD of free credit. There is no need for a credit card. The registration process is self-explanatory otherwise.
We have now account created. Log in to the API. Then click the “View API keys”-section. We are able to generate new secret keys in this page. Be careful not to share these secret keys.
Deploy
We generate the app via Streamlit. Streamlit has free tier. We will use it to deploy our app. The source code of this app is hosted on your Github repository.
A sample Github repository is available here. The repository includes the app.py file. It is coded in Python. I share an example app here. It will help you get started.
The Github repository includes Requirements.txt too. See an example here. It defines the packages required by our Streamlit app.
The Streamlit will need access to your Github repository. The OpenAI secret keys are inserted to the app advance settings.
We can now deploy the app.
Register your app
The app is now available. Congratulations! It may seem too simple, but you have an app available to showcase to anybody.
The deployment of GPT-3 comes with a responsibility. Such large language models are subject to misuse. Toxic speech is one such application.
GPT-3 apps are validated by OpenAI to prevent misuse. The deployment documentation and review process is explained here.
Be sure to submit your app for the validation. This way your API access is not revoked.
Last update: 22.02.2022
