Create a Text Generation Web App with 100% Python (NLP)

GPT–3 is a state–of–the–art text generation natural language processing (NLP) model created by OpenAI. You can use it to generate text that resembles text generated by a human.

This course will cover how to create a web app that uses an open–source version of GPT–3 called GPT–Neo with 100% Python. That’s right, no HTML, Javascript, CSS or any other programming language is required. Just 100% Python!

You will learn how to:

Implement GPT–Neo (and GPT–2) with Happy Transformer

Train GPT–Neo to generate unique text for a specific domain

Create a web app using 100% Python with Anvil!

Host your language model using Google Colab and Paperspace

Installations:

NONE!!! All of the tools we use in this tutorial are web–based. They include Google Colab, Anvil and Paperspace. So regardless of if you’re on Mac, Windows or Linux, you will not have to worry about downloading any software.

Technologies:

Model: GPT–Neo an open–source version of GPT–3 created by Eleuther AI

Framework: Happy Transformer an open–source Python package that allows us to implement and train GPT–Neo with just a few lines of code

Web technologies: Anvil a website that allows us to develop web app using Python

Backend technologies: We’ll cover how to use both Google Colab and Paperspace to host the model. Anvil automatically covers hosting the web app.