Prefix Tuning: Lightweight Adaptation of Large Language Models for Customized Natural Language Generation

Source: https://arxiv.org/pdf/2101.00190.pdf

Introduction

Natural language generation (NLG) models like the GPT series have enabled remarkable progress on conditional text generation tasks such as summarization and table-to-text.