Member-only story

Conflicting Prompts, and the Art of Building Enterprise Prompt Stores

Reinforcement Learning based automated curation of Prompt Stores

Debmalya Biswas
Towards Data Science
10 min readAug 20, 2024

--

Introduction

Prompts today are the primary mode of interaction with large language models (LLMs). Prompts need to be tuned according to the user need, providing the right context and guidance to the LLM — to maximize the chances of getting the ‘right’ response.

It has led to the rise of prompt engineering [1] as a professional discipline, where prompt engineers systematically perform trials, recording their findings, to arrive at the ‘right’ prompt to elicit the ‘best’ response. The list of such successful prompts are then organized in the form of a library such that they can be efficiently reused — referred to as a prompt store.

Unfortunately, curating and maintaining a high quality prompt store remains challenging. The overarching goal of a prompt store is to be able to retrieve the optimal prompt for a given task, without having to repeat the whole experimentation process. However, this retrieval is easier said than done primarily due to the overlapping nature of prompts.

Problem Statement

Let us try and understand the issue of overlapping prompts with the help of a couple of prompts from the field of content writing (one of the areas with highest Gen AI adoption today):

--

--

Towards Data Science
Towards Data Science

Published in Towards Data Science

Your home for data science and AI. The world’s leading publication for data science, data analytics, data engineering, machine learning, and artificial intelligence professionals.

Debmalya Biswas
Debmalya Biswas

Written by Debmalya Biswas

AI/ML, Privacy and Open Source | x-Nokia, SAP, Oracle | 50+ Patents https://www.linkedin.com/in/debmalya-biswas-3975261/

Responses (1)