A Secure Diwali: Celebrating with Javelin Advanced Data Protection

Anil Kumar
Javelin Blog
Published in
4 min readNov 15, 2023
Enterprise Grade LLM AI Gateway
Enterprise Grade LLM AI Gateway

As the world ignites with the glow of Diwali, the festival of lights, we at Javelin are dedicated to ensuring that your digital celebrations echo this joy while safeguarding your treasured data. In an era where information holds value akin to the gold and jewels bestowed by Lakshmi, the deity of wealth and prosperity revered during Diwali, we commit to protecting sensitive data with utmost vigilance.

PaLM Generative AI Models
PaLM Generative AI Models

Setting Up Secure Routes for Applications

At Javelin, the first step in this journey is the creation of abstraction Routes. These Routes act as conduits, connecting your applications with an ecosystem of AI providers and models, while also embedding data governance and compliance into the very fabric of your AI initiatives.

Why Abstraction Routes Matter?
Abstraction Routes simplify the complex process of integrating various AI capabilities into your applications. They serve as modular connectors that allow you to interchange AI models and providers with minimal changes to your underlying systems. This flexibility is vital for adapting to the evolving AI landscape and aligning with industry-specific compliance and governance requirements.

Creating Your Routes with Javelin

Here’s how to set up new Routes within the Javelin platform, using Google PaLM Models as an illustrative example:

1. Route for Conversational AI (PaLMChat):

Much like sharing sweets and gifts, warm exchanges that resonate with the heartfelt greetings of Diwali, securing personal interactions with the same care one would protect a flame from the wind. Setup your PaLMChat with the following.

curl https://api.javelin.live/v1/routes/PaLMChat \
-H "Content-Type: application/json" \
-X POST \
-H "x-api-key: your-api-key" \
-d '{
"name": "PaLMChat",
"type": "chat",
"enabled": true,
"model": {
"name": "chat-bison-001",
"provider": "google",
"weight": 0
},
}'

Here, PaLM’s chat-bison-001 model comes into play, ensuring that each interaction feels as warm and personal as a Diwali greeting.

Make sure to replace ‘your-api-key’ with your actual API key.

2. Route for Sentiment Analysis (PaLMEmbedding):

Understanding the subtle emotions behind a Diwali greeting, provides deep insights into sentiments while maintaining the sanctity of personal data.

curl https://api.javelin.live/v1/routes/PaLMEmbedding \
-H "Content-Type: application/json" \
-X POST \
-H "x-api-key: your-api-key" \
-d '{
"name": "PaLMEmbedding",
"type": "embedding",
"enabled": true,
"model": {
"name": "embedding-gecko-001",
"provider": "google",
"weight": 0
},
}'

By employing embedding-gecko-001, we bring you closer to what your users feel and say during this festive season.

3. Route for Text Generation (PaLMText):

The stories of Diwali are retold with added delight, carefully weaving words while protecting the threads of sensitive information.

curl https://api.javelin.live/v1/routes/PaLMText \
-H "Content-Type: application/json" \
-X POST \
-H "x-api-key: your-api-key" \
-d '{
"name": "PaLMText",
"type": "completions",
"enabled": true,
"model": {
"name": "text-bison-001",
"provider": "google",
"weight": 0
},
}'

This setup ensures that your applications can generate text completions, harnessing the power of PaLM’s text-bison-001 model.

The Advantages of Using Javelin’s Abstraction Routes

  • Flexibility: Switch between different AI models and providers without significant changes to your codebase.
  • Data Governance: Built-in features that help manage the way data is handled, ensuring adherence to privacy laws and regulations.
  • Compliance: Maintain compliance with industry standards and practices effortlessly as part of the Route configuration.

Updating Routes: Archiving & Data Protection

With the festive season comes a need for increased vigilance. Javelin’s advanced data protection strategies stand guard over your sensitive information. With Configurations for archiving and data leak prevention, we ensure that your data remains secure and compliant. Here’s how to do it:

curl https://api.javelin.live/v1/routes/PaLMText \
-H "Content-Type: application/json" \
-X PUT \
-H "x-api-key: your-api-key" \
-d '{
"name": "PaLMText",
"config": {
"rate_limit": 5,
"retries": 2,
"llm_cache": true,
"archive": true,
"cost_budget": 1000,
"dlp": {
"enabled": true,
"strategy": "mask",
"action": "none"
}
}'

Inspect: Customizable Templates for Scans & De-Identification

Just as the night watchmen patrol during Diwali, our configurable templates scan and anonymize sensitive data exchanged between applications and LLM providers. This vigilant oversight ensures that no unwanted information slips through, maintaining the sanctity of your digital celebrations.

De-Identification: Data Transformations Methods

  • Mask: Replaces sensitive data with innocuous characters.
  • Redact: Removes sensitive information, keeping private details like “javelin@example.com” confidential.
  • Replace: Substitutes sensitive data with alternate values, preserving the essence while protecting the specifics.
  • Anonymize: Transforms sensitive data with a cryptographic hash, ensuring irreversible security.

Supported Data Types: Hundreds of Built-In Data Types & Expanding

Currently focusing on text data, we are extending support to other data types such as images, documents, and structured data — ensuring that all forms of digital expression are protected under our watch.

Embracing the Festival with Confidence

As we celebrate Diwali, Javelin invites your enterprise to join us in heralding a new era of AI deployment. With our comprehensive solutions addressing the key challenges of AI in production, this festive season can be celebrated with the assurance of digital security, reliability, and operational excellence.

Let the lights of Diwali inspire us to illuminate the future of AI with innovation, integrity, and the festive spirit of prosperity and well-being.

curl https://api.javelin.live/v1/routes/query/PaLMText \
-H "Content-Type: application/json" \
-X POST \
-H "x-api-key: your-api-key" \
-d '{
"prompt": { "text": "Wishing everyone Happy Diwali!"}
}'
Let’s Build!
Let’s Build!

--

--