Get AI ready

--

Or How to create safe, MedTech ready GenAI Apps

Photo by National Cancer Institute on Unsplash

What are MedTech ready GenAI aps? I’ll go deeper in future post but essentially it comes down to industry knowledge and focused guidance. All while ensuring data security and patient privacy. This is the core issue around the hesitancy of hospitals and Care providers in general. They need to know that AI is ready for sensitive data (Intellectual Properties, PII, PHI).

Being AI ready really comes down the question “How do I protect patient data while gaining the power of Large Language Models and General Pre-trained Transformers?”

Generative AI teases the potential for massive efficiencies and insight especially in industries where deep subject matter expertise is hard to find. There are key industries that would gain from GenAI; Medical technology, Agriculture/Animal husbandry, and Advanced Manufacturing.

What benefits come from GenAI in regulated industries?

  • Untapped potential: Unstructured data encompasses text documents, social media conversations, images, and audio recordings — a rich source of insights often overlooked due to its complexity. AI orchestration platforms address this by providing tools for data ingestion, cleaning, and pre-processing.
  • Streamlining the Workflow: AI orchestration automates the tasks of extracting data from diverse sources, transforming it into a structured format, and feeding it to AI models in a timely and efficient manner. This eliminates manual intervention and streamlines the entire AI development lifecycle.
  • Maximizing AI Performance: By making unstructured data usable, AI orchestration unlocks the full potential of AI models. Structured data allows models to identify patterns and relationships more effectively, leading to more accurate predictions, improved decision-making, and enhanced AI performance across various applications.

However for each of these industries there are real risks that are currently a black box for Large Language Models that stymie innovation.

As a Software developer the key to taking advantage of Generative AI is the orchestration layer that connects industry specific data to “AI” to create “Generated insight”. AI orchestration is the key to innovative products that bring value to organizations.

The companies that incorporate AI orchestrators into their applications will be the new standard bearers of B2B software.

An AI Orchestrator powers innovation by allowing key sensitive data to provide context to a query of a general knowledge base without risk of data exposure.

In simplest terms what you really need to do is take generic advice from GenAI tools and make it tangible for a specific single person. That person has a huge personal corpus of knowledge and is looking for advice on moving forward and solving their specific problem not just some crowd-sourced information. Satisfying this specific person requires feeding “GenAI tools; LLMs, GPTs” with that persons’ most private and sensitive data.

What data is both necessary and too valuable to simply be given to the large SaaS AI?

Lets take Healthcare/Pharma as an example. Key innovations around streamlining patient experience and identifying novel therapeutics are extraordinarily risky with today’s LLM based AI systems.

What are the key capabilities of an AI orchestrator :

· Data Sandboxing- current systems combine large amounts of data across multiple points of context- by design. This is a real privacy risk.

Solution: Create isolated environments (sandboxes) where patient data is processed by the GAI engine. This prevents unauthorized access to patient data from other parts of the system.

· Privacy-Preserving Techniques-for individual hospitals, deep understanding of their proprietary data requires context for aligned interests; e.g. rare disease research only specific elements are necessary

Solution:: Explore techniques like federated learning that allow the GAI app to function without directly revealing individual patient information. This could take the form of “Small Language Models” that allow tokenized access for a LLM to query a restricted dataset.

· Model Explain-ability-: Ensure the GenAI model’s decision-making process is transparent and understandable. This helps doctors assess the reliability of the app’s recommendations and identify potential biases.

Innovation without the risk

AI orchestration acts like the maestro of a healthcare’s data symphony. Imagine all the instruments in an orchestra representing the various data sources you possess — clinical trials, research databases, patient information, electronic health records, and even social media sentiment around certain drugs- specific to your local region.

In essence, AI orchestration allows your company to harness the true potential of your data, leading to faster drug discovery, better-informed decisions, and ultimately, bringing life-saving medications to patients sooner.

Interested in learning more?

Here are my source lists:

Flipboard magazines:

AI orchestration: https://flipboard.com/@chriswynder/ai-orchestration-h35a5j99z?from=share&utm_source=flipboard&utm_medium=share

Developer Tools and Technology updates:

Learn more about OpenText’s tools to make you AI ready

--

--

Chris Wynder, Director of Marketing, OpenText
Chris Wynder, Director of Marketing, OpenText

Written by Chris Wynder, Director of Marketing, OpenText

I have turned laziness into a process automation consulting career. I need developers to make my life easier ;) so I write to help them help me