ThirdAI Customer FAQs

Bo Nielson
ThirdAI Blog
Published in
4 min readJun 27, 2024

In my 8 months at ThirdAI, we’ve spoken with over 200 clients, gone through several stages of our Go-To-Market cadence, and gained countless insights in the field of Generative AI. In meetings with executives across the enterprise, they shared excitement around the opportunity of Generative AI but the #1 objection that continued to come up was delivery delay (also known as POC Purgatory or Delinquency of Deliverables). Delayed projects brings unmeasurable risk to budgets, timelines, and of course, delivery. A major Global Systems Integrator (GSI) shared that out of 700 active projects, a very few are moving to production.

The focus of this write-up is to clarify the frequent questions about the distinctive technology that ThirdAI has.

Q. What is ThirdAI’s offering?

A. ThirdAI’s BOLT platform is designed for building NLP & Generative AI applications and specializes in addressing scale, latency, and privacy constraints for enterprises to minimize the time required to deploy GenAI capabilities. ThirdAI’s BOLT platform offers a comprehensive suite of push-button and customizable AI/NLP capabilities that can be seamlessly integrated into any software application. Our platform offers the following capabilities to build any search and nlp application:

  • ThirdAI Predict
  • ThirdAI Parse
  • ThirdAI Search
  • ThirdAI Rerank
  • ThirdAI Reformulate
  • ThirdAI Tune
  • ThirdAI Forecast
  • ThirdAI Generate
  • ThirdAI Protect

For technical details and case studies read our blogs: https://medium.com/thirdai-blog

Q. Does ThirdAI only offer pre-trained models? Can I build a custom domain specialized models?

A. Yes, ThirdAI’s unique architecture was built for extremely fine-grained customization of your AI, from custom training of models to specialized fine-tuning, all on commodity CPUs. Whether you have no desire to customize or you want perpetual customization, ThirdAI’s BOLT platform takes care of it.

Q. What kind of enterprises is ThirdAI ideal for?

A. ThirdAI is ideal for organizations that:

  • Want to quickly build and offer sophisticated AI capabilities to customers with minimal data science and engineering support.
  • Have no GPUs or limited GPU cycles and face growing AI demands outpacing GPU availability.
  • Find current AI solutions prohibitive in terms of cost and latency when scaling.

Q. Why should I use ThirdAI over other open source AI models?

A. The ThirdAI and open source options are meant for different experiences. The ThirdAI platform is designed to minimize the time to production for customized AI capabilities across the enterprise. Existing open-source solutions are built for experimentation and prototyping. Optimizing open source for production constraints or low-cost scalability could require dedicated engineering teams and years of effort. On the contrary, ThirdAI’s focus is on business considerations such as TCO, scale, latency, and privacy. As an end user, you directly define models that meet production constraints during inception. For example, LLM firewalls or NLP-driven searches have tight latency constraints of less than 10ms for inference even with 5000 tokens. No foundation models on Hugging Face will meet those requirements. Read Wayfair’s blog on how ThirdAI helps there. Another case study on PII redaction with latency and scale is presented here.

Q. How much time does it take to go live on ThirdAI?

A. ThirdAI specializes in minimizing the time to production for GenAI applications without the need for specialized hardware or data science experts. Most use cases are deployed and go live within a few days, though the final timeline can vary depending on the complexity and scale of integration.

Q. My company does not have high quality data for training ML/AI pipelines. Will ThirdAI still be useful for me?

A. Welcome to the age of Generative AI. You don’t need high-quality data to build an accurate AI solution. ThirdAI provides the capabilities to create accurate, high-quality AI solutions with inbuilt data generation features. Whether your organization has no data or terabytes of data, ThirdAI’s platform can get you up and running for your production needs in no time.

Q. When is ThirdAI not an ideal fit?

A. If your goal is to conduct research on neural network architecture changes, ThirdAI may not be suitable. Our stack optimizes the entire AI pipeline — from data ingestion to output. We recommend tools like TensorFlow or PyTorch for neural network architecture customization experimentation.

Q. My company is in a highly-regulated industry. Does ThirdAI facilitate compliance with mandates such as HIPAA, SOX, and GDPR?

A. Yes, ThirdAI is designed to support compliance with regulations such as HIPAA, SOX, and GDPR. ThirdAI software processes all data locally within your environment, ensuring that your data never leaves your secure premises. We never see your data, and you maintain complete control over it, facilitating compliance with stringent regulatory requirements.

Q. How do I customize ThirdAI?

A. You can customize ThirdAI’s foundation models for variety of domains. Please contact us for any specific requirements. We handle all kinds of custom, purpose built, downstream task. Whether you have data or need help with generating data, our APIs are built for all.

Q. I have a model trained in PyTorch or TensorFlow. Can I use ThirdAI’s package to deploy it for inference on CPUs?

A. No, ThirdAI requires models to be trained on our BOLT Engine due to our unique dynamic sparsifying computations. Training on BOLT is fast, and you can curate data using your existing model to train a BOLT model. If you do not have data, our push button APIs can generate a quality data with full coverage for any customized task. Contact us for more information.

Q. How can I engage with ThirdAI?

A. You can engage with ThirdAI in primarily two ways:

Build with ThirdAI: Deploy in Your Infrastructure: Contact us for a software license and deploy ThirdAI within your environment.

Enterprise: Joint Engagements: For tight deployment timelines, we offer collaborative projects to deliver quick, impactful results with our Software. We also have partnerships with GSIs for quick turnaround, compliance, and paperwork.

If you have additional question, please reach out to us at contact@thirdai.com.

--

--