Homepage
Open in app
Sign in
Get started
UbiOps Tech
Tech stories from the team at UbiOps
Follow
Data Privacy and AI in Healthcare
Data Privacy and AI in Healthcare
Artificial intelligence (AI) has the potential to significantly improve efficiency in the medical field. However, as the healthcare sector…
CL
Sep 4
What is multi-model routing?
What is multi-model routing?
Multi-model routing is a process of linking multiple AI models together. The routing can either be done in series or in parallel, meaning…
CL
Jun 20
Reducing inference costs for GenAI
Reducing inference costs for GenAI
For users of GenAI models, especially large language models (LLMs), inference costs remain one of the largest costs of using GenAI for…
CL
May 28
Creating a front-end for your Mistral RAG
Creating a front-end for your Mistral RAG
In this article we’ll create a front-end for that deployment, using Streamlit. As previously mentioned, we’ll be using the UbiOps Python…
Siwan Tunc
May 27
How to optimize inference speed using batching, vLLM, and UbiOps
How to optimize inference speed using batching, vLLM, and UbiOps
Let’s learn how to increase data throughput for LLMs using batching, specifically by utilizing the vLLM library.
CL
May 16
Deploy Llama 3 8B in under 15 minutes using UbiOps
Deploy Llama 3 8B in under 15 minutes using UbiOps
What is special about the instruct version of Llama 3? Deploy it in 15 minutes!
CL
Apr 25
Deploy Gemma 7B in under 15 minutes with UbiOps
Deploy Gemma 7B in under 15 minutes with UbiOps
What can you get out of this guide?
CL
Apr 19
What is model serving?
What is model serving?
Model deployment or model serving designates the stage in which a trained model is brought to production and readily usable. A…
CL
Mar 19
Deploy Gemma 2B for free using UbiOps
Deploy Gemma 2B for free using UbiOps
What can you get out of this guide?
CL
Mar 7
Top 6 current LLM applications and use cases
Top 6 current LLM applications and use cases
We discussed how to classify a Large Language Model (LLM), so let’s talk about the different ways LLMs can be used in the real world. The…
CL
Feb 11
About UbiOps-tech
Latest Stories
Archive
About Medium
Terms
Privacy
Teams