FriendliAI Tech & ResearchShowcasing FriendliAI’s Integration with LiteLLMLiteLLM recently introduced FriendliAI as one of their LLM inference API providers. LiteLLM allows users to utilize over 100 large language…20h ago20h ago
FriendliAI Tech & ResearchBuilding AI-Powered Web Applications In 20 Minutes with FriendliAI, Vercel AI SDK, and Next.jsWith the development of AI technologies it has become much easier for anyone to build AI applications. By leveraging the AI solutions and…20h ago20h ago
FriendliAI Tech & ResearchLevel Up Your Client-Side Interactions with Friendli’s gRPC SupportAlongside HTTP methods, Friendli Engine, your favorite LLM serving engine for generating creative text formats, also offers ways to…21h ago21h ago
FriendliAI Tech & ResearchinFriendliAIDeploying Weights & Biases Model Checkpoints on Friendli Dedicated EndpointsIn this blog post, we’ll be exploring our new exciting integration feature between Weights & Biases (W&B) and Friendli Dedicated Endpoints…Jul 26Jul 26
FriendliAI Tech & ResearchinFriendliAIDeploying Your Inference Endpoints on AWS Sagemaker with Friendli ContainerThis blog post will guide you through creating an Amazon SageMaker Model from model artifacts stored in an S3 bucket and leveraging…Jul 25Jul 25
FriendliAI Tech & ResearchinFriendliAIIntroducing Structured Output on Friendli Engine for Building LLM AgentsLarge language models (LLMs) excel at creative text generation, but we often face a case where we need LLM outputs to be more structured…Jun 19Jun 19
FriendliAI Tech & ResearchinFriendliAIMeasuring LLM Serving Performance with LLMServingPerfEvaluatorTired of Fixing LLM Serving Benchmarks?Jun 4Jun 4
FriendliAI Tech & ResearchinFriendliAIBuilding a RAG Chatbot with Friendli, MongoDB Atlas, and LangChainRecently, LangChain introduced support for Friendli as an LLM inference serving engine. This integration allows you to leverage Friendli…May 28May 28
FriendliAI Tech & ResearchinFriendliAIMeta Llama 3 now available on FriendliAt FriendliAI, we’re on a mission to democratize access to cutting-edge generative AI models. That’s why we’re thrilled to announce the…May 28May 28
FriendliAI Tech & ResearchinFriendliAIEasily Migrating LLM Inference Serving from vLLM to Friendli ContainervLLM is an open-source inference engine that provides a starting point for serving your large language models (LLMs). However, when it…May 17May 17
