James PogBuilding your own LLM API with AWS Bedrock and LambdaIn this short and sweet tutorial, I wanted to highlight some tricky parts to the processing of using the recent AWS Bedrock release to…Nov 30, 20231Nov 30, 20231
Fabio MatricardiinArtificial CornerYour Local LLM on your Network with FastAPI — part 2Learn how to run your local FREE Hugging Face Language Model with Python, FastAPI and Streamlit.Aug 3, 20232Aug 3, 20232
Fabio MatricardiinArtificial CornerA FastAPI for your Local LLM — part 1Take Control of Your Local LLM with a Personal API: A Step-by-Step Guide to setup your own API for the LLM running on your PC as a service…Jul 27, 20235Jul 27, 20235
Incletech AdminHow to Deploy LLM for Free of Cost.A step-by-step guide to deploy a large language models on production at zero cost.Dec 8, 20231Dec 8, 20231
Qendel AIThe Easiest and Cheapest Way to Deploy Finetuned Mistral 7B Instruct Model (or Any Model)An Easy and Cheap Way to Deploy a Finetuned Mistral 7B Instruct Model (or any model) on HuggingFace Inference EndpointsOct 12, 20233Oct 12, 20233
Sergei SavvovinBetter Programming7 Frameworks for Serving LLMsFinally, a comprehensive guide into LLMs inference and serving with detailed comparison.Aug 11, 202317Aug 11, 202317
DatadriftersinDev GeniusvLLM + AutoAWQ: Fastest Way To Serve LLMsJoin our next cohort: Full-stack GenAI SaaS Product in 4 weeks!Nov 2, 20232Nov 2, 20232
ModelZServing fine-tuned large language model with vLLMFine-tuned large language models (LLM) are becoming increasingly popular in AI applications. These powerful language models are widely used…Aug 23, 2023Aug 23, 2023
WoyerainArtificial Intelligence in Plain EnglishHow to use Llama 2 with an API on AWS to power your AI appsA quick start guide how to use the most worthy competitor yet to ChatGPTJul 19, 202314Jul 19, 202314