Homepage
Open in app
Sign in
Get started
OpenVINO™ toolkit
OpenVINO toolkit (Open Visual Inference and Neural network Optimization) is a free AI toolkit facilitating the optimization of a deep learning model from a framework and deployment using an inference engine onto Intel hardware.
Build
Optimize
Deploy
Scale
Download
Follow
How to Build Faster GenAI Apps with Fewer Lines of Code using OpenVINO™ GenAI API
How to Build Faster GenAI Apps with Fewer Lines of Code using OpenVINO™ GenAI API
Authors: Raymond Lo, Dmitriy Pastushenkov, Zhuo Wu
Raymond Lo, PhD
Jul 9
How to run OpenVINO™ on a Linux AI PC
How to run OpenVINO™ on a Linux AI PC
Benefit from CPU, GPU, and NPU
Adrian Boguszewski
Jul 8
Why and How to Use OpenVINO™ Toolkit to Deploy Faster, Smaller LLMs
Why and How to Use OpenVINO™ Toolkit to Deploy Faster, Smaller LLMs
With slim deployment packages, powerful AI performance, and official Intel support, OpenVINO is ideal for running your LLM applications.
OpenVINO™ toolkit
Jul 2
Reduce LLM Footprint with OpenVINO™ Toolkit Weight Compression
Reduce LLM Footprint with OpenVINO™ Toolkit Weight Compression
Create lean LLMs using weight compression with the OpenVINO™ toolkit. Reduce LLM size, memory footprint, and GPU requirements.
OpenVINO™ toolkit
Jul 2
Accelerating SpeechBrain emotion recognition using OpenVINO™ and NNCF
Accelerating SpeechBrain emotion recognition using OpenVINO™ and NNCF
Learn about SpeechBrain, an open-source speech processing toolkit, and its optimization using Intel® OpenVINO™ and NNCF.
Pradeep Sakhamoori
Jun 25
Join Us Live or On-Demand for Exclusive AI Training
Join Us Live or On-Demand for Exclusive AI Training
We are excited to announce a new tutorial-based web series designed to provide developers with hands-on training in the world of AI.
OpenVINO™ toolkit
Jun 25
Introducing OpenVINO 2024.2:
Introducing OpenVINO 2024.2:
OpenVINO 2024.2 brings new AI capabilities: LLM-specific APIs, improved model serving, performance optimizations, new models and more!
OpenVINO™ toolkit
Jun 17
How to Serve Models on NVIDIA Triton Inference Server* with OpenVINO Backend
How to Serve Models on NVIDIA Triton Inference Server* with OpenVINO Backend
Integrate OpenVINO backend for Triton Inference Server, eliminating the need for a complete shift to OpenVINO™ Model Server.
OpenVINO™ toolkit
May 24
Mastering Multimodal AI with LLaVA-NeXT and Advanced Quantization Techniques (NNCF)
Mastering Multimodal AI with LLaVA-NeXT and Advanced Quantization Techniques (NNCF)
Explore the capabilities of multimodal AI and how OpenVINO™ optimizes these systems for real-world applications focusing on LLaVA-NeXT.
OpenVINO™ toolkit
May 22
Unleashing the Power of Multimodal AI with Pix2Struct and Optimum Intel
Unleashing the Power of Multimodal AI with Pix2Struct and Optimum Intel
Explore the capabilities of multimodal AI and how OpenVINO™ optimizes these systems for real-world applications focusing on Pix2Struct.
OpenVINO™ toolkit
May 22
Build AI agents with LangChain and OpenVINO™
Build AI agents with LangChain and OpenVINO™
Let’s take a look at how to implement this process with OpenVINO™ and LangChain through a simple example.
OpenVINO™ toolkit
May 17
LangChain officially supports OpenVINO™ now!
LangChain officially supports OpenVINO™ now!
Now we can directly call OpenVINO™-based components in LangChain, including LLM, Text Embedding and Reranker.
OpenVINO™ toolkit
May 17
Paint Your Dream with AI PC
Paint Your Dream with AI PC
Learn how Generative AI can help to not only write your dream but also visualize it, on an AI PC!
OpenVINO™ toolkit
May 16
Building a Gen AI Assistant Chatbot on AI PC
Building a Gen AI Assistant Chatbot on AI PC
Discover how we can do this: Creating a virtual travel assistant that can help plan my next travel to Rome!
OpenVINO™ toolkit
May 13
Introducing OpenVINO™ 2024.1:
Introducing OpenVINO™ 2024.1:
Discover the new features of OpenVINO 2024.1 and its position in the ever-evolving landscape of AI inferencing and deployment.
OpenVINO™ toolkit
May 6
Unlock the Power of AI on Your Laptop or AI PC with OpenVINO™
Unlock the Power of AI on Your Laptop or AI PC with OpenVINO™
Take advantage of the new AI PC features like improved collaboration, productivity, and creativity- get started with AI and OpenVINO!
OpenVINO™ toolkit
May 1
Deployment of Llama3 on Your AI PC with OpenVINO™
Deployment of Llama3 on Your AI PC with OpenVINO™
The development speed of large language models (LLMs) is astonishing. On April 18, 2024, Meta officially announced the new generation of…
OpenVINO™ toolkit
Apr 24
About OpenVINO-toolkit
Latest Stories
Archive
About Medium
Terms
Privacy
Teams