Top 6 Things You Need to Know About the OpenVINO™ 2022.3 LTS Release
Authors: Raymond Lo, AI Software Evangelist, OpenVINO™ Toolkit
Ryan Loney, Product Manager, OpenVINO™ Toolkit
Anisha Udayakumar, AI Software Evangelist, OpenVINO™ Toolkit
Zhuo Wu, AI Software Evangelist, OpenVINO™ Toolkit
Get ready to unpack the latest long-term support (LTS) release of the Intel® Distribution of OpenVINO™ Toolkit this new year. Wherever you are on your AI programming journey — if you want to quickly and easily develop, or learn how to develop, world-class AI applications and deploy deep learning inferencing workloads from edge to cloud — you will want to know all about this latest update of the AI inferencing toolkit.
1. What is an LTS release and how does it differ from other releases?
In the software industry, an LTS release is one whose main focus is to expand or consolidate features already introduced in the previous releases of the same product and guarantee long-term support for them. It provides AI developers with one year of bug fixes and two years of security patches from the date of the official release.
While the price to pay for this stability and longevity is that there are no additional features to such releases for their entire life cycle, the good news is that all the new capabilities introduced to OpenVINO this year will be included in the 2022.3 LTS release. Those features include dynamic shapes, automatic batching, performance hints, the AUTO plugin, and support for Intel’s new discrete GPUs (Intel® Arc™ and Flex Series) as well as 6th to 13th generation Intel® Core™ processors.
The LTS also includes the new API 2.0, which was introduced in OpenVINO 2022.1 earlier this year and designed to make it easier for AI developers to adopt and maintain code. More information on the API 2.0 and how to transition is available here.
2. What is new in the OpenVINO™ 2022.3 LTS release?
In addition to an integrated, stable, and well-tested release of the toolkit’s 2022 updates, OpenVINO 2022.3 LTS comes with support for additional deep learning models and devices.
AI developers will find broader support for transformer-based natural language processing (NLP) models like GPT and OpenAI Whisper, and others models like Stable Diffusion (Figure 1); improved portability and performance enhancements; an integration with Hugging Face Optimum; new Jupyter notebook tutorials for YOLOv7, Style Transfer (Figure 2), and 3D Point Cloud Segmentation (Figure 3); and more.
3. What type of hardware support does this release offer?
On the hardware side, the short story is that OpenVINO 2022.3 LTS runs faster and smarter on more GPUs than ever before. The full story is about performance boosts across all supported CPUs and GPUs, hand in hand with automatic device discovery and load balancing, dynamic inference parallelism, and selection of compute modes added to AUTO functionality — enabling multiple accelerators (e.g., multiple Intel Data Center GPU Flex Series) to be used at once to maximize inferencing performance.
And above all, we are quite happy to share that OpenVINO 2022.3 LTS officially fully supports Intel discrete GPUs and the latest generation of Xeon Scalable! This includes support for Intel® Arc™ and Flex Series, 1st to 4th generation Intel® Xeon® Scalable processors as well as 6th to 13th generation Intel® Core™ processors.
4. Why is support for discrete Intel® GPUs big news?
This is the first time OpenVINO is providing gold-level support for running inference workloads on Intel discrete GPUs. Backed by more than five years of experience optimizing, testing, and deploying inference on Intel® Processor Graphics (or “iGPU”), this is just the last step of a long journey that successfully brings OpenVINO to many affordable GPUs that are widely available for desktops, laptops, and servers.
5. Will the OpenVINO™ 2022.3 LTS break your existing AI code?
Not if that code was written or had already been ported to the new API 2.0.
If you plan on upgrading to future versions of OpenVINO in 2023 to leverage new features, keep in mind that these features and optimizations will not get backported to the 2022.3 LTS release. For production deployments, we recommend staying up to date with OpenVINO 2022.3 LTS dot releases until new features in 2023 are stabilized in next year’s LTS.
6. When should you upgrade and what is the best way to upgrade?
We recommend that everybody wishing to quickly develop and deploy high-performing AI applications use OpenVINO 2022.3 LTS. But, for whatever reason, if that is not possible and you don’t want or need to take advantage of all the great features released throughout the year, the previous LTS release, OpenVINO 2021.4 LTS, will be supported with security patches until 2024.
When deciding, it’s extremely important to keep in mind that LTS releases are the only ones for which we provide official bug fixes and security patches through dot releases over an extended period of time.
You can upgrade to OpenVINO 2022.3 LTS using the following command:
pip install --upgrade openvino-dev But make sure to check all your dependencies because the upgrade may update other packages beyond OpenVINO. If you wish to install the C/C++ API, pull a pre-built Docker image or download from another repository, visit the download page to find a package that suits your needs. If you are looking for model serving instructions, check out the new documentation.
Additional Resources:
Accelerate your models with 🤗 Optimum Intel and OpenVINO™
Notices & Disclaimers
Intel technologies may require enabled hardware, software or service activation.
No product or component can be absolutely secure.
Your costs and results may vary.
© Intel Corporation. Intel, the Intel logo, and other Intel marks are trademarks of Intel Corporation or its subsidiaries. Other names and brands may be claimed as the property of others.
