Intel Employs Machine Learning to Computer Graphics Creation
Author: Sanket Save, Software Enabling and Optimization Engineer
Introduction
When the public thinks of Intel, many people naturally think of processors and other chips, not software. But Intel has large teams of software engineers working directly with ISV (Independent Software Vendor) partners to apply artificial intelligence/machine learning (AI/ML) and other Intel software optimizations to help accelerate performance and resolve customer challenges.
Arnold Renderer + Open Image Denoise
A recent project with Autodesk, a major player in professional graphics creation, incorporated Intel’s Open Image Denoise Library (a component of the Intel® oneAPI Rendering Toolkit), into Autodesk’s newly launched Arnold Renderer version 7. Arnold 7 was a big release for Autodesk. One of the main themes of Arnold 7 in enhancing creative content and graphics development was improving performance and interactivity.
“There are a lot of improvements around this topic in all the releases we’ve done this year and in Arnold 7.” ~ Frederic Servant, Senior Software Development Manager, Autodesk.
“The integration of Intel’s Open Image Denoise is completely part of this performance play. With stochastic path tracers like Arnold, Noise is the main thing we are fighting, and being able to remove the noise without altering the quality of render is a big shortcut. This applies to final frame renders, and Cinesite recently used Intel’s denoiser in production to cut down their render times significantly with Arnold. But it’s also useful when you do not need the highest quality when speed is more important. For dailies, for example, for being able to do more iterations at a level of quality that is not final but good enough to make creative decisions. The quality of OIDN’s denoising is really good, but it’s also very fast, and in fact, fast enough to allow noise-free interactive rendering in some use cases. This is impressive.” ~ Frederic Servant, Senior Software Development Manager, Autodesk.
Machine Learning for “Denoise”
Within Intel, we completed a lot of work on applying artificial intelligence/machine learning (AI/ML) to speed up denoising, which is a step in the graphics creation process that precedes and complements the high-resolution rendering of the final image.
For example, the animated movie, The Addams Family 2 requires very high-resolution images. The movie’s creative team at digital entertainment studio Cinesite used the Intel denoiser and Arnold to save significant amounts of time (and money) while creating The Addams Family 2. Kenny Chang, Cinesite head of lighting and compositing, said Cinesite used the Intel denoiser on every shot of The Addams Family 2, with a 10% to up to 25% gain in efficiency in rendering.¹(See this case study for more details.)
Our final estimates are that we made about a 20-percent savings, part-way through the project,” Driskill said. Using AI To Scrub Image Noise (And Save Money) In The Addams Family 2 (forbes.com).
Says Chang, “We used Intel’s denoiser on every shot of The Addams Family 2 and were able to gain a 10% to 20% — and sometimes 25% — efficiency in rendering, saving thousands of hours in rendering production time. That allowed artists to focus more on the creative aspect of moviemaking. Which meant they were able to spend their time lighting shots and making the visuals more intricate and complex, rather than spending time troubleshooting sample noise.”
Efficiency gains were due to optimizations by using Intel Open Image Denoise software.
The Intel Advanced Rendering and Visualization Architecture team created ML models which detect noise in an image, including variations in light or color, shadows, specks, and other problems. The Intel team trained the ML model by feeding the neural network tens of thousands of images, teaching the model to recognize issues and quickly optimize the image. The algorithm checks an image’s shapes, textural detail, and patterns from render and pixel noise and clears away the noise.
Intel® Open Image Denoise
Denoising is a step that animators use in both final rendering and during that animators use in both the final rendering and iteration stage to save time and deliver high-fidelity productions. In the latter case, denoising analyzes an image before moving to the compute-intensive rendering stage, much as a writer might create a rough draft for an editor to look at. A good denoiser — and Intel has pioneered the use of machine learning in a CPU-based denoiser — can identify issues in an image and quickly resolve many of them, allowing the animator to decide if the image needs more work before it is sent to the more time-consuming rendering step. Saving compute time saves money, of course, and allows a movie director to meet production deadlines with higher-quality images.
The flexible C/C++ API in Open Image Denoise makes integration very easy. In this particular case with Arnold, only 10 lines of code were added. Pre-filter is enabled for enhanced quality. And because AI/ML enables an application to keep learning as more data is run through the model, the Intel denoiser will keep improving its ability to clean up images quickly.
It is important to speed up the final rendering stage how quickly a denoiser does its job. ISVs such as Autodesk are putting more focus on interactivity. An artist working on a scene wants to decide whether to continue tweaking or move the image along to the final rendering stage. The denoiser tells the animator if the scene is worthy of going all the way to the final rendering. It doesn’t have to be high-end, but the animator wants to see a cleaned-up version so they can make a decision right away. Then, when the artist has finished the scene, it can be sent off to the rendering farm — running hundreds of Intel® Xeon® processors 24/7 — for the final output. The denoise function is critical in interactive rendering as well as final rendering.
CPUs Delivering Stellar Results for Rendering
Given the rise in popularity of GPUs, you might be asking, “Why are we still talking about the CPU?” The fact is that almost ALL high-quality rendering for the film is done on CPUs, and for several good reasons.
First, GPUs only go fast when everything is in their local memory. Film studios routinely render final scenes over 100 GB in size, which is too large for GPU memory.
Second, GPUs are designed to do the same thing to a lot of data at once. However, ray tracing is very incoherent (each ray can go a different direction, intersect different objects, shade different materials, access different textures), and this access pattern degrades GPU performance significantly, unlike CPUs.
Finally, high-end rendering often relies on complex shading networks, so often ray tracing is not the dominant cost. This is further complicated by the fact that there are often dependencies on third-party shaders — which cannot be ported readily to the GPUs.
Open Image Denoise has two important advantages: it runs on ubiquitous CPUs, and it is AI-based. It is fast, high quality, and CPU-powered. That solution was not there before; now users have more options. Previous CPU-based denoisers were very slow, primarily because they were not AI-based. With Open Image Denoise, denoising is almost instant, which means artists can perform CPU-based interactive rendering and accelerate the rendering workload to speed production.
For more information about Intel’s Open Image Denoise, visit https://www.openimagedenoise.org and https://intel.com/oneAPI-RenderKit.
Notices and Disclaimers
¹Testing Date: Results are based on data conducted by Cinesite 2020–21.10% to up to 25% rendering efficiency/thousands of hours saved in rendering production time/15 hrs per frame per shot to 12–13 hrs. Cinesite Configuration: 18-core Intel® Xeon® Scalable processors (W-2295) used in the render farm, 2nd gen Intel Xeon processor-based workstations (W-2135 and -2195) used. Rendering tools: Gaffer, Arnold, along with optimizations by Intel® Open Image Denoise.
Intel does not control or audit third-party data. You should consult other sources to evaluate accuracy.
Performance varies by use, configuration, and other factors. Learn more at www.Intel.com/PerformanceIndex
Your costs and results may vary.
Intel technologies may require enabled hardware, software, or service activation.
Intel does not control or audit third-party data. You should consult other sources to evaluate accuracy.
© Intel Corporation. Intel, the Intel logo, and other Intel marks are trademarks of Intel Corporation or its subsidiaries.
Other names and brands may be claimed as the property of others.
