If you work in the TV business, for sure you had to face with huge amount of work behind the post production. TV Shows usually don’t have particular complex pipeline to manage, compared a VFX post production. The amount of VFX in a daily TV show is almost tend to zero. Despite the CGI world, television has to deal with a enormous quantity of video needs to watch, log, cut, mix, color correct, quality control check, and lots of other things that the production house must have to do before delivery to the broadcast network; with a very short deadline. Lots of this operations are repetitive and in this article I’ll give you an overview about five tools that absolutely deserve attention in this industry field and can improve you workflow in post production, above all, referencing to unscripted tv shows.
We can all see the huge power of AI*, at the moment we are surrounded by a multitude apps that we use everyday. One of the biggest step AI did in the last decade is about analyzing images and since video is a sequence of images… lets see where TV stands.
1. Facial Recognition
Facial Recognition is one of most intriguing tool, you can automatically manage the clips based on the people faces in the shot. This possibility could really speed the workflow, especially if we are talking about a post production based on a very large footage and/or there are lots of contestants and you are looking for a specific one, for instance in a close up. Close Up shots are particularly difficult to log, because very rarely the director has the possibility to dedicate a camera for each contestants. The consequence is that human logs can’t report this kind of shots in a proper manner. Timecodes are most of the time vague, or the annotation is not what it was filmed. Especially if it’s an unscripted tv show production.
DaVinci Resolve 16
Neural Engine uses state of the art deep neural networks and learning, along with artificial intelligence to power new features such as speed warp motion estimation for retiming, super scale for up-scaling footage, auto color and color matching, facial recognition.
Apparently DaVinci Resolve 16 is the first commercial software that introduced facial recognition, It is enabled in the Studio Version.
2. Synthetic media
Synthetic media are contents generated by AI. There are lots of apps that can generate this particular media. One in particular it is an outstanding one: Synthesia. They are specialize in two core areas, translation and personalization. I’m going to talk the first one.
With Synthesia you record ones and then you can translate the video in all the languages you want. Of course, the perfect game for this technology is video marketing but it could be perfect for a production where the host leads the show a part from the contestants, or it could be very useful in a docufiction. It could be also indicate for news or similar contents, where it is necessary the translation of the contents. In the dubbing department, synthetic media is going to have a really strong impact.
3. Speech To Text Transcription powered by AI
This is a very handy tool. I find this tool absolutely useful, and right now the market is offering very good software with a very interesting price per minute. Here you can find an exhaustive article about this topic. Below there is a short list about the tools could be a good match for a television production, but really, the market nowadays covers pretty well all the businesses need from video marketing to television.
Rev’s Automated Transcription Software, apparently, is one of the most popular transcription software. You can expect 80% of accuracy with transcription powered by AI.
Google-Speech-To-Text uses an API powered by Google’s AI technologies. A very cool features, still in beta, it is the possibility to analyze up to five speakers recorded at the same time, from multichannel or just downmixed. And you can do it in a tons of different languages.
Watson-Speech-To-Text uses the well known Artificial Intelligence by IBM. It uses deep-learning AI algorithms to apply knowledge about grammar, language structure, and audio/voice signal composition to create customizable speech recognition for optimal text transcription.
For pricing and policy check the links above.
4. Video Classification
Video Classification is a video process machine learning based, where you can analyze the video contents and with the data that you have back after the process, you’re giving kind of super power to your contents. For example you can moderate inappropriate content, find the brands in the videos, path the movement of athletes during a game to identify plays for post-game analysis, labeling the footage and much more. Video classification is a huge argument to play with it. Setting a TV company server with the help of this technology it will be a winning strategy today without any doubt.
Amazon offers this service and it is connected with an AWS account. This kind of service is offered also by Google and IBM, plus lots of small and medium start up.
*Under the AI, in nowadays, forum and blogs refer a very vast field. If you have no idea what AI is, please take a look to this article from nvidia about the difference between Artificial intelligence, machine learning and deep learning.