Posted by Daniel Smilkov, Sandeep Gupta, and Vishy Tirumalashetty
For example, our pre-packaged Pose estimation and Body segmentation models allow you to build new forms of user interaction and can form the basis for new accessibility tools. All of these models are published on NPM and you can use them with a few lines of code (no ML knowledge required!):
TensorFlow.js + AutoML
We are excited to announce the integration with Cloud AutoML Vision, a Cloud service that enables developers to train a custom model on their labelled data. If your use-case is related to image classification or object detection, you can use the UI to upload your data, train an edge model and directly export it to a TensorFlow.js model, without any coding. Note that custom models can be directly trained using the open-source TensorFlow.js library (or Python TensorFlow), but AutoML provides an easy-to-use service that automates this process for you.
To make it easy to deploy and run the models efficiently in TensorFlow.js, we published a @tensorflow/tfjs-automl library on NPM. Once you export the model, you can follow our step-by-step guides for image classification and object detection. The guides use the NPM library and show you how to load the pre-trained model in the browser and make a prediction on an image.
If you already have a custom model, AutoML can still be incredibly useful. AutoML Vision Edge models are optimized to a small memory footprint and offer low latency while delivering high accuracy. We worked with several customers and partners and got some amazing early results and feedback. CVP, a business and technology consulting company, has been evaluating some vision scenarios to help with workplace safety on edge-based models used in remote locations. Here is what Cal Zemelman, Director of Data science at CVP said on their results:
We are very excited about the early results our customers and partners are seeing and look forward to hearing more with this release.
You can train an AutoML Vision Edge model today. Once you train the model, you can export the TensorFlow.js model to your client-side application. With AutoML Vision Edge, you only pay for training for any usage beyond 15 node hours you get for free. There are no charges for exporting or client side predictions.
- To learn more about AutoML, click here.
- For object detection, follow the step-by-step guides on training and deploying to TensorFlow.js
- For image classification, follow the step-by-step guides on training and deploying to TensorFlow.js
- Learn more about the AutoML NPM library via the official documentation.