Real-time model performance visualizations

Cecelia Shao
Jun 28, 2018 · 2 min read

At Comet.ml, we strive to help data scientists and machine learning engineers speed up the development and productionisation of their machine learning models.

A key part of the machine learning workflow is testing and evaluating iterations of these models. Visualizations are useful to compare various metrics and to track changes of metrics during job execution 📈📊

Image for post
Image for post
Tracking a keras model — plus I can export this chart as a JPEG to put into my presentation!

Especially since deep learning models run significantly longer than classical machine learning models (e.g. scikit learn), real-time visualizations can save time and compute (read: $$) by identifying errors and performance differences earlier. Instead of waiting 12+ hours to see how your model metrics and sharing screenshots, use real-time visualizations in Comet.ml to track performance and collaborate with your team.

Our original chart implementation overlaid all of the metrics on one chart. Based on user feedback and usability tests, we’ve introduced exciting new features for the Comet.ml chart builder!

With the new chart builder, you can:

  • Resize charts
  • Compare multiple metrics on a single chart (great for viewing training loss v. test loss)
  • Create, save, and update Saved Views (we start you off with a default view 👍🏼) — plus your entire Comet.ml team will be able to access these Saved Views!
  • Apply your Saved Views to other experiments (so you don’t have to build up the same view across experiments)
  • Export the charts as JPEG files (to put in your presentations)
Image for post
Image for post
A view into the charts builder — see a full example with this Comet.ml public project

“Stunning” — Nimrod L. our CTO 😉

We hope you find our new chart builder stunning like Nimrod — try out this multiple chart view with your own Comet.ml account!

Have feedback? We’d love to hear it on our Slack community or our Github repo!

Cecelia Shao is Comet.ml’s Product Lead 🚀🚀🚀

Comet.ml

Build better models faster

Cecelia Shao

Written by

Product @ Bowery Farming

Comet.ml

Comet.ml

Comet provides a self-hosted and cloud-based meta machine learning platform allowing data scientists and teams to track, compare, explain and optimize experiments and models.

Cecelia Shao

Written by

Product @ Bowery Farming

Comet.ml

Comet.ml

Comet provides a self-hosted and cloud-based meta machine learning platform allowing data scientists and teams to track, compare, explain and optimize experiments and models.

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store