AI Quick-Select Tool

Now in 3D and Faster Than Ever

Albane le Tournoulx de la Villegeorges
WEBKNOSSOS
Published in
2 min readSep 2, 2024

--

In June 2023, we integrated Meta’s AI model, SAM: Segment Anything, into WEBKNOSSOS, enabling users to segment cells in EM data with just a simple rectangle. Now, one year later, we’ve significantly enhanced the quick-select tool, making 3D cell annotation faster and more intuitive than ever!

Segmenting a cell in 3D with the quick-select tool.

How Does It Work?

Getting started is easy. Open your annotation and activate the quick-select tool. In the tool settings (located at the top right of the screen), select your desired prediction depth. Currently, WEBKNOSSOS can predict up to 16 sections, with more to come in future updates!

You can now choose between two techniques for automatic cell annotation:

  • Draw a rectangle around the cell, just like before.
  • Click once inside the cell you want to annotate. WEBKNOSSOS will automatically detect the cell boundaries and track them through the number of sections you’ve set.

After the initial annotation, be sure to scroll through the sections to check for any errors. If you spot any, you can easily correct them using the traditional brush tool.

Watch this video to see how it works in action:

Quick-select tool in WEBKNOSSOS

Demo Workflows

Here are some real-time examples of different structures annotated with just a few clicks using the AI quick-select tool, with the prediction depth set to 16 sections. Watch the video here:

Demo annotation workflows with the quick-select tool

AI technology in WEBKNOSSOS

The quick-select tool in WEBKNOSSOS is powered by SAM2, the new cutting-edge model from MetaAI designed for real-time, promptable object segmentation in both images and videos. This model delivers faster and more precise results. Additionally, by running the model on our server rather than in the browser, we’ve significantly enhanced the tool’s speed and performance. With WEBKNOSSOS, you can easily experience the power of SAM2 firsthand — no installation required.

We hope you’ll appreciate the improvements made to the quick-select tool. Create a free account on webknossos.org and test the AI quick-select tool on your data today! Don’t forget to follow us on X and Mastodon to stay updated on our latest features.

--

--

WEBKNOSSOS
WEBKNOSSOS

Published in WEBKNOSSOS

WEBKNOSSOS: Visualize, share and collaboratively annotate your large 3D image datasets online. Here we introduce new features and share insights into the WEBKNOSSOS development roadmap.

Albane le Tournoulx de la Villegeorges
Albane le Tournoulx de la Villegeorges

Written by Albane le Tournoulx de la Villegeorges

Marketing Manager and Visual Designer at scalable minds

No responses yet