Cross-Dataset Segmentation Models

Jonathan Striebel
Jun 4, 2019 · 2 min read

At scalable minds we work a lot with research labs in the Connectomics field and beyond to help them with automated image analysis and EM dataset reconstructions. We use state-of-the-art machine learning algorithms for automated dense reconstructions of neuron connections in brain tissue. Our alignment and segmentation tools are optimized to handle the terabyte-scale 3D EM datasets.

(left) Raw microscopy data from SegEM[1]. (right) Our
dense neuron segmentation method applied.

Usually, segmentation models require a high amount of training data. Gathering and annotating such datasets manually not only requires expert knowledge but also considerable resources and time. To minimize the data needed for a high-quality segmentation, we train our machine learning models on multiple annotated and available datasets, before fine-tuning on the actual training-data.

In preparation for the Connectomics Conference in Berlin, we validated this approach with two experiments presented here:

  1. How much training data is necessary to train a competitive model on the SegEM dataset [1]?
  2. Can we save on training data by fine-tuning a model trained on other datasets?

To evaluate the methods, we measure if a neuron was split into two segments, and if two neurons were merged wrongly. We optimized for a weighted error of splits and mergers, which compensates for the higher complexity of resolving merge errors.

Insight 1: 20M voxels training data suffice

Insight 2: Using pretraining 50–80% of data can be saved, 10M voxels suffice

We are currently working on improving this method, so that our models perform well even on unseen datasets having no training data at all. Get in touch with us if you would like to know more about our segmentation services or would like apply it to your own datasets.

[1] M Berning et al. SegEM: Efficient Image Analysis for High-Resolution Connectomics. Cell. 2015


scalable minds

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store