Open in app
Home
Notifications
Lists
Stories

Write
Curt Tigges
Curt Tigges

Home

5 days ago

Building a Transformer-Powered SOTA Image Labeler

An in-depth tutorial on getting SOTA results on multi-label classification using the current state-of-the-art model from the Query2Label paper — In my continued effort to learn more about transformers, I came across an interesting paper: Query2Label: A Simple Transformer Way to Multi-Label Classification. This was particularly relevant to me since I had just implemented the Vision Transformer, and also because one of my first projects in deep learning was an…

18 min read

Building a Transformer-Powered SOTA Image Labeller
Building a Transformer-Powered SOTA Image Labeller

Jun 26

Building the Vision Transformer From Scratch

A detailed guide to my implementation of the original Vision Transformer paper “An Image is Worth 16x16 Words: Transformers for Image Recognition At Scale.” — Though originally developed for NLP, the transformer architecture is gradually making its way into many different areas of deep learning, including image classification and labeling and even reinforcement learning. It’s an amazingly versatile architecture and very powerful at representing whatever it’s being used to model.

Machine Learning

9 min read

Building the Vision Transformer From Scratch
Building the Vision Transformer From Scratch
Curt Tigges

Curt Tigges

Following
  • Donald J. Robertson

    Donald J. Robertson

  • James J. Hughes PhD

    James J. Hughes PhD

  • Arthur Juliani

    Arthur Juliani

  • Diego Fernández Giraldo

    Diego Fernández Giraldo

  • Arets Paeglis

    Arets Paeglis

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Knowable