How to

Search products using text and image with CLIP and Python

An e-commerce search engine, built right in your browser

Have you ever had a wonderful pair of shoes that were just getting worn out, and you wanted to find another similar pair? Sometimes it’s tough to know exactly what words to use.

Amazon has a feature that lets you snap a picture and find similar items in their store. That’s great for Jeff Bezos, but not so good if you have your own e-commerce store and want that feature.

So in this notebook we’re going to build a simple search engine that will let you use images (or text) to search through a catalog of fashion items.

In later notebooks we’ll flesh it out with endpoints (for remote access), scaling, fine-tuning and cloud deployment. But for now let’s keep it dead simple.