Ozonetel AI
Published in

Ozonetel AI

Experiments in compressing Sentence Embeddings

Photo by Finn Mund on Unsplash
  1. Get 768 dimension sentence-transformers/paraphrase-mpnet-base-v2 embedding for each review.
  2. Build an alternate embedding space using Dr. Kumar’s algorithm.
  3. The alternate embedding space can be represented in a bit representation. That is, each dimension is represented using 1 bit.
  4. Use the new embedding for downstream tasks like classification.

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store