A mini-guide about using BERT for Natural Language Processing

Written by Jiazhen Zhu

Image for post
Image for post
Photo credit: Pixabay

BERT

Is this BERT from Sesame Street ??? Today I won’t talk about this yellow Muppet cartoon character but a machine learning technique for Natural language processing (NLP for short). BERT is short name for Bidirectional Encoder Representations from Transformers. It is developed by Google and published in 2018 by Jacob Devlin etc.

Agenda

  • What is Text Classification?
  • Data Preprocess
  • Experiment using CNN and LSTM
  • Experiment using BERT
  • CNN vs LSTM vs BERT
  • Conclusion

What is Text Classification?

Because text is unstructured format which doesn’t like structured table format, NLP plays a very…


A mini-guide about MicroService design for Data Pipeline

Written by Jiazhen Zhu

Image for post
Image for post
Photo credit: Pixabay

In the data engineering area, ETL and data pipeline are key points. Specially in a big company like Walmart, we have huge number of pipelines which need to be developed, tested, deployed and supported. I will show some challenges I face and present one solution below.

Challenges

  • How can we split monolithic pipeline into a couple small MicroService pipelines?
  • How can we reuse our code or MicroService across the team and organization?
  • How can we optimize the pipeline separately?
  • How can we test our pipeline more effectively?
  • How can we deploy our pipeline painless?

Solution


A mini-guide about speed layer data warehouse design

written by Jiazhen Zhu

designed by Global Governance Team

Image for post
Image for post
Photo credit: Pixabay

Motivation

The concept of big data has been popular around the world for a while, even back to a paper from Charles Tilly in the 1980s. To me, I started to get to know it during my undergraduate study in 2008. At the beginning, I thought the larger the data we have, the greater value and power we can get from it. …

Jiazhen Zhu

Data Engineer and Machine Learning Engineer

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store