Natural Language Processing (Part 8)-Putting it All Together
📚Chapter 2: Sentiment Analysis (Logistic Regression)
Putting it All Together
You will now use everything that you learned to create a matrix that corresponds to all the features of your training example. Specifically, I will walk you through an algorithm that allows you to generate this x matrix.Let’s take a look at how you can build it.
General Overview
Previously, you saw how to preprocess a tweet like this one to get a list of words that contain all the relevant information for the sentiment analysis tasks in NLP. With that list of words, you would be able to get a nice representation using a frequency dictionary mapping. And finally, get a vector with a bias unit and two additional features that store the sum of the number of times that every word on your process tweets appears in positive tweets and the sum of the number of times they appear in negative ones.
In practice, you would have to perform this process on a set of m tweets. So given a set of multiple raw tweets, you would have to preprocess them one by one to get these sets of lists of words one for each of your tweets. And finally, you’d be able to extract features using a frequencies dictionary mapping. At the end, you would have a matrix, X with m rows and three columns where every row would containthe features for each one of your tweets.
General Implementation
The general implementation of this process is rather easy. First, you build the frequencies dictionary, then initialize the matrix X to match your number of tweets. After that, you’ll want to go over through your sets of tweets carefully deleting stop words, stemming, deleting URLs, and handles and lower casing. And finally, extract the features by summing up the positive and negative frequencies of the tweets. For this week’s assignment, you’ve been provided some helper functions, build_freqs and process_tweet. However, you’ll have to implement the function to extract the features of a single tweet. That was a lot of code, but at least now you have your X matrix. And in the next video, we will show youhow you can feed in that X matrix into your logistic regression classifier. Let’s take a look at how you can do that.
Please Follow coursesteach to see latest updates on this story
If you want to learn more about these topics: Python, Machine Learning Data Science, Statistic For Machine learning, Linear Algebra for Machine learning Computer Vision and Research
Then Login and Enroll in Coursesteach to get fantastic content in the data field.
Stay tuned for our upcoming articles where we will explore specific topics related to NLP in more detail!
Remember, learning is a continuous process. So keep learning and keep creating and sharing with others!💻✌️
Note:if you are a NLP export and have some good suggestions to improve this blog to share, you write comments and contribute.
if you need more update about NLP and want to contribute then following and enroll in following
👉Course: Natural Language Processing (NLP)
References
1- Natural Language Processing with Classification and Vector Spaces
