Text Analytics

Topic Modelling

When faced with a huge body of text, sometimes we may just want to see if there are common threads running through the text.

Topic modelling is a good way to do that. Basically, the algorithms search of clusters of words that may(or may not) be logical common threads…

Summarisation

Sometimes, we just want to quickly get the gist of a document or an article on the web.

There are a number of Python libraries out there that can help with that (or you can train your own), but the ‘sumy’ library is a good choice.

PDF Downloads

Going through a page to find and download PDFs can sometimes be a huge pain. We can easily automate this process.

We first import the following libraries -

• Beautiful Soup (bs4), to help us tease the good stuff out from HTML and XML

RSS Ingestion

If you don’t know what an RSS feed is (where have you been?), it’s a link which you can subscribe to get data in an structured format. Typically, we use RSS readers to subscribe to RSS feeds.

Getting data from RSS feeds can also be done through Python, and it’s a breeze…