Analyzing StackOverflow job posts and the next technology trends

UPDATE 2018: I’ve created an analytics website for this data http://www.reallyhyped.com . Which is better than just having static graphs like in this article

I have been scraping StackOverflow job board (https://stackoverflow.com/jobs) for around 8 months now.

Collecting data and trying to see interesting trends. I like SO job posts because they have a limit of 5 tags that describe the job. Unlike scraping the post’s content that is full of buzz words, 5 tags I think is more precise proxy for any real employment trends and has less hype. Also the companies that pay for the job ad tend to be more diverse, from big enterprises to small and large shops, less startups.

So what do I see ?

The top 5 techs are the usual suspects. Java and Javascript are ~25% of the job posts with a little change over 2016. Python 15% increase and C# -12% decrease. No surprise here , Python is all the rage now with Data Science jobs.

What about web tech, F/E frameworks? ReactJS is exploding 60% increase , AngularJS is stagnating and VueJS is nowhere to be found(from 0 to 5 job posts in December). How is that possible, reading HackerNews I would think VueJS is the framework of the day. 2017 will be the year when the number of ReactJS jobs will surpass Angular’s.

Here is the percentage change for the top tags:

javascript -4.14%
java 5.94%
python 14.95%
c# -11.66%
sql -18.99%
php 1.66%
html -21.29%
c++ 20.26%
css -15.98%
Linux 9.76%
angularjs 3.37%
reactjs 58.91%

Conclusions ?

Learn ReactJS and Python to get a job in 2017, they are in demand and growing well above any other common tech.

Sources:

The data that I used is here https://github.com/aparij/soCareers-Data and the scraping tool is here https://github.com/aparij/soCareersScrape .

One day I will make the charts interactive…