Six Tools That I Use Daily as Data Science
Increase your productivity with these tools for Data Science
I worked as a data science developer for a part-time job for two years during my full-time job as AWS Cloud Architect/Solution Architect. After two years, I decided to stop working because of many reason, which I will publish in another post.
During two years journey, I used these five tools and never turned them off.
MS Teams: I have to say that I am a big hater of Microsoft and all its products. I would not say I like windows, SharePoint, MS Office and the rest of Microsoft technologies and products. Nevertheless, here comes big but. I am pretty surprised how smoothly MS Teams works. It is the first thing created by Microsoft, and I like it. I used MS Teams during my school time. I did not face any problems while using this application in 3 years. I appreciate the opportunity to create a hierarchy of people in the company, but these features are not the most important for everybody. Video calls work well. The only problem is the internet connection of each participant in a call. MS Teams provide an interactively way to schedule a call between other users, and schedule assistant works excellent. Yes, it is pretty strange to hear from my mouth word great to any Microsoft product, but it is true.
Apache Spark, or simply Spark, is an all-powerful analytics engine, and it is the most used tool that I used. I love working with it. Spark is specifically designed to handle batch processing and Stream Processing.It comes with many APIs that facilitate Data Scientists to make repeated access to data for Machine Learning, Storage in SQL, etc. It is an improvement over Hadoop and can perform 100 times faster than MapReduce. Spark has many Machine Learning APIs that can help Data Scientists to make powerful predictions with the given data. Spark does better than other Big Data Platforms in its ability to handle streaming data. This means that Spark can process real-time data as compared to other analytical tools that process only historical data in batches.
Focus To-Do: Even though many people told me I am a machine, I am not. I have set up my daily work right based on my preferences. I use the Pomodoro technique. I tried to find out the best ratio between focus and break, and after several times I found it out. I set up working time to 25 minutes and 5 minutes to break. I know it is hard to adhere to the schedule strictly, but I do my best. It is hard to adhere to this schedule between so many calls, but I try my best. I installed the application, which is called Focus To-Do, on my computer, but during the calls, it was funny to see the sentence “It is break time”, so I deleted the application and installed it on my iPad Air 2020. By the way, the application is free, and I highly recommend giving a shot at the application. I can work more hours with the Pomodoro technique, and I do not feel completely exhausted.
BigML is another widely used Data Science Tool. It provides a fully interactable, cloud-based GUI environment that you can use for processing Machine Learning Algorithms. BigML provides standardized software using cloud computing for industry requirements. Through it, I used Machine Learning algorithms across various parts of their company. For example, it can use this software for sales forecasting, risk analytics, and product innovation. BigML specializes in predictive modeling. It uses a wide variety of Machine Learning algorithms like clustering, classification, time-series forecasting, etc. BigML provides an easy to use web-interface using Rest APIs, and you can create a free account or a premium account based on your data needs. It allows interactive visualisations of data and provides you with the ability to export visual charts on your mobile or IoT devices. Furthermore, BigML comes with various automation methods that can help you to automate the tuning of hyperparameter models and even automate the workflow of reusable scripts.
MinimaList: During the day, I need to accept lots of information. I say it to a full mouth. I am not able to handle everything. My boss had a pretty funny motto, “When you are stupid, write the notes”. He had three notebooks where he wrote all the notes. I used to create notes on a tablet and application MinimaList. There are many applications for writing notes in the Apple or Google store, so you can try lots of them and let me know which you prefer. Minimalist is entirely free and has no hidden costs. All the features are intuitive, and it works smoothly.
Jupyter is an open-source tool based on IPython for helping developers in making open-source software and experience interactive computing. Jupyter supports multiple languages like Julia, Python, and R. It is a web-application tool used for writing live code, visualisations, and presentations. Jupyter is a widely popular tool that is designed to address the requirements of Data Science. It is an interactable environment through which Data Scientists can perform all of their responsibilities. It is also a powerful tool for storytelling as various presentation features are present in it. Using Jupyter Notebooks, one can perform data cleaning, statistical computation, visualisation, and create predictive machine learning models. It is 100% open-source and is, therefore, free of cost.
If you have any questions or use valuable tools or applications, I would love to hear about them. Have a lovely rest of the day. See you soon.
If you did not catch another 5 tools you can see them on the following link Six Five Tools That I Use Daily as Data Science — part 2. For the third part where I introduced the another 5 tools please visit the following page Five Tools That I Use Daily as Data Science — part 3.
