Cloud Computing

Introduction

Every day, big and small companies collect more and more data. Enterprises typically gather data about companies’ operations, clients, competition, products etc. They need to store, process and analyze all this information in an efficient manner.

The traditional solution of setting up warehouses and databases is simply not up to the task of satisfying the companies’ needs as they deal with very large amounts of data. These solutions also don’t facilitate the usage of analytics or machine learning techniques that have become very popular in recent years.

The problems with traditional warehouses initially led to the development of cloud storage…

Machine Learning

Introduction

This article will teach you how to set up a Machine Learning project with a DagsHub: a new tool designed to ease collaboration on Data Science projects that require data versioning and model building.

Today, we will talk about:

• Problems with traditional Git and DVC setup for Machine Learning projects and why this approach does not fully work.
• What is DAGsHub, and how does it solve the problems mentioned above?
• And finally, we will learn how to set up your first project using DAGsHub and DAGsHub Storage.

The Problem with Traditional Git and DVC Setup

Most of the collaboration…

Introduction

Jupyter Notebook is a great programming environment and often the most popular choice for data scientists or data analysts that are coding in python. Unfortunately, its default settings do not allow the level of customization that you have with standard programming environments such as PyCharm or similar tools.

Jupyter Notebooks themes are trying to diminish this gap and allow you to make the notebook a bit prettier and also more functional using the themes. In this article, I will walk you through the installation process of Jupyter Notebook themes and show you some of their most important features.

Installation

…

Introduction

This article is a follow-up to my previous article that has introduced you to Jupyter notebook extensions and has presented my favorite ones. If you have not read it yet you probably should start there as it introduces the general concepts such as:

1) what are Jupyter notebook extensions,

2) how to install them,

3) and presents some basic but very useful extensions.

The list of extensions demonstrated in my previous article is not exhaustive so the goal of the current article is to add a few other, more complex but still very beneficial extensions to the previous list.

…

Introduction

In this post, I will explain how to add large data sets to Google Drive so they can be accessed from Google Colab for processing and modeling.

Whereas uploading a single file can be done with the drag and drop interface of Google Drive, it becomes more difficult with a large number of files. Dragging the whole folder containing 1GB of files just fails and freezes Google Drive. The alternative is to drag a zipped folder. …

What are f-strings?

In this article, we will talk about f-strings and their advantages over regular traditional string formatting in python.

F-strings have been introduced in Python 3.6 and allow for easier and more convenient formatting. The syntax to define an f-string is almost identical to defining the string itself. You use quotes but proceed the opening quote part with the lower case ‘f’ or upper case ‘F’. Below there are a few examples.

As with normal string definition, you can use single quotes:

my_first_f_string = f'I am going to use f-strings form now on.'

Or double quotes:

f_string_with_double_qoutes =…

What are the magic commands?

Magic commands are special commands that can help you with running and analyzing data in your notebook. They add a special functionality that is not straight forward to achieve with python code or jupyter notebook interface.

Magic commands are easy to spot within the code. They are either proceeded by % if they are on one line of code or by %% if they are written on several lines.

In this article, I am going to list magic commands that are used most often and show practical examples of how to take an advantage of…

Introduction

Pandas library is probably the most popular package for performing data analysis with python. There are a lot of tutorials that go through pandas basic functions but in this article, I would like to share some pandas functions that are a bit less known but can be very handy for everyday data analysis tasks.

Let’s get started.

Load data

Before we get to know the functions chosen for this article we need to load some data. We will work on a data frame that we will create with the following code.

import pandas as pd
client_dictionary = {'name': ['Michael', 'Ana'…