Python Efficiency — Reduce Computing Time and Memory Usage!

A quick overview of caching, memory reduction of objects, data-streaming, generators, Cython, and thread pools to maximize your runtime and memory usage.

image from here

What are we here for?

If to be concise — I’m here to boost your performance with python, and to improve your memory usage.
if this interests you — I hope you'll stay and continue reading.

This guide will show the main concepts, but I encourage you to dig deep and find out more, or comment on the concepts you find more interesting, and I’ll make an article on them specifically!
It will start from simple, reaching all the way to C integration.

Basically today, the data science community is just massive, and the amount of data itself is indescribable.

There is a true need to work in ways that are memory efficient, since if you try to load up 10 million data objects into memory at one time, and you don't have enough RAM, then your PC will crash.