What’s Future Engineering? Is your data clean?!!
In the future, we most probably can’t be done anything without looking at the data. Yes, this is significant, because we are reaching out the unexpected results, with Data that we never even thought of. We can bring such important results to meaningful solutions in the triangle of mathematics, statistics, and programming.
Yes, I’m an Econometrics graduate and I’ve seen most of the metrics, calculation paths, and analysis outputs here before, but I’ve always had trouble adapting them to real-life problems, it wouldn’t be a lie if I say I had second enlightenment because I took a break for years before starting my current education :)
Especially if we consider today, where the development speed of computers has increased exponentially and reached good accelerations, we see more and more how important the Big Data concept has become.
Yes, we have reached the data and we will start the calculations, we say let's analyze, right? But starting this process is not that easy.
The importance of the outputs that can be reached with data is not known and people are not caring much, or someone can’t think what will happen if this is missing in our current workload, bla bla.
There are dozens and hundreds of missing information for this reason and this is where the real work begins. The importance of the Future Engineering concept is exactly here…
What’s The Future Engineering?
This is exactly data engineering. Data cleaning, variable derivation, missing variable filling, etc. a lot of things are entered and this part constitutes 85–90% of the transactions we will do. Because, it is debatable how accurate our analysis will be, even if there is insufficient information in the data.
Together with these operations, we will also prepare our data for machine learning algorithms.
If you really knew that you could now achieve the results you always wanted to achieve, or if you could always reach those automated but also good outputs. For example, wouldn’t you want a calculation that automatically prepares orders for tens of thousands of products in your warehouse and will keep you at that optimum level after these orders?
I have such a problem that I can’t solve it no matter what I do. I will invest or improve or make a change in my system, but I do not know what the consequences will be. Do you have ideas that you say you’re going to spend tens of thousands of dollars on but don’t know if it’s really worth it?
Today, people who will solve this and thousands of similar problems have been raised and continue to be raised. Now, you should shift your necessary investments to the computer in the cloud system and choose which of those thousands of products or millions of customers will be beneficial to invest in, and transfer your work to algorithms based on mathematics and statistics, more confident that your money really goes to the right place.
The future is right here… :)
