How I Silently Upgraded in Data Engineering While At College (Studying Chemical Engineering)
Silent Ways to Level Up in Data Engineering
During my internship in the West African region, I had a snippet of the data world and thought the road would be pretty rosy. The ideal picture was to have the fundamental knowledge and get the ball rolling non-stop. I thought the whole process would make sense as I climbed the ladder without intentional effort to level up, but little did I know I had it all wrong!
Reality dawned on me, and I saw the need to do more!
The picture became clearer, and I realized no one truly cares about you (not even your mother). You’ll remain just as you are and slowly slide into extinction if you do nothing about your growth.
Data engineering can be a fun-filled adventure if you enjoy figuring things out, being curious, learning continuously, and serving.
It’s a game filled with ups and downs—sometimes the process smiles at you, and other times it presents formidable challenges to overcome—the attribute that makes it beautiful (for me).
The game-changer for me?
I realized there are no shortcuts.
You must get your ass off, roll up your sleeves, and get the sh*t done! It's that simple! There are no two ways about it!
Crafting my plan
In the words of Antoine de Saint-Exupéry:
“A goal without a plan is just a wish”
When I resumed my academic activities after the internship, I knew there were potholes to be navigated and loopholes to be filled. I embraced reality and created a plan to be where I wanted to be.
For me, then, I needed to know more about Window Functions in SQL and also data modeling.
Here was the plan:
- I chose one at a time. I began with Window Functions.
- Despite my academic activities, I chose specific times within the week when I learned and practiced.
- I worked on mini-projects during one of these times and kept the ball rolling.
We all have different endeavors, and you may not be a student like I was. Whatever it is, first identify the lapses you need to address and create a solid plan for closing the loopholes.
These loopholes may arise from your inability to meet certain job requirements, i.e., if you want to change your work environment.
They may also arise from stepping up your value at your current company. For example, if your company uses Airflow but you aren’t skilled at it yet, it’s an opportunity to change the game and increase your worth by learning and practicing Airflow.
Get the necessary resources you need from platforms like YouTube or Udemy, and learn!
Weekends were for projects
Actual learning begins when you engage in hands-on projects. You owe it to yourself to bridge the gap between theory and practical application.
This allows you to practice all you have learned and implement it in real-world scenarios.
No matter how minute the concept may seem, crown the process with practice.
Yes, you will make mistakes, and your first project will stink, but these experiences are inevitable to have a proper understanding of what you are doing. You may spend hours surfing the internet just to find out that you don’t need a comma at a point in your query—it can be that crazy!
My weekends were dedicated to building projects based on what I had learned during the week, and I set deadlines for completing each of them.
The beautiful thing is that I’m not accountable to anyone regarding these projects. I try different things as my curiosity leads me, and I learn more in the process.
For you, these projects could be as simple as writing a query where you try to use CTEs instead of subqueries to help your colleagues read your queries easily.
This strategy of project-building keeps you on track and helps you stay committed.
Carving daily moments
Studying Chemical Engineering was demanding!
I needed so much time for my academics, and somehow, this influenced my learning schedule for data engineering.
I resolved to break down my goals into small chunks and draft a plan for them ahead of a new week, spreading the tasks across the days of the week.
This means I worked every day on data engineering-related problems, with intense learning sessions. I did this for an hour each day and devoted the rest of the day to other activities.
For you, it may be required to set aside 30 minutes, depending on your schedule.
As much as this technique is effective, there’s often the temptation to overlook a period since it’s just for a small amount of time in the hopes of getting your tasks done at another time, which may never come. Be faithful to each of these periods and get each task completed.
These techniques worked for me while I was a student. I understand we are all different and have different endeavors. The circumstances may differ, but it’s up to you to make adjustments and play the game as it suits you.
Flexibility matters a lot! There were a few times I couldn’t show up at the stipulated times. I scheduled another time within the day for cover-up. You’ll fall, and you’ll make mistakes. But don’t give up! It takes time to build a new habit.
I hope this helps you achieve your goals and become a more valuable data engineer!
