So again, data engineering is my career goal in tech.
I kinda already did this in my study intro, but that was more data science.
Data science is the more sexy part that you see everybody going for. And I still want to do it, but if I’m gonna do it this way, I got to go all the way. The bare minimum is my enemy on this journey.
Data engineering is unsexy. Science is where you get to ask questions, wrangle data, and generate insights to make better decisions. Engineering is working with the computers that collect, house, and process this data. Playing the video game sounds much more fun than developing it, but I can’t only focus on what’s fun.
So what exactly does a data engineer do?
They develop and maintain scalable data infrastructures while also monitoring the data as it moves through the system.
So just how you develop a video game, you also have to supervise it for any bugs or glitches that come up. It’s not like the old days where they just put out a game and anything that was wrong with it was a you problem. So anything you build, you’re responsible for anything that happens after you build it.
My biggest concern with this whole thing will be collecting the data. The courses and preset projects just give it to you as files, but real-world data isn’t like that. I have to go out in the wild and collect this data, and it’s gonna be messy.
So I got multiple roadmaps I’m looking at. They have dozens of concepts and terms I’ve never seen. So before I let that overwhelm me, I’m gonna focus on Python and SQL, since I can’t even do the easy projects until I’m proficient in those. And I’ll start tinkering with databases; I’ll go through the types of them later. Most of them require SQL so I’ll have to get up on that to unlock that next step
Regarding the math part, I’ve already dabbled in probability, statistics, linear algebra, and calculus. But, just like with school, there’s no point in me zeroing in on those if I’m not ready to apply them. So I’ll be holding off on those until I got use for them.
Most of my work will be on my other sectors, this data sector here is my home base where I’ll be tying everything together.
This the start of my journey. Let’s get it!