Information Engineering 101

Why You Need It and What It Is

Decision-First AI
Data Based
Published in
4 min readAug 1, 2017

--

This article is not about the Information Engineering formally defined as part of software development processes. It is related. The definition we are using here is related to the collection, organization, distribution, and analysis of information within your systems and overall organization. Is that really something you need to care about? Probably more than you know.

Large corporations have IT teams, analytic teams, and data management teams. They employ data architects, data scientists, and network specialists. All of whom are engaged in what is essentially distributed information engineering. Note — that is no way to pursue information engineering, but this article isn’t about them.

Likely, your business doesn’t have the resources or budget to employ that many people. That doesn’t mean you can’t benefit from the process. In fact, you are probably more likely to need it.

Big Companies Talk Of Big Data and Data Silos

Your company may not have true silos, but likely your data is just as big and just as disparate as any larger organization. What exactly does that mean?

Your data is likely divide among any number of different software platforms. Perhaps you use Google Analytics, Salesforce, Marketo, or Mailchimp. You may have web logs and facebook marketing. You may use Braintree, PayPal, or Stripe. All of these systems provide support for specific tasks (no matter how hard they try). And all of these systems store your data.

The role of an information engineer is to extract that data, organize it, and deliver it to you via a simple platform that’s purpose is to help you understand your business. A system built to provide you information — so that you don’t have to keep wondering why Salesforce’ numbers don’t box to your general ledger, or google, or marketing, or whatever…

The Information Engineer

Typically an analytics professional by background, an information engineer needs to have a broad skill set. They need to be comfortable in a spreadsheet, a warehouse (the data type), and in a boardroom. They need to understand your technology, your product, your business, and your customer. They need to be a teacher, by necessity. And they need to be dedicated to providing access and transparency.

The engineer will work to collect your data. Audit it. Organize it. And begin developing the reporting and other tools you need to make great decisions and better understand (and predict) your business. They may go further, but at that point they are switching hats to full-blown analyst (not a bad thing).

Great providers of Information Engineering may be better thought of as Analytic Service Providers. They may utilize a small team of professionals to provide you with better expertise, but as a result should also have more efficient pricing. As a result, they can deliver the support you need for a price and an ROI that makes sense for your business.

Many organizations may simply want to hire an IE (or ASP Team) to end frustration. Although the ROI should still be positive, determining it may not be critical. Some business leaders simply grow tired of never having the numbers they need or the answers they want. How many times have reports from different systems in your company provided you with different numbers? How many times have you spent hours arguing over which one was right? Or how they are even defined?

ASP Teams (information engineers) will have a plan, a process, and a path to alleviate that frustration. They can empower your organization. They can solve your problems. So…

If you have a problem, if no one else can help, and if you can find them, maybe you can hire an ASP-Team.

… or at least get yourself a great Information Engineer.

Looking for help? We can.

--

--

Decision-First AI
Data Based

Decision-First AI is an investment company focused on the future of data. We maintain this medium publication to further analytic debate and discussion.