Distributed to Data Science

How To Deal With Big Data For AI?

An Architectural Approach to Big Data Management

Dr Mehmet Yildiz
Jan 16, 2020 · 21 min read
Image for post
Image for post
Picture courtesy of pixabay

I learnt that architecting Big Data solutions pragmatically with rigour can substantially contribute to the delivery of quality AI and Cognitive solutions especially in enterprise modernisation and digital transformation programs. These transformative programs are empowered by Big Data and AI, integrated with other emerging technology domains e.g. Cloud, Edge, IoT, Blockchain, and Mobile technologies.

Let’s understand what Big Data is

Even though architecturally similar to the traditional data, Big Data requires newer methods and tools to deal with these particular characteristics. It is important to highlight that the traditional methods and tools are not adequate to process big data.

Data is architected and managed layer by layer

An overview of Big Data lifecycle management

Phase 1: Foundations

Phase 2: Data Acquisition

Phase 3: Data Preparation

Phase 4: Data Input and Access

Phase 5: Data Processing

Phase 6: Data Output & Interpretation

Phase 7: Data Storage

Phase 8: Data Integration

Phase 9: Data Analytics & Visualisation

Phase 10: Data Consumption

Phase 11: Retention, Backup, & Archival

Phase 12: Data Destruction

Big Data Solution Components

Data Types

Data Principles

Data Quality Specifications

Big Data quality can be gauged using relevant data sources, optimised analytical models, and obtaining favourable results translating into data consumer experience and profitability for the enterprise. These results can be tangible or intangible.

Big Data Platforms

Big Data Governance

Business Vocabulary

Conclusion

Technology Hits

Important, informing, and engaging stories on technology

Sign up for Technology Hits Highlights

By Technology Hits

Featured stories, tech news, industry trends, useful tips Take a look

By signing up, you will create a Medium account if you don’t already have one. Review our Privacy Policy for more information about our privacy practices.

Check your inbox
Medium sent you an email at to complete your subscription.

Dr Mehmet Yildiz

Written by

Technologist/Cognitive Scientist empowering writers. Founder of ILLUMINATION curating & amplifying important messages. Connection: https://digitalmehmet.com

Technology Hits

Important, high-impact, informative, and engaging stories on all aspects of technology.

Dr Mehmet Yildiz

Written by

Technologist/Cognitive Scientist empowering writers. Founder of ILLUMINATION curating & amplifying important messages. Connection: https://digitalmehmet.com

Technology Hits

Important, high-impact, informative, and engaging stories on all aspects of technology.

Medium is an open platform where 170 million readers come to find insightful and dynamic thinking. Here, expert and undiscovered voices alike dive into the heart of any topic and bring new ideas to the surface. Learn more

Follow the writers, publications, and topics that matter to you, and you’ll see them on your homepage and in your inbox. Explore

If you have a story to tell, knowledge to share, or a perspective to offer — welcome home. It’s easy and free to post your thinking on any topic. Write on Medium

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store