Data Architects: We live in a distributed world. Design as such.
A guide to use graph structures to mix data types, computation DAGs, compute connectivity, and real-world actions to model distributed data applications.
Recently, I’ve been exploring the gap between early predictions of the value that AI will drive (with numbers in the $3 Trillion plus range) and what our current technology will enable us to achieve. In an earlier post, I discussed how many of the most challenging use cases are those requiring real-time AI at the edge. My opinion is that fog computing (which I’ll call distributed cloud, as the public cloud providers are likely to own this space going forward) platforms will be essential in solving those challenging “hot” use cases. In that post, I also briefly discussed how Graph modeling techniques can be leveraged to simplify the complexity of designing the systems to take advantage of distributed cloud infrastructure.
In this post, I’m going to dive into the details and discuss a specific approach to designing these graph systems.
