Leveraging Google Cloud for Industrial AI: Choosing the Right Approach

Snehanshu Jena
Google Cloud - Community
4 min readJul 19, 2024

Artificial Intelligence (AI) is revolutionizing the way industries operate — from predicting equipment failures to optimizing production/ supply chain processes, AI empowers businesses to make informed decisions and enhance overall efficiency. We will explore how to leverage Google Cloud AI and machine learning products with the Manufacturing Data Engine (MDE) for a variety of AI use cases in manufacturing, with a focus on choosing the right approach among the most popular options — Time Series Insights API (TSI API), BigQuery ML (BQML) and Vertex AI platform — AutoML/ Custom (focused mainly on building a custom model).

Industrial AI Use Cases: From Anomaly Detection to Predictive Maintenance

AI’s potential in manufacturing is vast and diverse. Let’s highlight a few key use cases:

  • Anomaly Detection: Identify unusual patterns or outliers in data — such as unexpected equipment behavior or quality deviations, allowing for early intervention and problem resolution.
  • Predictive maintenance: Predict equipment failures before they occur — enabling proactive maintenance and minimizing downtime/bottlenecks.
  • Automated Quality Assurance: Automate defect detection and ensure consistent product quality through AI-powered image analysis or sensor data analysis.
  • Production/Process optimization: Use AI to optimize manufacturing parameters, leading to improved efficiency, reduced waste and resource conservation.
  • Supply chain management: Forecast demand and optimize inventory levels, preventing stockouts and overstocking.
  • AI-Powered Manufacturing Assistant: LLMs can power an intelligent, multilingual assistant capable of understanding and responding to natural language queries

Google Cloud Tools: Your AI Toolkit

Google Cloud offers a comprehensive ecosystem of tools, with MDE as the data foundation and Vertex AI serving as the unified AI platform. Here’s how they fit together:

Manufacturing Data Engine (MDE)

  • Data Ingestion: Seamlessly ingest real-time manufacturing data from diverse sources, including PLCs, sensors and MES systems, using MDE’s flexible connectors ( Ex: Pub/Sub, Dataflow).
  • Data Storage and Processing: MDE leverages BigQuery, BigTable and Cloud Storage for scalable data storage and efficient processing, allowing you to transform raw data into valuable insights.
  • Data Access: Easily access and query your manufacturing data using SQL or other familiar tools, providing a unified view across your operations.

Vertex AI

  • Unified Platform: A single platform to build, deploy and manage your entire ML workflow.
  • Custom Model Development: Build and train machine learning models from scratch using your preferred frameworks ( Ex: TensorFlow, PyTorch, scikit-learn). Provides full flexibility and control, but requires ML expertise.
  • AutoML: Leverage Google’s AutoML capabilities to automate model selection, hyperparameter tuning and feature engineering. Great for users with limited ML experience.
  • Pre-built Models and LLMs: Access a library of pre-trained models for common tasks or leverage powerful Large Language Models (LLMs) for natural language processing, generation and even aiding in code development and debugging.
  • Experiment Tracking: Track and compare model performance across different experiments, streamlining the model selection process.
  • Model Deployment: Deploy models to production with a few clicks, making them accessible for real-time & batch predictions.
  • Model Monitoring: Monitor model performance over time, identify drift and retrain models as needed to ensure ongoing accuracy.
  • Explainable AI: Gain insights into how your models make predictions, increasing transparency and trust in AI-driven decisions.

Additional Tools

  • BigQuery ML (BQML): Train and deploy machine learning models directly within BigQuery, making predictions without complex data movement.
  • Time Series Insights API (TSI API): A specialized tool for time-series data analysis, including anomaly detection and forecasting.
  • ​​Looker: Create interactive dashboards and reports to visualize insights derived from MDE data or AI models, enabling data-driven decision-making across your organization.

Choosing the Right Approach: TSI API, BQML, or Vertex AI

The decision among TSI API, BQML and Vertex AI (including AutoML and custom models) depends on various factors:

When to Use Each Approach

TSI API: Ideal for quick and easy anomaly detection or forecasting on time-series data, especially when you have limited machine learning expertise.

BQML: Suitable for predictive modeling and basic machine learning tasks directly on structured data within BigQuery. Provides good scalability and ease of use compared to building custom models from scratch.

Vertex AI:

  • AutoML: A great starting point for users with limited ML experience, automating model selection and tuning for various tasks like image classification, text classification, etc.
  • Custom Models: Choose this when you need maximum flexibility, complex algorithms, or the integration of domain-specific knowledge. It requires more ML expertise but offers the highest degree of customization.

Pre-built Models and LLMs: Leverage pre-trained models or LLMs for common tasks or advanced natural language processing needs, including sentiment analysis on customer feedback or generating summaries of complex technical documents

A Unified Approach with Google Cloud — Vertex AI , MDE, and Looker

Google Cloud, MDE and Looker work together to create a comprehensive solution for industrial AI.

  • MDE serves as the foundation, efficiently ingesting, storing, and processing your manufacturing data.
  • Vertex AI provides the tools to build, deploy, and manage AI models that extract insights from this data.
  • Looker transforms those insights into interactive visualizations and dashboards, empowering stakeholders across your organization to make data-driven decisions.

Conclusion

By carefully evaluating your use case, data characteristics and available resources; you can select the most suitable approach among TSI API, BQML and Vertex AI. Leverage Google Cloud’s powerful tools and MDE’s capabilities to unlock AI’s potential, optimize your manufacturing processes and drive innovation in your business. The addition of Large Language Models (LLMs) further expands the possibilities, enabling natural language understanding, generation and knowledge management capabilities that can enhance efficiency and productivity across various aspects of your manufacturing operations.

--

--