Set up Serverless Store: Part 2 (Machine Learning/API, Data Analytics, and Data Visualization)

Before you begin

Machine Learning/AI

Google Cloud Vision API

Understanding the code

See functions/detect_labels/main.py for the full source code.

Google Cloud AutoML Vision

  • Find some pet product and regular product images. AutoML Vision recommends using at least 100 images for each category; however you may use a much smaller dataset just to try things out.
  • Click Get started with AutoML.
  • Click Set up now.
  • Click New Dataset.
  • Type in pet_recommendations as the dataset name.
  • Choose Import images later.
  • Click Create Dataset.
  • Click Add label. Add two labels, not_for_pets and pets.
  • Click Add Images > Upload from your computer.
  • Upload all the pet product images. It may take a while for AutoML to process the data.
  • Click category Unlabeled. Select all images.
  • In the Label drop-down menu, select pets.
  • Repeat the steps and upload regular product images. Assign them the label not_for_pets.
  • Now AutoML has all the information to train the model. Select the Train tab and click Start Training. It takes a while to train the model.
  • Now you have a model capable of identifying pet products. You can check the details of the model in the Evaluate tab and try the model in the Predict tab. Write down the model ID in the Predict tab. It looks like this: ICN000000000000000000.

Understanding the code

See functions/automl/main.py for the full source code.

DialogFlow (for Google Assistant integration)

  • Go to the Activity Control page. Sign in with your Google account and make sure you have enabled the following permissions: Web & App Activity, Device Information, and Voice & Audio Activity.
  • Go to the Actions on Google Console. Actions on Google allows you to register an action for Google Assistant and other Google solutions.
  • Click Add/Import Project.
  • Type in a project name.
  • Click Create Project.
  • Skip the welcome page.
  • In the left side bar, click Build > Actions. Then click Add Your First Action.
  • Select Custom Intent and click Build. This tells Actions on Google console that you would like to use DialogFlow to create the action.
  • DialogFlow Console will open in a new window/tab. Type in the name of the action (Agent name) . Click Create. You will be redirected to the Intents page.
  • Intent is, loosely speaking, a conversational round. It specifies an event or a sentence that starts a round (“What’s up, my assistant?”), and a response that concludes the conversation (“Everything’s good, thanks!”) or triggers the next round (“I’m good, what can I help you today?”). DialogFlow also allows developers to extract information automatically from sentences (“I want to book a flight from New York to Shanghai.”). At this moment there should be two intents on screen. Default Welcome Intent is the default starting point of a conversation and Default Fallback Intent is what Google Assistant will use when it does not know what to say. Click Default Welcome Intent.
  • You will see, in the new page, a collection of training phrases. DialogFlow uses Natural Language Processing technologies to learn from these phrases; users can speak any sentence close to the training phrases in meaning to start a conversation. If no training phrase is present, Google Assistant will lead the conversation instead. For this demo, we would like Google Assistant to speak up first; as a result, you will have to remove all the training phrases.
  • Next, add a custom response. Remove all the defaults ones, and add “Hi Serverless Store here. What can I help you today?”
  • Click Save.
  • Go back to the Intents page. Click Create Intent to add another round of conversation to follow up with the “Hi! Serverless Store here. What can I help you today? prompt.
  • Type in Trending Items as the intent name.
  • Click Add Training Phrases. Type in “What’s trending in Serverless Store?”. Press Enter.
  • Since trending items are changing all the time, you will need a dynamic response. Click Fulfillment, then Enable Fulfillment. Turn on Enable webhook call for this intent. This settings allows DialogFlow to prepare a response using a webhook, such as a Cloud Function.
  • Click Save.
  • Open the left side bar and go to the Fulfillment page.
  • Enable Inline Editor. You will deploy a Cloud Function directly from the DialogFlow Console. Alternately, you may also deploy it manually and set it up in the Webhook section.
  • Delete the sample code in the editor. Copy all the lines in functions/dialogFlow/index.js here.
  • Click Deploy.
  • Now, speak to the Google Assistant app on your phone or your Google Home devices: “Talk to my test app.” If you don’t have Google Assistant available, use the Simulator in Actions on Google Console. The conversation should sound like this:

Understanding the code

See functions/dialogFlow/index.js for the full source code.

Data Analytics and Data Visualization

Google BigQuery

  • Open the BigQuery page in Google Cloud Console. Enable the API if prompted.
  • Click Create Dataset.
  • Type in sample_data as the Dataset ID.
  • In the left side bar, expand your project and select the newly created dataset.
  • Click Create Dataset.
  • Click Create Table.
  • Type in sample_table as the Table Name.
  • Edit the schema and add the following fields:
  • Click Create Table.

Understanding the code

See extras/streamEventsApp/server.js for the full source code.

Google Data Studio

  • Open Google Data Studio.
  • Click the Add Button (+) at the bottom right of the screen.
  • Click Create New Data Source.
  • Select BigQuery.
  • Find your Google Cloud Platform project, select the sample_data dataset, and the sample_table table.
  • Click Connect.
  • You will see a number of fields you create in the last step. Click Add to Report and confirm.
  • Click Add a Chart. For this demo you can pick a standard bar chart.
  • By default it shows the record count, which is 0 at the moment, with the context dimension.
  • In the right panel, remove the context dimension and add the eventType dimension. Now the bar chart will display the number of events in each event type.

What’s next

--

--

--

Developer Relations @ Google Cloud Platform

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Read this before doing your first NLP Social Media Project

In 20 minutes learn to conduct an A/B test

Microsoft Sentinel Machine Learning (ML) based Threat Detection Rules

Deep learning for OCR

Predict Sentiments of Coronavirus Tweets

GPT VS BERT

Maximum likelihood Estimate (MLE) — an Introduction

NLP Logistic Regression and Sentiment Analysis

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Ratros Y.

Ratros Y.

Developer Relations @ Google Cloud Platform

More from Medium

Data Overload Vol. 10

AWS Data Wrangler

Data Apps: From Local to Live in 10 Minutes

Warehousing with Google’s Big Query