Tenny SusantoSetting up a Cloudera Cluster in Azure Part 1I just started doing a POC of Azure. One of the task was to set up a self managed Cloudera Cluster in Microsoft Azure. I made a video that…May 10, 2018May 10, 2018
Tenny SusantoGoogle Cloud Platform POC Part 4 — Google Big QueryWe are very heavy users of Impala at work and have been using it in production for the last 4 years, pretty much ever since it went into…Apr 10, 20181Apr 10, 20181
Tenny SusantoGoogle Cloud Platform POC Part 3 — Using Flume to push files to GCSIn this article, I wanted to document how I used Flume running on our on premise Cloudera hadoop cluster to push files dropped off in a…Jan 31, 2018Jan 31, 2018
Tenny SusantoGoogle Cloud Platform POC Part 2 — Create hive schema, run a spark job, scale the clusterIn my previous article, I talked about the configuration changes I made in my on premise Cloudera hadoop cluster so that I can easily do a…Jan 25, 20182Jan 25, 20182
Tenny SusantoGoogle Cloud Platform POC Part 1 — hadoop distcp to Google cloud storageI’m currently doing a POC on Google Cloud Platform, namely Cloud Dataproc, which is Google’s managed hadoop as a service. I’ve been…Jan 23, 20183Jan 23, 20183
Tenny SusantoDumping data out of KafkaIf you ever need a quick and dirty way to dump out all messages from a Kafka queue, you can just use the Kafka command-line tools.Nov 9, 2017Nov 9, 2017
Tenny SusantoAutomating hadoop admin tasks with Cloudera Manager APIDo you manage a (or several like I do) Cloudera hadoop cluster and have a need to detect failed services and auto restart?Aug 29, 2017Aug 29, 2017
Tenny SusantoConsuming from a secured Kafka with Spark streamingWe use Cloudera’s CDH for our hadoop servers at work. Up until recently, we’ve been using Spark 1.6 since that was the default Spark…May 1, 2017May 1, 2017
Tenny SusantoBuilding a spark application using scalaIn this post I’m going to walk you through how I built a spark application using scala. The code parses an xml file, flattens the rows, and…Feb 17, 2017Feb 17, 2017
Tenny SusantoKudu + ImpalaI’ve been heavily working with Impala for the last 3 years and happy to report that everyone at work, both developers and end users, is…Feb 17, 2017Feb 17, 2017