Nitin GuptaApache Sqoop : Incremental import with sqoop-jobHere we have example to incremental import data from mySql to HDFS.Dec 30, 20181Dec 30, 20181
Nitin GuptaApache Sqoop : Import from MySql to HDFS in AVRO format with Snappy compressionWe want to import the data from MySql table to HDFS in AVRO format along with Snappy compression.Dec 28, 20181Dec 28, 20181
Nitin GuptaSetup Sqoop to import mysql data to HDFS on Ubuntu 16.04We intend to setup Sqoop from step 1 and demonstrate a basic import from mysql table to HDFS. I tried to demonstrate every single step…Dec 27, 2018Dec 27, 2018
Nitin GuptaSetup Hadoop psuedo cluster on Ubuntu 16.04This article to set up Hadoop on your personal Ubuntu machine from scratch. Please follow step by step and you will be able to start the…Dec 27, 2018Dec 27, 2018
Nitin GuptaAuthenticating API using OAuth2.0 access token in ApigeeWe have a back-end server already running REST micro-service in any language framework. We have GET / POST APIs ready to be consumer by…Dec 16, 2018Dec 16, 2018
Nitin GuptaCreating Outh2.0 access token using ApigeeWe have a backend server already running REST micro-service in any language framework. We have GET / POST APIs ready to be consumer by the…Dec 16, 2018Dec 16, 2018
Nitin GuptaApache spark streaming from text fileInstall spark hadoop, refer online instruction. I have “spark-2.3.2-bin-hadoop2.7” to refer in this demo.Nov 30, 2018Nov 30, 2018
Nitin GuptaSpark streaming with PySpark reading socketThis article will illustrate to have a flavour of how spark streaming can work to read the stream from an open socket.Nov 30, 2018Nov 30, 2018
Nitin GuptaHello World with Apache Spark SQLWe need to just have a hello world program with Apache Spark SQL to demonstrate structured data-set processing. In this program we are…Nov 25, 2018Nov 25, 2018