Sumit PawarThe architecture of Apache Spark Microsoft SQL Server connectorThis article is about how apache spark MS SQL connector was implemented to handle data duplication in case of spark relaunch a task and…Dec 6, 2022Dec 6, 2022
Sumit PawarApache spark custom serializer for a classThis blog is about how to specify a custom serializer for a class, considering the default serializer is Kryo .Jul 19, 2022Jul 19, 2022
Sumit PawarRunning spark application jobs(actions) parallel with FAIR schedulerThis article is about, how to run spark application jobs in parallel and spark scheduler configuration.Jun 12, 2022Jun 12, 2022