Manoj Kumar DhakadCracking the Data Engineer Coding and Problem-Solving Rounds: Strategies for SuccessBased on my experience conducting and participating in numerous interviews, coding problems for data engineers tend to be relatively…Mar 30Mar 30
Manoj Kumar DhakadSpark and SQL — Identifying and Eliminating Duplicates RowsDuplicate data can often pose a significant challenge in data processing and analysis, resulting in inaccuracies and skewed results. In…Feb 2Feb 2
Manoj Kumar DhakadEssential Excel Features Every Data Engineer Should MasterExcel is a crucial tool for individuals working with data, including Data Engineers, Data Scientists, Data Analysts, and Business Analysts…Dec 23, 2023Dec 23, 2023
Manoj Kumar DhakadExploring Advanced Data Engineering Beyond SQL: Techniques and StrategiesI possess over 7 years of experience in the field of IT, with a dedicated focus on data engineering for more than 6 years. Throughout my…Sep 17, 2023Sep 17, 2023
Manoj Kumar DhakadPython: Read and send Outlook mail using OAuth2 token and Graph APIMicrosoft has announced the deprecation of basic authentication for Outlook, which involves using a username and password for…Jun 30, 202311Jun 30, 202311
Manoj Kumar DhakadApache Spark: Broadcast Join Internals and TypesSpark offers various joining strategies, including Shuffle Hash Join, Shuffle Sort-Merge Join, Cartesian Join, and Broadcast Join. This…Jun 25, 2023Jun 25, 2023
Manoj Kumar DhakadHow to do graceful shutdown of spark streaming jobSpark streaming is the extension to the core spark API that enables fault-tolerant, scalable and high throughput stream processing of live…May 11, 20191May 11, 20191
Manoj Kumar DhakadHow to use AWS Dynalite in Local local environmentAWS is providing many useful services to us. We can develop applications which uses them in local environment with no problem means…Dec 7, 2018Dec 7, 2018
Manoj Kumar DhakadHow to create linear regression model using Spark and Scala in Scala IDEI created several predictive models using python and its machine learning library sklearn but I didn’t find good resource to create machine…Apr 30, 2018Apr 30, 2018