PinnedNicholas PiescoModeling in PySpark Pt. 2A robust data model is crucial for maintaining data integrity and quality, particularly when dealing with complex and hierarchical…Feb 61Feb 61
PinnedNicholas PiescoinData Engineer ThingsComplex Data Types & OBT Modeling in PySparkComplex data types are essential when dealing with intricate or semi-structured data in PySpark. This guide provides a comprehensive…Jan 91Jan 91
PinnedNicholas PiescoinData Engineer ThingsObject-Oriented Programming in PySpark: Serialization IssuesObject-Oriented Programming (OOP) is a foundational principle for modern software development, providing a clear code structure and design…Aug 8, 2023Aug 8, 2023
PinnedNicholas PiescoinData Engineer ThingsThe Evolution of Big Data: From SQL Databases to Interactive AnalyticsJun 19, 20232Jun 19, 20232
Nicholas PiescoinData Engineer ThingsGranular Look at Left, Semi, and Anti Joins in PySparkIn data operations, understanding the inner-working of the various types of joins can optimize query performance and accuracy. Spark…May 20May 20
Nicholas PiescoinData Engineer ThingsCracking the Code: Tied Scores, a Window Functions PerspectiveIn modern businesses, performance dashboards have become essential tools for recognizing and celebrating top performers. Serving as a…Apr 31Apr 31
Nicholas PiescoPerformance Considerations; ORMs, ODBC, and Database DriversInteractions between software and databases are a critical component of system architecture. Engineers can employ various data access…Nov 14, 2023Nov 14, 2023
Nicholas PiescoinData Engineer ThingsTraditional & Modern Data Modeling in Distributed Computing Frameworks: A Guide to Effective…Handling data in distributed environments imposes numerous challenges to organizations related to data management and efficient processing…Oct 26, 20231Oct 26, 20231
Nicholas PiescoDecentralization vs Centralization: Balancing Data Management DynamicsThe continuously evolving nature of industry conditions underscores a discernible shift towards data decentralization. Largely triggered by…Jun 16, 2023Jun 16, 2023