SongkunjumpinAgoda Engineering & DesignHow AQE Helps Optimize Shuffle Partition NumberApache Spark is swiftly gaining traction as a versatile data processing system when it comes to big data tools. It is especially useful for…May 23, 2022May 23, 2022
SongkunjumpShuffle Partition Size Matters and How AQE Help Us Finding Reasoning Partition SizeIntroductionFeb 2, 20222Feb 2, 20222
SongkunjumpSpark: Understand the Basic of Pushed Filter and Partition Filter Using Parquet FilePushed Filter and Partition Filter are techniques that are used by spark to reduce the amount of data that are loaded into memory. In this…Nov 1, 20211Nov 1, 20211