RahulSolving Small file problem in spark structured streaming : A versioning ApproachStreaming jobs usually creates too many small files which impacts the performance of jobs and queries reading these files. There is no…3 min read·Jul 17, 2020--5--5