Miguel Ángel LobatoAbout reading raw json files in sparkA while ago, I wrote an article here at medium with an approach to read raw json files in spark and an approach to handle schema changes…May 13, 2022May 13, 2022
Miguel Ángel LobatoImproving delta lake schema evolutionImportant note: in Delta Lake 1.1.0 and following releases, part of this problem is solved (but not completely).Sep 13, 2021Sep 13, 2021