Shyamal AkruvalainNerd For TechOvercoming Parquet Schema IssuesCouple approaches on how we overcame parquet schema related issues when using Pandas and Spark dataframes.Aug 20, 20201Aug 20, 20201
Mark W KiehlDarren Smith's article "Saving Metadata with DataFrames" shows how to retain custom metadata by…1) Saving a Pandas DataFrame to a Feather file is 13x faster than saving to a compressed Parquet file (using PyArrow).Mar 26, 2023Mar 26, 2023
Russell JurneyinData Syndrome BlogPython and Parquet PerformanceIn Pandas, PyArrow, fastparquet, AWS Data Wrangler, PySpark and DaskNov 1, 20204Nov 1, 20204
Tirthajyoti SarkarinProductive Data ScienceWhy you should use Parquet files with PandasWhy you should use Parquet files with Pandas to make your analytics pipeline faster and efficient.Sep 28, 20212Sep 28, 20212