The good, bad, and ugly ways of uploading large batches of data — Speed matters! In data pipelines, as in anywhere else. Dealing with massive datasets is an everyday thing for most data professionals. There would be no issue if they streamed into a database or a warehouse. But there are instances where we need to upload batch data that are heavy enough…