PinnedPeter FlookinData Engineer ThingsProviding your documents to an LLM on your laptopA step-by-step example of how you can provide your own set of documents to an LLM to answer your questions. All in your local laptop.Jan 173Jan 173
Peter FlookData Contracts in Action: TestingThere has been a lot of talk about data contracts, but not much action. Let us see them in action when applied to testing data pipelines.Jul 17Jul 17
Peter FlookinData Engineer Thingsinsta-infra: Single command quickstart for any toolThe simple way to spin up any tool on your local laptop.Jun 12Jun 12
Peter FlookFile Formats Unveiled: Exploring the World of File Format DifferencesSo you want to store data in a file. But which file format suits your use case? What are the differences between Parquet and ORC? Delta…May 11May 11
Peter FlookAs a data engineer, I was overwhelmed with the number of open-source technologies.Compare the differences between technologies and tools such as file formats, job orchestrators and more at Tech Diff.May 6May 6
Peter FlookAnnoying Bug of The Day: HTML Form SubmitTLDR: Beware of buttons in forms in HTML. Set <button type="button">.May 5May 5
Peter FlookinData Engineer ThingsWhat is something we have but don’t own and is never working when you need it.Testing is difficult but pains could be eased with unified tooling. Here we explore the pros and cons of testing with new tools to help usMay 2May 2
Peter FlookSwagger/OpenAPI Data GenerationSimple and fast tool for generating high-quality data for any REST/HTTP API defined in a Swagger/OpenAPI document.Apr 18Apr 18
Peter FlookinData Engineer ThingsDeploying a Spark-based application as a Windows application*Note: Not a medium member? Use this link to view the full article. **Note: If you want to generate or validate data, take a look at Data…Apr 32Apr 32
Peter FlookThe number of places you can find the Java version in IntellijJuggling projects that use different versions of Java in Intellij or having random errors relating to Java when running in IntellijMar 8Mar 8