PinnedPeter FlookinData Engineer ThingsProviding your documents to an LLM on your laptopA step-by-step example of how you can provide your own set of documents to an LLM to answer your questions. All in your local laptop.·9 min read·Jan 17, 2024--3--3
Peter FlookFile Formats Unveiled: Exploring the World of File Format DifferencesSo you want to store data in a file. But which file format suits your use case? What are the differences between Parquet and ORC? Delta…·3 min read·May 11, 2024----
Peter FlookAs a data engineer, I was overwhelmed with the number of open-source technologies.Compare the differences between technologies and tools such as file formats, job orchestrators and more at Tech Diff.·3 min read·May 6, 2024----
Peter FlookAnnoying Bug of The Day: HTML Form SubmitTLDR: Beware of buttons in forms in HTML. Set <button type="button">.·3 min read·May 5, 2024----
Peter FlookinData Engineer ThingsWhat is something we have but don’t own and is never working when you need it.Testing is difficult but pains could be eased with unified tooling. Here we explore the pros and cons of testing with new tools to help us·5 min read·May 2, 2024----
Peter FlookSwagger/OpenAPI Data GenerationSimple and fast tool for generating high-quality data for any REST/HTTP API defined in a Swagger/OpenAPI document.3 min read·Apr 18, 2024----
Peter FlookinData Engineer ThingsDeploying a Spark-based application as a Windows application*Note: Not a medium member? Use this link to view the full article. **Note: If you want to generate or validate data, take a look at Data…·4 min read·Apr 3, 2024--2--2
Peter FlookThe number of places you can find the Java version in IntellijJuggling projects that use different versions of Java in Intellij or having random errors relating to Java when running in Intellij5 min read·Mar 8, 2024----
Peter FlookinData Engineer ThingsCreating a document answering ChatbotA simple way to create a document chatbot without too much coding.·5 min read·Jan 27, 2024----
Peter FlookinData Engineer ThingsIs Testing Too Difficult? Automate Your Integration Tests via Automated Data FlowsA scalable and simple way to test jobs, services, or applications via data generation and validation.7 min read·Jan 10, 2024--1--1