Data Science

Exploring the Different Levels of Granularity in Data Product

Data product design — Data verification and cleaning

Even if the rice is harvested, it cannot be eaten directly and needs to undergo a series of processing before it can be delivered to the consumer.

Types of data product — Raw Data

Garbage in, garbage out

Introduction to Data Product

Data + Product

Preface

Big data and AI are hot topics these years. Both companies and customers have started to improve their products or business through data analysis or machine learning. However, in the past few years…

Data Pipeline Design Patterns(2) Partial Mirroring

部分鏡像 — Select and Filter

適用情境

Data Pipeline Design Patterns(1) Mirroring

完全鏡像

[Data] Data Pipeline 101（八） — ETL Job 開發流程

從開發到放棄

介紹一下一般開發 ETL 的流程。每隻 ETL 都可以看作是獨立的程式，有獨立的開發流程。

設計原型

跟一般的軟體開發一樣，先從最關鍵的點開始做 POC，確認商業邏輯和資料是可行的再做後續開發。