TDS Archive

An archive of data science, data analytics, data engineering, machine learning, and artificial intelligence writing from the former Towards Data Science Medium publication.

Photo by Vladislav Babienko on Unsplash

Member-only story

You Can’t Step in the Same River Twice

The Book of Why” Chapters 7&8, a Read with Me series

Zijing Zhu, PhD
TDS Archive
Published in
18 min readDec 20, 2023

--

In my previous articles, we learned about confounders and colliders in observational data that hinder establishing reliable causal relationships. The solution Pearl provided is to draw causal diagrams and use the backdoor criterion to find the sets of confounders to block and leave the colliders and mediators along.

However, when dealing with confounding variables that cannot be observed or measured, it becomes difficult to estimate causality from the observational data. Coping with this issue, in Chapter 7 of "The Book of Why," Judea Pearl introduced the do-calculus rules. These rules are particularly useful for the front-door criterion and instrumental variables. They can be used to establish causality even when unobservable confounding variables are present.

In Chapter 8, we will explore the amazing world of counterfactuals. Opening with Poet Robert Frost’s famous lines:

“And sorry I could not travel both

And be one traveler, long I stood…”

Pearl states although it’s impossible to travel both paths or step into the same rivers twice, our brains can imagine what would have happened if we had taken the other path. In…

--

--

TDS Archive
TDS Archive

Published in TDS Archive

An archive of data science, data analytics, data engineering, machine learning, and artificial intelligence writing from the former Towards Data Science Medium publication.

Zijing Zhu, PhD
Zijing Zhu, PhD

Written by Zijing Zhu, PhD

Ph.D. in Economics | Data Scientist @Cisco | Top 1000 Writer in Medium| Lifetime Learner | https://www.linkedin.com/in/zijingzhu/

Responses (3)