Section: 15 π Common Sense Judgement and Probability
15.1 Introduction
We will step away from coding for a moment. In the class description we promise to address the million dollar question βHow not to be fooled by data?β. Letβs dive into this important issue. We have already discussed powerful tools such as hypothesis testing, p-values and Bonferroni correction for multiple hypothesis traps. But even if you never want to write a line of code, you need to know about common traps which you may be fooled by in whatever you do. We need to be informed and educated citizens who can catch the fake inferences and fake discoveries whether we read them in the news or hear politicians falling for the traps.
Daniel Kahnemann, the Nobel Prize winner in Economics is the author of the fascinating book βThink fast, think slowβ and he identifies pitfalls of human relationships with numbers, frequencies. We discuss Availability, Anchoring, Conjunctive fallacy, Narrative fallacy, Law of small numbers, Reverse to the mean and many other concepts in the attached power points.
In the next section we will also discuss Bayesian theorem and Bayesian reasoning (with some coding handy) to finally come back to the paradoxes such as prosecutorial paradox, Simpson paradox and ecological fallacy in section 21.