{"categories":["Probability Theory"],"contentHtml":"<h3>Week 2</h3><h4>Reading</h4><h5>FT-2 | Probability Measure</h5><p>We have already considered the measurable space <math><mo stretchy=\"false\">(</mo><mi mathvariant=\"normal\">Ω</mi><mo>,</mo><mi>ℱ︀</mi><mo stretchy=\"false\">)</mo></math> of the sample space and <math><mi>𝜎</mi></math>-algebra. We can now define the probability measure <math><mi>ℙ</mi></math> as a measure defined on events in the <math><mi>𝜎</mi></math>-algebra <math><mi>ℱ︀</mi></math>, taking values in the unit interval <math><mo stretchy=\"false\">[</mo><mn>0</mn><mo>,</mo><mn>1</mn><mo stretchy=\"false\">]</mo></math>. This measures the size of the events, which has two properties: the probability of <math><mi mathvariant=\"normal\">Ω</mi></math> is 1, which means that all outcomes are accounted for in the sample space, and that the measure is countably additive, which allows us to extend the probability of individual events to the entire <math><mi>𝜎</mi></math>-algebra.</p><p>There are three ways of thinking on how the numerical values of probability manifest. Frequentism assigns values directly from data. Objectivism assigns values based on some model which is considered to describe aspects of the universe. Subjectivism characterizes probability as measuring beliefs about the world.</p><p>The definition of probability measure is as follows:</p><p><math><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi mathvariant=\"normal\">Ω</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>=</mo><mn>1</mn></math></p><p>and for any sequence of disjoint events in <math><mi>ℱ︀</mi></math>:</p><p><math><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><msubsup><mo form=\"prefix\" lspace=\"0em\">⋃</mo><mrow><mi>𝑛</mi><mo lspace=\"0em\" rspace=\"0em\">=</mo><mn>1</mn></mrow><mi>∞</mi></msubsup><msub><mi>𝐴</mi><mi>𝑛</mi></msub><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>=</mo><msubsup><mo form=\"prefix\" lspace=\"0em\">∑</mo><mrow><mi>𝑛</mi><mo lspace=\"0em\" rspace=\"0em\">=</mo><mn>1</mn></mrow><mi>∞</mi></msubsup><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><msub><mi>𝐴</mi><mi>𝑛</mi></msub><mo stretchy=\"false\">)</mo></math></p><p>There are some other basic properties that arise from these definitions:</p><p>When <math><mi>𝐴</mi><mo>⊂</mo><mi>𝐵</mi></math></p><p><math><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐵</mi><mo>∖</mo><mi>𝐴</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>=</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐵</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>−</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐴</mi><mo stretchy=\"false\">)</mo></math></p><p><math><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐴</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>≤</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐵</mi><mo stretchy=\"false\">)</mo></math></p><p><math><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><msup><mi>𝐴</mi><mi>𝑐</mi></msup><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>=</mo><mn>1</mn><mo>−</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐴</mi><mo stretchy=\"false\">)</mo></math></p><p><math><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>∅</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>=</mo><mn>0</mn></math></p><p>For all <math><mi>𝐴</mi><mo>,</mo><mi>𝐵</mi></math>:</p><p><math><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐴</mi><mo>∪</mo><mi>𝐵</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>=</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐴</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>+</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐵</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>−</mo><mi>𝑃</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐴</mi><mo>∩</mo><mi>𝐵</mi><mo stretchy=\"false\">)</mo></math></p><p>Poincaré’s formula:</p><p><math><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><msub><mi>𝐴</mi><mn>1</mn></msub><mo>∪</mo><msub><mi>𝐴</mi><mn>2</mn></msub><mo>∪</mo><mi>…</mi><mo>∪</mo><msub><mi>𝐴</mi><mi>𝑛</mi></msub><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>=</mo><msub><mo form=\"prefix\" lspace=\"0em\" rspace=\"0em\">∑</mo><mrow><mi>𝐼</mi><mo lspace=\"0em\" rspace=\"0em\">⊂</mo><mrow><mo>{</mo><mrow><mn>1</mn><mo rspace=\"0em\">,</mo><mn>2</mn><mo rspace=\"0em\">,</mo><mi>…</mi><mo rspace=\"0em\">,</mo><mi>𝑛</mi></mrow><mo>}</mo></mrow></mrow></msub><mo form=\"prefix\" stretchy=\"false\">(</mo><mo form=\"prefix\">−</mo><mn>1</mn><msup><mo form=\"postfix\" stretchy=\"false\">)</mo><mrow><mo stretchy=\"false\">|</mo><mi>𝐼</mi><mo lspace=\"0em\" rspace=\"0em\">|</mo><mo lspace=\"0em\" rspace=\"0em\">+</mo><mn>1</mn></mrow></msup><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><msub><mo form=\"prefix\" lspace=\"0em\">⋂</mo><mrow><mi>𝑖</mi><mo lspace=\"0em\" rspace=\"0em\">∈</mo><mi>𝐼</mi></mrow></msub><msub><mi>𝐴</mi><mi>𝑖</mi></msub><mo stretchy=\"false\">)</mo></math></p><p><math><mo form=\"infix\" lspace=\"0em\">=</mo><msubsup><mo form=\"prefix\" lspace=\"0em\">∑</mo><mrow><mi>𝑖</mi><mo lspace=\"0em\" rspace=\"0em\">=</mo><mn>1</mn></mrow><mi>𝑛</mi></msubsup><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><msub><mi>𝐴</mi><mi>𝑖</mi></msub><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>−</mo><msub><mo form=\"prefix\" lspace=\"0em\">∑</mo><mrow><mi>𝑖</mi><mo lspace=\"0em\" rspace=\"0em\">&lt;</mo><mi>𝑗</mi><mo lspace=\"0em\" rspace=\"0em\">≤</mo><mi>𝑛</mi></mrow></msub><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><msub><mi>𝐴</mi><mi>𝑖</mi></msub><mo>∩</mo><msub><mi>𝐴</mi><mi>𝑗</mi></msub><mo stretchy=\"false\">)</mo></math></p><p><math><mo>+</mo><msub><mo form=\"prefix\">∑</mo><mrow><mi>𝑖</mi><mo lspace=\"0em\" rspace=\"0em\">&lt;</mo><mi>𝑗</mi><mo lspace=\"0em\" rspace=\"0em\">&lt;</mo><mi>𝑘</mi><mo lspace=\"0em\" rspace=\"0em\">≤</mo><mi>𝑛</mi></mrow></msub><mi>ℙ</mi><mrow><mo>(</mo><mrow><msub><mi>𝐴</mi><mi>𝑖</mi></msub><mo>∩</mo><msub><mi>𝐴</mi><mi>𝑗</mi></msub><mo>∩</mo><msub><mi>𝐴</mi><mi>𝑘</mi></msub></mrow><mo>)</mo></mrow><mo>−</mo><mi>…</mi><mo>+</mo><msup><mrow><mo>(</mo><mrow><mo>−</mo><mn>1</mn></mrow><mo>)</mo></mrow><mi>𝑛</mi></msup><mo lspace=\"0.2222222222222222em\" rspace=\"0.2222222222222222em\">×</mo><mi>ℙ</mi><mrow><mo>(</mo><mrow><msub><mi>𝐴</mi><mn>1</mn></msub><mo>∩</mo><msub><mi>𝐴</mi><mn>2</mn></msub><mi>…</mi><mo>∩</mo><msub><mi>𝐴</mi><mi>𝑛</mi></msub></mrow><mo>)</mo></mrow></math></p><p>This is better expressed as the idea that the probability measure of the unions of sets can be expressed as the alternating signed partial sum of all the different partial intersections of the sequence of sets. It is proved by induction over the previous property.</p><p>Finite subadditivity (Boole’s inequality):</p><p><math><mi>ℙ</mi><mrow><mo>(</mo><mrow><msubsup><mo lspace=\"0em\">⋃</mo><mrow><mi>𝑖</mi><mo lspace=\"0em\" rspace=\"0em\">=</mo><mn>1</mn></mrow><mi>𝑛</mi></msubsup><msub><mi>𝐴</mi><mi>𝑖</mi></msub></mrow><mo>)</mo></mrow><mo>≤</mo><msubsup><mo form=\"prefix\" lspace=\"0em\">∑</mo><mrow><mi>𝑖</mi><mo lspace=\"0em\" rspace=\"0em\">=</mo><mn>1</mn></mrow><mi>𝑛</mi></msubsup><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><msub><mi>𝐴</mi><mi>𝑖</mi></msub><mo stretchy=\"false\">)</mo></math></p><p>To show this, we shall set: <math><msub><mi>𝐵</mi><mn>1</mn></msub><mo>=</mo><msub><mi>𝐴</mi><mn>1</mn></msub><mo>,</mo><msub><mi>𝐵</mi><mn>2</mn></msub><mo>=</mo><msub><mi>𝐴</mi><mn>2</mn></msub><mo>∩</mo><msubsup><mi>𝐴</mi><mn>1</mn><mi>𝑐</mi></msubsup><mo>,</mo><mi>…</mi><mo>,</mo><msub><mi>𝐵</mi><mi>𝑛</mi></msub><mo>=</mo><msub><mi>𝐴</mi><mi>𝑛</mi></msub><mo>∩</mo><msubsup><mi>𝐴</mi><mrow><mi>𝑛</mi><mo lspace=\"0em\" rspace=\"0em\">−</mo><mn>1</mn></mrow><mi>𝑐</mi></msubsup><mo>∩</mo><mi>…</mi><mo>∩</mo><msubsup><mi>𝐴</mi><mn>1</mn><mi>𝑐</mi></msubsup></math></p><p>You can think of this every successive element being disjoint with all the previous elements, which means</p><p><math><msub><mi>𝐵</mi><mi>𝑖</mi></msub><mo>∩</mo><msub><mi>𝐵</mi><mi>𝑗</mi></msub><mo>=</mo><mi>∅</mi></math></p><p>and also</p><p><math><msubsup><mo lspace=\"0em\">⋃</mo><mrow><mi>𝑖</mi><mo lspace=\"0em\" rspace=\"0em\">=</mo><mn>1</mn></mrow><mi>𝑛</mi></msubsup><msub><mi>𝐵</mi><mi>𝑖</mi></msub><mo>=</mo><msubsup><mo form=\"prefix\" lspace=\"0em\">⋃</mo><mrow><mi>𝑖</mi><mo lspace=\"0em\" rspace=\"0em\">=</mo><mn>1</mn></mrow><mi>𝑛</mi></msubsup><msub><mi>𝐴</mi><mi>𝑖</mi></msub></math></p><p>because the union of all the disjoint parts of the sets will include all the overlap in the sets.</p><p>A <strong>partition</strong> of a set <math><mi mathvariant=\"normal\">Ω</mi></math> is a collection of disjoint sets <math><mrow><mo>{</mo><msub><mi mathvariant=\"normal\">Ω</mi><mi>𝑖</mi></msub><mo>}</mo></mrow></math> where the union recreates the original set: <math><msub><mo lspace=\"0em\">⋃</mo><mi>𝑖</mi></msub><msub><mi mathvariant=\"normal\">Ω</mi><mi>𝑖</mi></msub><mo>=</mo><mi mathvariant=\"normal\">Ω</mi></math></p><p>We can think of the probability of an event as the intersections of the event with a partition of <math><mi mathvariant=\"normal\">Ω</mi></math>. This is <strong>the law of total probability</strong>. For <math><mo stretchy=\"false\">(</mo><msub><mi>𝐴</mi><mi>𝑖</mi></msub><msub><mo stretchy=\"false\">)</mo><mrow><mi>𝑖</mi><mo lspace=\"0em\" rspace=\"0em\">∈</mo><mi>𝐼</mi></mrow></msub></math> a partition of <math><mi mathvariant=\"normal\">Ω</mi></math> and every event <math><mi>𝐵</mi><mo>∈</mo><mi>ℱ︀</mi></math>:</p><p><math><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐵</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>=</mo><msub><mo form=\"prefix\" lspace=\"0em\">∑</mo><mrow><mi>𝑖</mi><mo lspace=\"0em\" rspace=\"0em\">∈</mo><mi>𝐼</mi></mrow></msub><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐵</mi><mo>∩</mo><msub><mi>𝐴</mi><mi>𝑖</mi></msub><mo stretchy=\"false\">)</mo></math></p><h6>Uniqueness of Probability Measures</h6><p>Let’s consider the idea of a <math><mi>𝜆</mi></math>-system <math><mi>𝒰︀</mi></math> which is a family of events where:</p><p><math><mi mathvariant=\"normal\">Ω</mi><mo>∈</mo><mi>𝒰︀</mi></math></p><p>For any <math><mi>𝐴</mi><mo>,</mo><mi>𝐵</mi><mo>∈</mo><mi>𝒰︀</mi></math> and <math><mi>𝐴</mi><mo>⊂</mo><mi>𝐵</mi></math>, <math><mi>𝐵</mi><mo>∖</mo><mi>𝐴</mi><mo>∈</mo><mi>𝒰︀</mi></math></p><p>For a sequence of disjoint events <math><msub><mi>𝐴</mi><mi>𝑛</mi></msub></math>, indexed by <math><mi>𝑛</mi><mo>∈</mo><mi>𝒰︀</mi></math>:</p><p><math><msub><mo lspace=\"0em\">⋃</mo><mi>𝑛</mi></msub><msub><mi>𝐴</mi><mi>𝑛</mi></msub><mo>∈</mo><mi>𝒰︀</mi></math></p><p>You might notice that this is fairly similar to the definition of a <math><mi>𝜎</mi></math>-algebra. In fact, a <math><mi>𝜎</mi></math>-algebra is a <math><mi>𝜆</mi></math>-system, and every <math><mi>𝜆</mi></math>-system closed to finite intersection is a <math><mi>𝜎</mi></math>-algebra.</p><p>Now let’s consider a collection of sets <math><mi>ℳ︀</mi><mo>⊆</mo><mi>𝑃</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi mathvariant=\"normal\">Ω</mi><mo stretchy=\"false\">)</mo></math> where <math><mi>𝒰︀</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>ℳ︀</mi><mo stretchy=\"false\">)</mo></math> is the smallest <math><mi>𝜆</mi></math>-system which contains <math><mi>ℳ︀</mi></math>: <math><mi>𝒰︀</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>ℳ︀</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>=</mo><mi>𝜎</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>ℳ︀</mi><mo stretchy=\"false\">)</mo></math></p><p>Note that this is distinct from the previous definition because although the <math><mi>𝜆</mi></math>-system is known to be a <math><mi>𝜎</mi></math>-algebra, it is now also defined to be the same as one which is generated by the same collection of sets.</p><p>Now let’s consider some probability measures <math><msub><mi>ℙ</mi><mn>1</mn></msub></math> and <math><msub><mi>ℙ</mi><mn>2</mn></msub></math> on the <math><mi>𝜎</mi></math>-algebra <math><mi>ℱ︀</mi></math> generated from a collection of sets <math><mi>ℳ︀</mi></math>. If <math><msub><mi>ℙ</mi><mn>1</mn></msub></math> and <math><msub><mi>ℙ</mi><mn>2</mn></msub></math> coincide on <math><mi>ℳ︀</mi></math>, then they coincide on <math><mi>ℱ︀</mi></math>. This means that for every event, the two probability measures assign the same probabilities, which includes all the different kinds of events generated by the <math><mi>𝜎</mi></math>-algebra. This also applies to partitions of a sample space.</p><h6>Monotone Class</h6><p>This is a variant of a <math><mi>𝜆</mi></math>-system. A <strong>monotone class <math><mi>ℳ︀</mi></math></strong> of subsets in <math><mi mathvariant=\"normal\">Ω</mi></math> is closed under the formation of monotone unions and intersections, i.e.</p><p><math><msub><mi>𝐴</mi><mn>1</mn></msub><mo>,</mo><msub><mi>𝐴</mi><mn>2</mn></msub><mo>,</mo><mi>…</mi><mo>∈</mo><mi>ℳ︀</mi></math> and <math><msub><mi>𝐴</mi><mi>𝑛</mi></msub><mo>⊆</mo><msub><mi>𝐴</mi><mrow><mi>𝑛</mi><mo lspace=\"0em\" rspace=\"0em\">+</mo><mn>1</mn></mrow></msub><mo>,</mo><msub><mo lspace=\"0em\">∪</mo><mi>𝑛</mi></msub><msub><mi>𝐴</mi><mi>𝑛</mi></msub><mo>=</mo><mi>𝐴</mi><mo stretchy=\"false\">⇒</mo><mi>𝐴</mi><mo>∈</mo><mi>ℳ︀</mi></math></p><p>where the sets are increasing in size, containing the previous one,, and the union of all of them equals the last one.</p><p><math><msub><mi>𝐴</mi><mn>1</mn></msub><mo>,</mo><msub><mi>𝐴</mi><mn>2</mn></msub><mo>,</mo><mi>…</mi><mo>∈</mo><mi>ℳ︀</mi></math> and <math><msub><mi>𝐴</mi><mi>𝑛</mi></msub><mo>⊇</mo><msub><mi>𝐴</mi><mrow><mi>𝑛</mi><mo lspace=\"0em\" rspace=\"0em\">+</mo><mn>1</mn></mrow></msub><mo stretchy=\"false\">⇒</mo><msub><mo lspace=\"0em\">∩</mo><mi>𝑛</mi></msub><msub><mi>𝐴</mi><mi>𝑛</mi></msub><mo>∈</mo><mi>ℳ︀</mi></math></p><p>or where the sets are decreasing in size, containing the next one, and the intersection of all of them equals the last one.</p><p><strong>Open question:</strong> more stuff about monotone classes only if the professor talks about them.</p><h6>Monotone Convergence Properties of Probability</h6><p>How do we deal with infinity?</p><p>If <math><msub><mi>𝐴</mi><mi>𝑛</mi></msub><mo>,</mo><mi>𝐴</mi><mo>∈</mo><mi>ℱ︀</mi></math> and <math><msub><mi>𝐴</mi><mi>𝑛</mi></msub><mo stretchy=\"false\">↑</mo><mi>𝐴</mi></math>, which means that <math><mi>𝐴</mi></math> is a monotonically increasing class, then <math><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><msub><mi>𝐴</mi><mi>𝑛</mi></msub><mo form=\"postfix\" stretchy=\"false\">)</mo><mo stretchy=\"false\">↑</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐴</mi><mo stretchy=\"false\">)</mo></math> and the same is true for <math><msub><mi>𝐴</mi><mi>𝑛</mi></msub><mo stretchy=\"false\">↓</mo><mi>𝐴</mi></math>.</p><p>Under countable subadditivity, the probability measure of the union of sets is less than or equal to the sum of the probability measures of those sets. That makes sense intuitively because it would be equal if the sets were disjoint, but the sets might overlap, making it less. We can use the above properties to extend this idea to countably infinite sets.</p><p>A <strong>null set</strong> is a set with probability measure 0. <math><mi>∅</mi></math> is the obvious example, and in infinite sets there may be others like the probability measure of a singleton set in the Borel <math><mi>𝜎</mi></math>-algebra.</p><h6>Conditional Probability</h6><p>“In some cases the probability of an event happening depends not just on the experiment itself but on other information as well. <strong>Conditional probability</strong> forms a framework in which this additional information can be incorporated.”</p><p><math><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐴</mi><mo lspace=\"0em\" rspace=\"0em\">|</mo><mi>𝐵</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>=</mo><mfrac><mrow><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐴</mi><mo lspace=\"0em\" rspace=\"0em\">∩</mo><mi>𝐵</mi><mo stretchy=\"false\">)</mo></mrow><mrow><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐵</mi><mo stretchy=\"false\">)</mo></mrow></mfrac></math></p><p>Obviously, the probability measure of <math><mi>𝐵</mi></math> cannot be 0, which makes sense because in order for something to be conditioned, the condition has to have happened, which is not possible if the probability is 0.</p><p>We can get the <strong>multiplicative rule</strong> from this formula.</p><p><math><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐴</mi><mo>∩</mo><mi>𝐵</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>=</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐴</mi><mo lspace=\"0em\" rspace=\"0em\">|</mo><mi>𝐵</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐵</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mo rspace=\"0em\">,</mo></math></p><p><math><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐴</mi><mo>∩</mo><mi>𝐵</mi><mo>∩</mo><mi>𝐶</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>=</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐴</mi><mo lspace=\"0em\" rspace=\"0em\">|</mo><mi>𝐵</mi><mo>∩</mo><mi>𝐶</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐵</mi><mo lspace=\"0em\" rspace=\"0em\">|</mo><mi>𝐶</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐶</mi><mo stretchy=\"false\">)</mo></math>, etc.</p><p>Let’s take an example. We have Urn 1 which contains 2 black balls and 3 white balls, and Urn 2 which contains 1 of each. One urn is chosen at random and one ball is chosen randomly from that urn. If a black ball is chosen, what is the probability it came from Urn 1?</p><p>Let’s assign our variables.</p><p><math><mi>𝐴</mi></math> is the event of choosing Urn 1, and <math><mi>𝐵</mi></math> is the event of choosing a black ball. We’re trying to find <math><mi>𝑃</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐴</mi><mo lspace=\"0em\" rspace=\"0em\">|</mo><mi>𝐵</mi><mo stretchy=\"false\">)</mo></math>, so we need <math><mi>𝑃</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐴</mi><mo>∩</mo><mi>𝐵</mi><mo stretchy=\"false\">)</mo></math>. There are four total events in our sample space: { Urn1Black, Urn1White, Urn2Black, Urn2White }. The probability of Urn1Black is <math><mn>0.5</mn><mo lspace=\"0.2222222222222222em\" rspace=\"0.2222222222222222em\">×</mo><mn>0.4</mn><mo>=</mo><mn>0.2</mn></math>. The probability of choosing a black ball is <math><mn>0.5</mn></math> in the case of Urn 2 and <math><mn>0.4</mn></math> in the case of Urn 1, which averages to <math><mn>0.45</mn></math>. So the overall probability is <math><mn>0.2</mn><mi>/</mi><mn>0.45</mn></math>, which is <math><mn>4</mn><mi>/</mi><mn>9</mn></math>.</p><p>The <strong>total probability formula</strong> given <math><msub><mi>𝐴</mi><mi>𝑛</mi></msub></math> partition of <math><mi mathvariant=\"normal\">Ω</mi></math> is</p><p><math><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐵</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>=</mo><msubsup><mo form=\"prefix\" lspace=\"0em\">∑</mo><mrow><mi>𝑖</mi><mo lspace=\"0em\" rspace=\"0em\">=</mo><mn>1</mn></mrow><mi>𝑛</mi></msubsup><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐵</mi><mo lspace=\"0em\" rspace=\"0em\">|</mo><msub><mi>𝐴</mi><mi>𝑖</mi></msub><mo form=\"postfix\" stretchy=\"false\">)</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><msub><mi>𝐴</mi><mi>𝑖</mi></msub><mo stretchy=\"false\">)</mo></math></p><p>for any event <math><mi>𝐵</mi><mo>∈</mo><mi>ℱ︀</mi></math>.</p><p>If Stanley wants to draw a card from 20, where 8 are favorable to him, what is the probability of him drawing a favorable card if he draws first, second, or third?</p><p>First is easy. <math><mn>8</mn><mi>/</mi><mn>20</mn><mo>=</mo><mn>0.4</mn></math></p><p>For second, there are two different possibilities. Either the first draw was a favorable or unfavorable card. Let’s use the formula above.</p><p><math><mi>𝐵</mi></math> is the event of Stanley drawing a favorable card. There are two <math><mi>𝐴</mi></math> events in consideration, which are the first card being favorable and unfavorable. <math><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><msub><mi>𝐴</mi><mn>1</mn></msub><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>=</mo><mn>2</mn><mi>/</mi><mn>5</mn></math> and <math><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><msub><mi>𝐴</mi><mn>2</mn></msub><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>=</mo><mn>3</mn><mi>/</mi><mn>5</mn></math>. If a favorable card was drawn first, then the new probability is <math><mn>7</mn><mi>/</mi><mn>19</mn></math>. Otherwise, it’s <math><mn>8</mn><mi>/</mi><mn>19</mn></math>. So the complete formula becomes</p><p><math><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐵</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>=</mo><mn>2</mn><mi>/</mi><mn>5</mn><mo lspace=\"0.2222222222222222em\" rspace=\"0.2222222222222222em\">×</mo><mn>7</mn><mi>/</mi><mn>19</mn><mo>+</mo><mn>3</mn><mi>/</mi><mn>5</mn><mo lspace=\"0.2222222222222222em\" rspace=\"0.2222222222222222em\">×</mo><mn>8</mn><mi>/</mi><mn>19</mn><mo>=</mo><mn>0.4</mn></math></p><p>It’s clear that the same situation would arise if he drew the third card.</p><p><strong>Bayes’ formula</strong> is the following (like the others it’s based on a partition <math><mi>𝐴</mi></math> and arbitrary set <math><mi>𝐵</mi><mo>∈</mo><mi>ℱ︀</mi></math>):</p><p><math><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><msub><mi>𝐴</mi><mi>𝑗</mi></msub><mo lspace=\"0em\" rspace=\"0em\">|</mo><mi>𝐵</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>=</mo><mfrac><mrow><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐵</mi><mo lspace=\"0em\" rspace=\"0em\">|</mo><msub><mi>𝐴</mi><mi>𝑗</mi></msub><mo form=\"postfix\" stretchy=\"false\">)</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><msub><mi>𝐴</mi><mi>𝑗</mi></msub><mo stretchy=\"false\">)</mo></mrow><mrow><msubsup><mo lspace=\"0em\">∑</mo><mrow><mi>𝑖</mi><mo lspace=\"0em\" rspace=\"0em\">=</mo><mn>1</mn></mrow><mi>𝑛</mi></msubsup><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐵</mi><mo lspace=\"0em\" rspace=\"0em\">|</mo><msub><mi>𝐴</mi><mi>𝑖</mi></msub><mo form=\"postfix\" stretchy=\"false\">)</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><msub><mi>𝐴</mi><mi>𝑖</mi></msub><mo stretchy=\"false\">)</mo></mrow></mfrac></math></p><p>“This theorem can be interpreted as: All of a sudden we find out <math><mi>𝐵</mi></math> happened. In the light of this new information there should be a simple way to update all the probabilities of the sets in the partition <math><mo stretchy=\"false\">(</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><msub><mi>𝐴</mi><mi>𝑗</mi></msub><mo lspace=\"0em\" rspace=\"0em\">|</mo><mi>𝐵</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mo stretchy=\"false\">)</mo></math>. Indeed, the Bayes rule provides just that.”</p><p>So you take the existing <math><mi>𝐴</mi></math>, and then condition it on <math><mi>𝐵</mi></math>, and then the calculation cascades across the events in the sample space i.e.&nbsp;<math><mi>𝐴</mi></math>.</p><h6>Independence</h6><p>Two events <math><mi>𝐴</mi></math> and <math><mi>𝐵</mi></math> are defined as <strong>independent</strong> if</p><p><math><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐴</mi><mo>∩</mo><mi>𝐵</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>=</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐴</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐵</mi><mo stretchy=\"false\">)</mo></math></p><p>which can be extended to the idea of being <strong>mutually independent</strong> (or simply independent) for a set of events:</p><p><math><mi>ℙ</mi><mrow><mo>(</mo><mrow><msub><mo lspace=\"0em\">⋃</mo><mrow><mi>𝑗</mi><mo lspace=\"0em\" rspace=\"0em\">∈</mo><mi>𝐽</mi></mrow></msub><msub><mi>𝐴</mi><mi>𝑗</mi></msub></mrow><mo>)</mo></mrow><mo>=</mo><msub><mo form=\"prefix\" lspace=\"0em\">∏</mo><mrow><mi>𝑗</mi><mo lspace=\"0em\" rspace=\"0em\">∈</mo><mi>𝐽</mi></mrow></msub><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><msub><mi>𝐴</mi><mi>𝑗</mi></msub><mo stretchy=\"false\">)</mo></math></p><p>There’s also the idea of <strong>jointly independent</strong> (or pairwise independent):</p><p><math><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><msub><mi>𝐴</mi><mi>𝑖</mi></msub><mo>∪</mo><msub><mi>𝐴</mi><mi>𝑗</mi></msub><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>=</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><msub><mi>𝐴</mi><mi>𝑖</mi></msub><mo form=\"postfix\" stretchy=\"false\">)</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><msub><mi>𝐴</mi><mi>𝑗</mi></msub><mo stretchy=\"false\">)</mo></math></p><p>which does not necessarily imply independence.</p><p>For two <math><mi>𝜎</mi></math>-algebras <math><mi>𝐺</mi></math> and <math><mi>𝐻</mi></math>, they are <math><mi>ℙ</mi></math>-independent if</p><p><math><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐺</mi><mo>∪</mo><mi>𝐻</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mo>=</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐺</mi><mo form=\"postfix\" stretchy=\"false\">)</mo><mi>ℙ</mi><mo form=\"prefix\" stretchy=\"false\">(</mo><mi>𝐻</mi><mo stretchy=\"false\">)</mo></math></p><p>and the same applies for mutual independence as with events.</p><p>We can also show that if all <math><mi>𝜎</mi></math>-algebras in a family are each generated from a collection of independent sets, they are independent. This independence is also associative. There’s an additional property of “disassociativity of the independence”, where independent families included in bigger independent families remain independent.</p><p><math><mi>𝜎</mi></math>-algebras generated by events are related in their independence.</p>","contentSourceFormat":"typst","contentTypst":"== Week 2\n<week-2>\n=== Reading\n<reading>\n==== FT-2 | Probability Measure\n<ft-2-probability-measure>\nWe have already considered the measurable space $\\(Omega\\,cal(F)\\)$ of the sample space and $sigma$-algebra. We can now define the probability measure $bb(P)$ as a measure defined on events in the $sigma$-algebra $cal(F)$, taking values in the unit interval $\\[0\\,1\\]$. This measures the size of the events, which has two properties: the probability of $Omega$ is 1, which means that all outcomes are accounted for in the sample space, and that the measure is countably additive, which allows us to extend the probability of individual events to the entire $sigma$-algebra.\n\nThere are three ways of thinking on how the numerical values of probability manifest. Frequentism assigns values directly from data. Objectivism assigns values based on some model which is considered to describe aspects of the universe. Subjectivism characterizes probability as measuring beliefs about the world.\n\nThe definition of probability measure is as follows:\n\n$bb(P)\\(Omega\\)= 1$\n\nand for any sequence of disjoint events in $cal(F)$:\n\n$bb(P)\\(union.big_(n = 1)^oo A_n\\)= sum_(n = 1)^oo bb(P)\\(A_n\\)$\n\nThere are some other basic properties that arise from these definitions:\n\nWhen $A subset B$\n\n$bb(P)\\(B without A\\)= bb(P)\\(B\\)- bb(P)\\(A\\)$\n\n$bb(P)\\(A\\)lt.eq bb(P)\\(B\\)$\n\n$bb(P)\\(A^c\\)= 1 - bb(P)\\(A\\)$\n\n$bb(P)\\(nothing\\)= 0$\n\nFor all $A\\,B$:\n\n$bb(P)\\(A union B\\)= bb(P)\\(A\\)+ bb(P)\\(B\\)- P\\(A inter B\\)$\n\nPoincaré's formula:\n\n$bb(P)\\(A_1 union A_2 union dots.h union A_n\\)= sum_(I subset { 1\\,2\\,dots.h\\,n })\\(- 1\\)^(\\|I\\|+ 1)bb(P)\\(inter.big_(i in I) A_i\\)$\n\n$= sum_(i = 1)^n bb(P)\\(A_i\\)- sum_(i < j lt.eq n) bb(P)\\(A_i inter A_j\\)$\n\n$+ sum_(i < j < k lt.eq n) bb(P)(A_i inter A_j inter A_k) - dots.h + (-1)^n times bb(P)(A_1 inter A_2 dots.h inter A_n)$\n\nThis is better expressed as the idea that the probability measure of the unions of sets can be expressed as the alternating signed partial sum of all the different partial intersections of the sequence of sets. It is proved by induction over the previous property.\n\nFinite subadditivity (Boole's inequality):\n\n$bb(P) (union.big_(i = 1)^n A_i) lt.eq sum_(i = 1)^n bb(P)\\(A_i\\)$\n\nTo show this, we shall set: $B_1 = A_1\\,B_2 = A_2 inter A_1^c\\,dots.h\\,B_n = A_n inter A_(n - 1)^c inter dots.h inter A_1^c$\n\nYou can think of this every successive element being disjoint with all the previous elements, which means\n\n$B_i inter B_j = nothing$\n\nand also\n\n$union.big_(i = 1)^n B_i = union.big_(i = 1)^n A_i$\n\nbecause the union of all the disjoint parts of the sets will include all the overlap in the sets.\n\nA #strong[partition] of a set $Omega$ is a collection of disjoint sets ${ Omega_i }$ where the union recreates the original set: $union.big_i Omega_i = Omega$\n\nWe can think of the probability of an event as the intersections of the event with a partition of $Omega$. This is #strong[the law of total probability]. For $\\(A_i\\)_(i in I)$ a partition of $Omega$ and every event $B in cal(F)$:\n\n$bb(P)\\(B\\)= sum_(i in I) bb(P)\\(B inter A_i\\)$\n\n===== Uniqueness of Probability Measures\n<uniqueness-of-probability-measures>\nLet's consider the idea of a $lambda$-system $cal(U)$ which is a family of events where:\n\n$Omega in cal(U)$\n\nFor any $A\\,B in cal(U)$ and $A subset B$, $B without A in cal(U)$\n\nFor a sequence of disjoint events $A_n$, indexed by $n in cal(U)$:\n\n$union.big_n A_n in cal(U)$\n\nYou might notice that this is fairly similar to the definition of a $sigma$-algebra. In fact, a $sigma$-algebra is a $lambda$-system, and every $lambda$-system closed to finite intersection is a $sigma$-algebra.\n\nNow let's consider a collection of sets $cal(M) subset.eq P\\(Omega\\)$ where $cal(U)\\(cal(M)\\)$ is the smallest $lambda$-system which contains $cal(M)$: $cal(U)\\(cal(M)\\)= sigma\\(cal(M)\\)$\n\nNote that this is distinct from the previous definition because although the $lambda$-system is known to be a $sigma$-algebra, it is now also defined to be the same as one which is generated by the same collection of sets.\n\nNow let's consider some probability measures $bb(P)_1$ and $bb(P)_2$ on the $sigma$-algebra $cal(F)$ generated from a collection of sets $cal(M)$. If $bb(P)_1$ and $bb(P)_2$ coincide on $cal(M)$, then they coincide on $cal(F)$. This means that for every event, the two probability measures assign the same probabilities, which includes all the different kinds of events generated by the $sigma$-algebra. This also applies to partitions of a sample space.\n\n===== Monotone Class\n<monotone-class>\nThis is a variant of a $lambda$-system. A #strong[monotone class $cal(M)$] of subsets in $Omega$ is closed under the formation of monotone unions and intersections, i.e.\n\n$A_1\\,A_2\\,dots.h in cal(M)$ and $A_n subset.eq A_(n + 1)\\,union_n A_n = A arrow.r.double A in cal(M)$\n\nwhere the sets are increasing in size, containing the previous one,, and the union of all of them equals the last one.\n\n$A_1\\,A_2\\,dots.h in cal(M)$ and $A_n supset.eq A_(n + 1) arrow.r.double inter_n A_n in cal(M)$\n\nor where the sets are decreasing in size, containing the next one, and the intersection of all of them equals the last one.\n\n#strong[Open question:] more stuff about monotone classes only if the professor talks about them.\n\n===== Monotone Convergence Properties of Probability\n<monotone-convergence-properties-of-probability>\nHow do we deal with infinity?\n\nIf $A_n\\,A in cal(F)$ and $A_n arrow.t A$, which means that $A$ is a monotonically increasing class, then $bb(P)\\(A_n\\)arrow.t bb(P)\\(A\\)$ and the same is true for $A_n arrow.b A$.\n\nUnder countable subadditivity, the probability measure of the union of sets is less than or equal to the sum of the probability measures of those sets. That makes sense intuitively because it would be equal if the sets were disjoint, but the sets might overlap, making it less. We can use the above properties to extend this idea to countably infinite sets.\n\nA #strong[null set] is a set with probability measure 0. $nothing$ is the obvious example, and in infinite sets there may be others like the probability measure of a singleton set in the Borel $sigma$-algebra.\n\n===== Conditional Probability\n<conditional-probability>\n\"In some cases the probability of an event happening depends not just on the experiment itself but on other information as well. #strong[Conditional probability] forms a framework in which this additional information can be incorporated.\"\n\n$bb(P)\\(A\\|B\\)= frac(bb(P)\\(A inter B\\), bb(P)\\(B\\))$\n\nObviously, the probability measure of $B$ cannot be 0, which makes sense because in order for something to be conditioned, the condition has to have happened, which is not possible if the probability is 0.\n\nWe can get the #strong[multiplicative rule] from this formula.\n\n$bb(P)\\(A inter B\\)= bb(P)\\(A\\|B\\)bb(P)\\(B\\)\\,$\n\n$bb(P)\\(A inter B inter C\\)= bb(P)\\(A\\|B inter C\\)bb(P)\\(B\\|C\\)bb(P)\\(C\\)$, etc.\n\nLet's take an example. We have Urn 1 which contains 2 black balls and 3 white balls, and Urn 2 which contains 1 of each. One urn is chosen at random and one ball is chosen randomly from that urn. If a black ball is chosen, what is the probability it came from Urn 1?\n\nLet's assign our variables.\n\n$A$ is the event of choosing Urn 1, and $B$ is the event of choosing a black ball. We're trying to find $P\\(A\\|B\\)$, so we need $P\\(A inter B\\)$. There are four total events in our sample space: { Urn1Black, Urn1White, Urn2Black, Urn2White }. The probability of Urn1Black is $0.5 times 0.4 = 0.2$. The probability of choosing a black ball is $0.5$ in the case of Urn 2 and $0.4$ in the case of Urn 1, which averages to $0.45$. So the overall probability is $0.2\\/0.45$, which is $4\\/9$.\n\nThe #strong[total probability formula] given $A_n$ partition of $Omega$ is\n\n$bb(P)\\(B\\)= sum_(i = 1)^n bb(P)\\(B\\|A_i\\)bb(P)\\(A_i\\)$\n\nfor any event $B in cal(F)$.\n\nIf Stanley wants to draw a card from 20, where 8 are favorable to him, what is the probability of him drawing a favorable card if he draws first, second, or third?\n\nFirst is easy. $8\\/20 = 0.4$\n\nFor second, there are two different possibilities. Either the first draw was a favorable or unfavorable card. Let's use the formula above.\n\n$B$ is the event of Stanley drawing a favorable card. There are two $A$ events in consideration, which are the first card being favorable and unfavorable. $bb(P)\\(A_1\\)= 2\\/5$ and $bb(P)\\(A_2\\)= 3\\/5$. If a favorable card was drawn first, then the new probability is $7\\/19$. Otherwise, it's $8\\/19$. So the complete formula becomes\n\n$bb(P)\\(B\\)= 2\\/5 times 7\\/19 + 3\\/5 times 8\\/19 = 0.4$\n\nIt's clear that the same situation would arise if he drew the third card.\n\n#strong[Bayes' formula] is the following (like the others it's based on a partition $A$ and arbitrary set $B in cal(F)$):\n\n$bb(P)\\(A_j\\|B\\)= frac(bb(P)\\(B\\|A_j\\)bb(P)\\(A_j\\), sum_(i = 1)^n bb(P)\\(B\\|A_i\\)bb(P)\\(A_i\\))$\n\n\"This theorem can be interpreted as: All of a sudden we find out $B$ happened. In the light of this new information there should be a simple way to update all the probabilities of the sets in the partition $\\(bb(P)\\(A_j\\|B\\)\\)$. Indeed, the Bayes rule provides just that.\"\n\nSo you take the existing $A$, and then condition it on $B$, and then the calculation cascades across the events in the sample space i.e.~$A$.\n\n===== Independence\n<independence>\nTwo events $A$ and $B$ are defined as #strong[independent] if\n\n$bb(P)\\(A inter B\\)= bb(P)\\(A\\)bb(P)\\(B\\)$\n\nwhich can be extended to the idea of being #strong[mutually independent] (or simply independent) for a set of events:\n\n$bb(P) (union.big_(j in J) A_j) = product_(j in J) bb(P)\\(A_j\\)$\n\nThere's also the idea of #strong[jointly independent] (or pairwise independent):\n\n$bb(P)\\(A_i union A_j\\)= bb(P)\\(A_i\\)bb(P)\\(A_j\\)$\n\nwhich does not necessarily imply independence.\n\nFor two $sigma$-algebras $G$ and $H$, they are $bb(P)$-independent if\n\n$bb(P)\\(G union H\\)= bb(P)\\(G\\)bb(P)\\(H\\)$\n\nand the same applies for mutual independence as with events.\n\nWe can also show that if all $sigma$-algebras in a family are each generated from a collection of independent sets, they are independent. This independence is also associative. There's an additional property of \"disassociativity of the independence\", where independent families included in bigger independent families remain independent.\n\n$sigma$-algebras generated by events are related in their independence.","dataUrl":"https://sharifhsn.dev/api/posts/probability-measures-and-bayes-rule.json","date":"2024-09-09","datePublished":"2024-09-09","description":"We have already considered the measurable space ( Ω , ℱ︀ ) of the sample space and 𝜎 -algebra. We can now define the probability measure ℙ as a measure defined on events in the 𝜎…","site":"https://sharifhsn.dev","slug":"probability-measures-and-bayes-rule","source":"FE-540 | Probability Theory","sourceUrl":null,"tags":["Probability Theory","Conditional Probability","Bayes Rule"],"title":"Probability Measures and Bayes' Rule","url":"https://sharifhsn.dev/blog/probability-measures-and-bayes-rule/","version":"1","wordCount":2067}