You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: lectures/likelihood_ratio_process.md
+12-12Lines changed: 12 additions & 12 deletions
Original file line number
Diff line number
Diff line change
@@ -36,7 +36,7 @@ Among things that we'll learn are
36
36
* A peculiar property of likelihood ratio processes
37
37
* How a likelihood ratio process is a key ingredient in frequentist hypothesis testing
38
38
* How a **receiver operator characteristic curve** summarizes information about a false alarm probability and power in frequentist hypothesis testing
39
-
* How during World War II the United States Navy devised a decision rule that Captain Garret L. Schyler challenged and asked Milton Friedman to justify to him, a topic to be studied in {doc}`this lecture <wald_friedman>`
39
+
* How during World War II the United States Navy devised a decision rule that Captain Garret L. Schyler challenged, a topic to be studied in {doc}`this lecture <wald_friedman>`
40
40
41
41
42
42
Let's start by importing some Python tools.
@@ -64,18 +64,16 @@ that $q$ is either $f$ or $g$, permanently.
64
64
65
65
Nature knows which density it permanently draws from, but we the observers do not.
66
66
67
-
We do know both $f$ and $g$ but we don’t know which density nature
67
+
We know both $f$ and $g$ but we don’t know which density nature
68
68
chose.
69
69
70
70
But we want to know.
71
71
72
72
To do that, we use observations.
73
73
74
-
We observe a sequence $\{w_t\}_{t=1}^T$ of $T$ IID draws
75
-
from either $f$ or $g$.
74
+
We observe a sequence $\{w_t\}_{t=1}^T$ of $T$ IID draws that we know came from either $f$ or $g$.
76
75
77
-
We want to use these observations to infer whether nature chose $f$ or
78
-
$g$.
76
+
We want to use these observations to infer whether nature chose $f$ or $g$.
79
77
80
78
A **likelihood ratio process** is a useful tool for this task.
81
79
@@ -90,7 +88,7 @@ same intervals of possible realizations of the random variable $W$.
90
88
91
89
That means that under the $g$ density, $\ell (w_t)=
92
90
\frac{f\left(w_{t}\right)}{g\left(w_{t}\right)}$
93
-
is evidently a nonnegative random variable with mean $1$.
91
+
is a nonnegative random variable with mean $1$.
94
92
95
93
A **likelihood ratio process** for sequence
96
94
$\left\{ w_{t}\right\}_{t=1}^{\infty}$ is defined as
@@ -237,7 +235,7 @@ How can $E\left[L\left(w^{t}\right)\bigm|q=g\right]=1$ possibly be true when mos
237
235
ratio process is piling up near $0$ as
238
236
$t \rightarrow + \infty$?
239
237
240
-
The answer has to be that as $t \rightarrow + \infty$, the
238
+
The answer is that as $t \rightarrow + \infty$, the
241
239
distribution of $L_t$ becomes more and more fat-tailed:
242
240
enough mass shifts to larger and larger values of $L_t$ to make
243
241
the mean of $L_t$ continue to be one despite most of the probability mass piling up
@@ -442,9 +440,11 @@ for i, t in enumerate([1, 7, 14, 21]):
442
440
plt.show()
443
441
```
444
442
445
-
The graph below shows more clearly that, when we hold the threshold
446
-
$c$ fixed, the probability of detection monotonically increases with increases in
447
-
$t$ and that the probability of a false alarm monotonically decreases.
443
+
444
+
When we hold $c$ fixed at $c=1$, the following graph shows that
445
+
* the probability of detection monotonically increases with increases in
446
+
$t$
447
+
* the probability of a false alarm monotonically decreases with increases in $t$.
448
448
449
449
```{code-cell} python3
450
450
PD = np.empty(T)
@@ -468,7 +468,7 @@ of both types of error.
468
468
If for a fixed $t$ we now free up and move $c$, we will sweep out the probability
469
469
of detection as a function of the probability of false alarm.
470
470
471
-
This produces what is called a [receiver operating characteristic
471
+
This produces a [receiver operating characteristic
0 commit comments