Skip to content

Commit a4ed05c

Browse files
Tom's edit of another lecture May 7
1 parent f0bfd5a commit a4ed05c

File tree

1 file changed

+12
-12
lines changed

1 file changed

+12
-12
lines changed

lectures/likelihood_ratio_process.md

Lines changed: 12 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -36,7 +36,7 @@ Among things that we'll learn are
3636
* A peculiar property of likelihood ratio processes
3737
* How a likelihood ratio process is a key ingredient in frequentist hypothesis testing
3838
* How a **receiver operator characteristic curve** summarizes information about a false alarm probability and power in frequentist hypothesis testing
39-
* How during World War II the United States Navy devised a decision rule that Captain Garret L. Schyler challenged and asked Milton Friedman to justify to him, a topic to be studied in {doc}`this lecture <wald_friedman>`
39+
* How during World War II the United States Navy devised a decision rule that Captain Garret L. Schyler challenged, a topic to be studied in {doc}`this lecture <wald_friedman>`
4040

4141

4242
Let's start by importing some Python tools.
@@ -64,18 +64,16 @@ that $q$ is either $f$ or $g$, permanently.
6464

6565
Nature knows which density it permanently draws from, but we the observers do not.
6666

67-
We do know both $f$ and $g$ but we don’t know which density nature
67+
We know both $f$ and $g$ but we don’t know which density nature
6868
chose.
6969

7070
But we want to know.
7171

7272
To do that, we use observations.
7373

74-
We observe a sequence $\{w_t\}_{t=1}^T$ of $T$ IID draws
75-
from either $f$ or $g$.
74+
We observe a sequence $\{w_t\}_{t=1}^T$ of $T$ IID draws that we know came from either $f$ or $g$.
7675

77-
We want to use these observations to infer whether nature chose $f$ or
78-
$g$.
76+
We want to use these observations to infer whether nature chose $f$ or $g$.
7977

8078
A **likelihood ratio process** is a useful tool for this task.
8179

@@ -90,7 +88,7 @@ same intervals of possible realizations of the random variable $W$.
9088

9189
That means that under the $g$ density, $\ell (w_t)=
9290
\frac{f\left(w_{t}\right)}{g\left(w_{t}\right)}$
93-
is evidently a nonnegative random variable with mean $1$.
91+
is a nonnegative random variable with mean $1$.
9492

9593
A **likelihood ratio process** for sequence
9694
$\left\{ w_{t}\right\} _{t=1}^{\infty}$ is defined as
@@ -237,7 +235,7 @@ How can $E\left[L\left(w^{t}\right)\bigm|q=g\right]=1$ possibly be true when mos
237235
ratio process is piling up near $0$ as
238236
$t \rightarrow + \infty$?
239237

240-
The answer has to be that as $t \rightarrow + \infty$, the
238+
The answer is that as $t \rightarrow + \infty$, the
241239
distribution of $L_t$ becomes more and more fat-tailed:
242240
enough mass shifts to larger and larger values of $L_t$ to make
243241
the mean of $L_t$ continue to be one despite most of the probability mass piling up
@@ -442,9 +440,11 @@ for i, t in enumerate([1, 7, 14, 21]):
442440
plt.show()
443441
```
444442

445-
The graph below shows more clearly that, when we hold the threshold
446-
$c$ fixed, the probability of detection monotonically increases with increases in
447-
$t$ and that the probability of a false alarm monotonically decreases.
443+
444+
When we hold $c$ fixed at $c=1$, the following graph shows that
445+
* the probability of detection monotonically increases with increases in
446+
$t$
447+
* the probability of a false alarm monotonically decreases with increases in $t$.
448448

449449
```{code-cell} python3
450450
PD = np.empty(T)
@@ -468,7 +468,7 @@ of both types of error.
468468
If for a fixed $t$ we now free up and move $c$, we will sweep out the probability
469469
of detection as a function of the probability of false alarm.
470470

471-
This produces what is called a [receiver operating characteristic
471+
This produces a [receiver operating characteristic
472472
curve](https://en.wikipedia.org/wiki/Receiver_operating_characteristic).
473473

474474
Below, we plot receiver operating characteristic curves for different

0 commit comments

Comments
 (0)