ENGI 3423 Probability and Statistics

Extension of Bayes’ Theorem to a Pair of Tests


Suppose that an input signal is one of the mutually exclusive and collectively exhaustive set of signals { A1, A2, A3, ... , An } and that a test is available to determine which signal was input.   However, the test is not perfect.   It is possible that the test will claim that a signal other than the true one was input.   The same test is applied twice to the same input signal.

Let   Bj   represent the claim from the first application of the test and
let   Ck   represent the claim from the second application of the test.

The probabilities   P[Ai],   P[Bj | Ai ]   and   P[Ck | Ai Bj ]   are all known.
Furthermore, we can assume that the results of the two tests are independent of each other, so that
P[Ck | Ai Bj ] = P[Ck | Ai ]   and we can also assume that the two tests are identical, so that
P[Cj | Ai ] = P[Bj | Ai ].

Then after the first application of the test, Bayes’ theorem tells us that

P[Ai|Bj] = P[Bj|Ai]*P[Ai] / Sum_r {P[Bj|Ar]*P[Ar]}

Extended to the pair of tests, this becomes (see the proof below)

P[Ai|BjCk] = P[Ck|AiBj]*P[Ai|Bj] / Sum_r {P[Ck|ArBj]*P[Ar|Bj]}

But, because the tests are independent and identical (and therefore exchangeable),

P[Ai|BjCk] = P[Bk|Ai]*P[Ai|Bj] / Sum_r {P[Bk|Ar]*P[Ar|Bj]}

which is the same as the single test result, except that the posterior probabilities from the first test
{ P[ Ai | Bj] } replace { P[ Ai ] } as the prior probabilities in the second test.

An application of this result to a system of three signals, { A1, A2, A3 } and a pair of tests is provided in an associated Excel file.


Proof:

P[Ai|BjCk] = P[AiBjCk]/P[BjCk]
    = P[Ck|AiBj]*P[AiBj] / Sum_r{P[CkArBj]}

= P[Ck|AiBj]*P[Ai|Bj]*P[Bj] / Sum_r{P[Ck|ArBj]*P[ArBj]}

= P[Ck|AiBj]*P[Ai|Bj]*P[Bj] / Sum_r{P[Ck|ArBj]*P[Ar|Bj]*P[Bj]}

= P[Ck|AiBj]*P[Ai|Bj]*P[Bj] / (Sum_r{P[Ck|ArBj]*P[Ar|Bj]}*P[Bj])

= P[Ck|AiBj]*P[Ai|Bj] / Sum_r{P[Ck|ArBj]*P[Ar|Bj]}


    Return to the Index of Demonstration Files   [Return to the Index of Demonstration Files.]
    Back to previous page   [Return to your previous page]

Created 1999 10 06 and most recently modified 2007 07 05 by Dr. G.H. George