Probability and Stochastic Processes
An Introduction
Prerequisites for the course:
Set Theory
Definitions:[Set]
A set is a collection (possibly empty) of distinct objects. Note that the order that the elements of the set does not matter.
Definition:[Empty Set]
The empty set, or null set, is a set which does not contain any elements. We denote the empty set .
Definition:
We say that is a subset of
if all elements of
are also elements of
. We denote a subset by
.
Definition:[Super Set]
If we then say that
is a super set of
, that is
is a set which contains
. We denote a super set as
.
Example:
If and
then we have that
\begin{itemize}
\item
\item
\end{itemize}
which one we use depends on the application we are working with.
Definition:[Power Set]
For a set , the power set of
, denoted
, is the collection of all subsets of
.
Definition:[Set Equality]
We say that and
are equal if
and
. That is both
and
have all of the same elements.
Definition:[Intersection]
A set is the intersection of two sets if it contains all elements that are shared between both sets. That is
Example:
If then
Example:
If then
Definition: A set is said to be the union of two sets if it contains elements that occur in either of the sets (or both). We denote it by and it is defined to be
Definition:
A set is called the complement of an set, , if it contains all of the points that are not in
and none of the points that are in
. We denote the complement by
and define it to be
Note that when we take the complement of a set it is in regards to another superset.
Definition:{Difference} – An event is called the difference of two events and
if it occurs whenever
occurs but
does not. We denote the set difference by
We have that
and
. In mathematical terms
Definition:
We say that two sets, , are mutually exclusive if
.
Example:
If is the set of all odd numbers and
is the set of all even numbers then
and so
and
are mutually exclusive.
Set Operation Properties
(1)
Definition:{Commutative Laws:}
(2)
Definition:{Associative Laws:}
(3)
Definition:{Distributive Laws:}
(4)
Definition:{De Morgan’s First Law:}
(5)
Definition:{De Morgan’s Second Law:}
(6)