RL 001
· 2 min read
Reinforcement Learning
- Learn how to make a good sequence of decisions by interacting with the environment.
Characteristics of RL
- Trial and Error: Based learning approach.
- Optimization: Find good sequences of actions or decisions.
- Delayed Consequences/Rewards: Takes time to relize the actions or decisions are good or bad.
- Exploration: Learn by making decisions or forming actions or through experiences. Trying new actions to discover their effects.
- Exploitation: Choosing actions with the highest expected reward, based on current knowledge.
- Generalization: Use previous experiences or knowledge to new or unseen situations effectively.
Framwork of RL
- OpenAI Gym
- Torch RL
- AWS DeepRacer
RL Math
Probability
Bonferroni's Inequality
- Gives a lower bound on the intersection probability which is useful when this probability is difficult to compute directly.
- It is useful when the probabilities of individual events are sufficiently large.
Boole's Inequality
for any sets .
- It is useful when finding an upper bound for the probabilities of the union of events.
Bayes' Rule
- It allows us to compute the conditional probability from the inverse conditional probability .
- Let be a partition of the sample space . Then let be any subset of we have:
Independent Events
-
A family of events is independent if for every finite subset we have:
-
The pair-wise independence of events does not imply their mutual independence.
Conditional Independence
- where .
- or equivalently, and .