CS63 Artificial Intelligence


Week 7: Journal Questions

Answer the following question for Monday's reading on the introduction to MDPs

  1. Markov Decision Processes (or MDPs) assume that all states and actions are discrete, like other problems we looked at previously including the sliding block and traffic jam puzzles. How are the problems that MDPs model different from these simple problems?
  2. Briefly describe a situation where you skipped an immediate reward in order to achieve a better, future gain.