Table of Contents

  1. Bandits: A new beginning
  2. Finite-armed stochastic bandits: Warming up
  3. First steps: Explore-then-Commit
  4. The Upper Confidence Bound (UCB) Algorithm
  5. Optimality concepts and information theory
  6. More information theory and minimax lower bounds
  7. Instance dependent lower bounds
  8. Adversarial bandits
  9. High probability lower bounds
  10. Contextual bandits, prediction with expert advice and Exp4
  11. Stochastic Linear Bandits and UCB
  12. Ellipsoidal confidence sets for least-squares estimators
  13. Sparse linear bandits
  14. Lower bounds for stochastic linear bandits
  15. Adversarial linear bandits
  16. Adversarial linear bandits and the curious case of linear bandits on the unit ball
  17. First order bounds for k-armed adversarial bandits
  18. The variance of Exp3
  19. Bayesian/minimax duality for adversarial bandits

3 thoughts on “Table of Contents”

    1. The new posts depend on background from the previous posts, which we refer to occasionally. We’re now a little more lax and sometimes also refer to the book. The TOC should be updated from now on though.

Leave a Reply

Your email address will not be published. Required fields are marked *