Analysis and optimization of controlled stochastic systems. Models: linear and nonlinear stochastic controlled systems, controlled Markov chains. Optimization of systems described by Markov processes; dynamic programming under perfect and imperfect information, fi nite and infi nite horizons. System identifi cation: off-line, recursive. Stochastic adaptive control: Markov chains, self-tuning regulators, bandit problems.