Course detail
Optimization Methods II
FSI-VPP-A Acad. year: 2026/2027 Winter semester
The course deals with the following topics: Dynamic programming and optimal control of stochastic processes. Bellman optimality principle as a tool for optimization of multistage processes with a general nonlinear criterion function. Optimum decision policy. Computational aspects of dynamic programming in discrete time. Hidden Markov models and the Viterbi algorithm. Algorithms for shortest paths in graphs. Multicriteria control problems. Deterministic optimal control in continuous time, Hamilton-Jacobi-Bellman equation, Pontryagin maximum principle. LQR and Kalman filter. Process scheduling and planning. Problems with infinitely many stages. Approximate dynamic programming. Heuristic methods for complex problems. Applications of the methods in solving practical problems.
Language of instruction
English
Number of ECTS credits
7
Supervisor
Department
Entry knowledge
Knowledge of the basics of programming, mathematical analysis, algebra, theory of sets, statistics and probability.
Rules for evaluation and completion of the course
Course-unit credit: Active participation in the seminars, elaboration of a given project. Examination: Written and oral.
Attendance at seminars is required. An absence can be compensated for via solving additional problems.
Aims
The aim of the course is to inform the students about creations and applications of mathematical methods for optimal control of technological and economic processes e.g. in the automation of mechanical systems, in the management of production in mechanical engineering, in project management and in optimization of information systems, using contemporary tools of computer science.
Knowledge: Students will know basic principles and algorithms of methods applicable to the optimization of the deterministic and stochastic, discrete and continuous. They will be made familiar with basic principles and algorithms of methods that are appropriate to creation of decision-support systems for project management, as the tool for the identification, selection and realization of projects. Skills: Students will be able to apply the above methods to the solution of the practical problems from economic decision, problems of increasing the reliability of technological devices, problems of automation control of technological processes and problems of project management, by using contemporary tools of computer science.
The study programmes with the given course
Programme N-AIŘ-P: Applied Computer Science and Control, Master's, compulsory
Type of course unit
Lecture
39 hours, optionally
Syllabus
1. Basics of mathematical processes theory. Bellman optimality principle and dynamic programming.
2. Deterministic finite-state problems. Forward DP algorithm.
3. Hidden Markov models and the Viterbi algorithm.
4. Algorithms for shortest paths in a graph.
5. Multicriteria and constrained optimal control problems.
6. LQR a Kalman filter. Problems without perfect state information.
7. Problems with an infinite number of stages.
8. Deterministic continuous-time optimal control, Hamilton-Jacobi-Bellman equation, Pontryagin maximum principle.
9. Heuristics for complex problems I – evolution strategies.
10. Heuristics for complex problems II – genetic algorithms and ant colony optimization.
11. Approximate dynamic programming.
12. Rolling horizon and Model predictive control.
13. Process scheduling.
Computer-assisted exercise
26 hours, compulsory
Syllabus
Implementation and analysis of the following problems:
1. – 3. Basic dynamic programming problems.
4. Problems with time delays.
5. Viterbi algorithm for decoding convolutional codes.
6. Shortest path problems.
7. Multiobjective problems.
8. LQR.
9. Infinite horizon problems.
10. Continuous-time problems.
11. Evolution strategies for weighted MAX-SAT.
12. Genetic algorithms and ant colony optimization for TSP.
13. Process scheduling problems.