[an error occurred while processing this directive]


Kungl Tekniska högskolan / Optimeringslära och systemteori /

[an error occurred while processing this directive]This is a printer-friendly version of (none)



SF1811 Optimization for F / Optimeringslära för F 2009

Course home page adress: http://www.math.kth.se/optsyst/studinfo/kurser/SF1811/.

Instructor:

Per Enqvist,
email: penqvist@math.kth.se ,
office nr. 3725, Lindstedtsv 25,
phone nr. +46 (0)8 790 62 98
The lectures will be held in english.

Teaching assistants:

David Anisi,
email: anisi@math.kth.se,
office nr. 3727,
phone nr. +46 (0)8 790 66 60.

Maja Karasalo,
email: karasalo@math.kth.se,
office nr. 3738,
phone nr. +46 (0)8 790 71 32.

Study material:

  • Book: Linear and Nonlinear Programming, second edition, by Griva, Nash och Sofer.
    It is encouraged to buy the new improved book, especially since the same book is also used in the continuation courses SF2812 and SF2822. Information on how to import it from USA is available on the home page. If you find it too complicated, the print-outs from the student office works too.

The following material can be bought at the student office at the math. department, Lindstedtsvägen 25.

  • Print-outs from selected parts of the old book, first version of Nash and Sofer are sold.

  • Compendium: Quadratic optimization.

  • Compendium: Exercises in SF1841.

Further material will be available on the homepage.

What is optimization?

Optimization theory deals with finding the "best" solution in a set of feasible solutions. The solutions are represented by variables and the feasible solutions are characterized by constraints on the variables. What is "best" is quantified by an objective function that for each feasible solution determines a number (ranking), e.g., the total amount of traffic that passes through a network. The problem to maximize a general objective function over a general feasible set is difficult. In this course we concentrate on optimization problems with continuous variables, where the objective function is linear, quadratic or (convex) non-linear, and the constraints are linear or (convex) non-linear. This theoretical framework has found numerous applications in many differents areas, such as crew-scheduling for airplane personel, radiation therapy planning for cancer patients, risk management for portfolios, internet traffic control and structural optimization for mechanism design.

Aim

The overall purpose of the course is that the student should get well acquainted with basic concepts, theory, models and solution methods for optimization. Furthermore, the student should get basic skills in modelling and computer based solving of various applied optimization problems. To pass the course, the student should attain most of the following aims:

  • Explain basic concepts and theory for optimization, in particular the modelling concept variables-objective-constraints and some basic theoretical properties of convex optimization problems, and decide whether a given problem is convex or not.

  • Apply and analyze the algorithms considered in the course. This ability can, e.g., be demonstrated by solving (small) problems with pen and paper.

  • Analyze potential optimal solutions to nonlinear constrained problems.

    • State relevant optimality conditions and use these to decide whether a given feasible solution to a given convex problem with constraints is an optimal solution or not.

    • Calculate all the solutions to the Karush-Kuhn-Tucker optimality conditions of a given (not so complex but possibly nonconvex) problem with nonlinear objective- and constraint functions, and decide whether any of these is a global optimal solution.

  • Explain the concept Lagrangian relaxation, and use this tool for solving separable convex optimization problems.

  • Use linear algebra, in particular fundamental subspaces and factorizations, to, e.g., describe the feasible sets of linearly constrained programs.

  • Formulate optimization problems on a tractable mathematical form, solve them using your own or commercial software, and then evaluate and present the result in a written or oral format.


Syllabus

Examples of applications and modelling training. Basic concepts and theory for optimization, in particular theory for convex problems. Some linear algebra in R^n, in particular bases for the four fundamental subspaces corresponding to a given matrix. Linear optimization. Simplex algorithm. Duality theory. Optimization of flows in networks, especially minimum cost network flows. Quadratic optimization with equality-constraints. Linear least squares problems, in particular minimum norm solutions. Unconstrained nonlinear optimization, in particular nonlinear least squares problems. Optimality conditions for constrained nonlinear optimization. Lagrangian relaxation.

Schedule for the classes

Nr 

Date  

Time 

Place 

Type

Content 

L1. 

Mon 19/1 

15-17 

D2 

Lecture

Introduction. Linear Programming (LP). 

L2. 

Tue 20/1 

10-12 

B2 

Lecture

The simplex method for LP-problems. 

E1. 

Wed 21/1 

13-15 

D31,D34 

Exercise

LP-formulations. Simplex method. 

L3. 

Mon 26/1 

15-17 

D2 

Lecture

Duality theory for LP. 

L4. 

Tue 27/1 

10-12 

B2 

Lecture

Linear subspaces. 

E2. 

Wed 28/1 

13-15 

D31,D34 

Exercise

Duality and complementarity for LP  

L5. 

Mon 2/2 

15-17 

D2 

Lecture

Optimization of network flows. 

L6. 

Tue 3/2 

10-12 

B2 

Lecture

Transportation Problems, Degeneracy. 

E3. 

Wed 4/2 

13-15 

D31,D34 

Exercise

Optimization of network flows. 

L7. 

Mon 9/2 

15-17 

D2 

Lecture

Quadratic Programming and Convexity. 

L8. 

Tue 10/2 

10-12 

B2 

Lecture

QP and linear least squares. 

E4. 

Wed 11/2 

13-15 

D31,D34 

Exercise

QP with equality constraints. 

L9. 

Mon 16/2 

15-17 

D2 

Lecture

Nonlinear programs - no constraints  

L10. 

Tue 17/2 

10-12 

B2 

Lecture

Newtons method, nonlinear LSQ. 

E5. 

Wed 18/2 

15-17 

D31,E31 

Exercise

Optimality conditions, convexity  

L11. 

Mon 23/2 

15-17 

D2 

Lecture

Lagrange relaxation and duality. 

L12. 

Tue 24/2 

10-12 

B2 

Lecture

NLP with equality constraints.  

E6. 

Wed 25/2 

13-15 

D31,D34 

Exercise

NLP without constraints, Newton, Lagrange duality  

L13. 

Mon 2/3 

15-17 

D2 

Lecture

NLP with equality/inequality constraints, KKT. 

L14. 

Tue 3/3 

10-12 

B2 

Lecture

NLP with inequality constraints, KKT. 

E7. 

Wed 4/3 

13-15 

D31,D34 

Exercise

NLP with constraints, KKT. 

E8. 

Thu 5/3 

10-12 

D31,D34 

Exercise

NLP with constraints, KKT. 

Examination

Home assignments:

There will be two voluntary home assignments and a poster session. These assignments are usually appreciated by the students and the aim is to provide an opportunity for deeper understanding of the subject. The exercises will be solved using a computer and the optimization toolbox in Matlab. The results of the home assignment should be presented in a brief written report, and some randomly chosen groups will also present their work in class. The poster session will be used to present an open-ended formulation problem assignment.
The first written home assignment should be handed in at the beginning of the exercise class February 4, and oral presentations will also be given during this class. For the second home assignment, the deadline is March 4. The poster session will be held Febraury 18.
All of this may grant up to a total of 5 (2+2+1) bonus points on the final exam. These bonus points will be valid for both of the exams held for this course during 2009. More information will be posted on the home page.

Written examination (TEN1, 6hp):

The examination is scheduled at saturday March 14, 2009, at the time 08.00-13.00. The only other scheduled examination occasion this year is monday June 8, 2009, at the time 14.00-19.00.
The maximal number of points on the exam is 55, including the 5 bonus point that can be obtained from the home assignments. Preliminary grading:
44-55 points for an A, 38-43 points for a B, 33-37 points for a C,
28-32 points for a D, 25-27 points for an E, 23-24 points for Fx.
A short table of equations is handed out at the exam and is the only aid allowed.

An Fx grade may be converted to an E grade by a successful completion of further written and oral tests. This process has to be completed within three weeks of the date of notification of grades, so please contact the instructor asap by email.

Welcome to the course!