Research Article
A Framework for Optimization under Limited Information
@INPROCEEDINGS{10.4108/icst.valuetools.2011.245775, author={Tansu Alpcan}, title={A Framework for Optimization under Limited Information}, proceedings={5th International ICST Conference on Performance Evaluation Methodologies and Tools}, publisher={ICST}, proceedings_a={VALUETOOLS}, year={2012}, month={6}, keywords={Optimization information theory learning multi-objective optimization decision making under limited information}, doi={10.4108/icst.valuetools.2011.245775} }
- Tansu Alpcan
Year: 2012
A Framework for Optimization under Limited Information
VALUETOOLS
ICST
DOI: 10.4108/icst.valuetools.2011.245775
Abstract
In many real world problems, optimization decisions have to be made often with limited information. The decision maker may have no a priori data about the (nonconvex) objective function except from on a limited number of points that are obtained over time through costly observations. This paper presents an optimization framework that takes into account the information collection (observation), estimation (regression), and optimization (maximization) aspects in a holistic and structured manner. Explicitly quantifying the information acquired at each optimization step using the entropy measure from information theory, the objective function to be optimized is modeled and estimated by adopting a Bayesian approach, specifically using Gaussian processes as a state-of-the-art regression method. The resulting iterative scheme allows the decision maker to solve the problem by expressing preferences for each aspect quantitatively and concurrently.