Response Surface Methodology for Optimizing Hyper Parameters
Loading...
Date
2006-02-27T14:09:32Z
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
The performance of an algorithm often largely depends on some hyper parameter which should be optimized before its usage. Since most conventional optimization methods suffer from some drawbacks, we developed an alternative way to find the best hyper parameter values. Contrary to the well known procedures, the new optimization algorithm is based on statistical methods since it uses a combination of Linear Mixed Effect Models and Response Surface Methodology techniques. In particular, the Method of Steepest Ascent which is well known for the case of an Ordinary Least Squares setting and
a linear response surface has been generalized to be applicable for repeated measurements situations and for response
surfaces of order o <= 2.
Description
Table of contents
Keywords
Deterministic error terms, Method of Steepest Ascent, Random Intercepts Model, Repeated measurements, Support Vector Machine