A sequential adaptive sampling technique based on a local linear model for computer experiment applications
Abstract
The objective of this dissertation research is to develop a model independent sequential adaptive sampling technique for surrogate model (SM) applications based on a local linear model. This technique, called Nearest Neighbors Adaptive Sampling (NNAS), is conceived to be conceptually simple, computationally robust, and easy to apply, all characteristics that are crucial for effective surrogate modeling application during early phases of the engineering design process. SMs are now regarded as powerful engineering tools for the approximation of expensive responses — obtained either from computer simulations or real experiments — via less computationally expensive mathematical models. The use of SMs is especially valuable during the preliminary design phase when engineers need fast and accurate tools to assess the performance of different configurations and to define the top-level specifications that will guide the entire design process. Due to the increasing importance of SMs, new strategies are continuously being devised to build more flexible SM formulations, to rigorously select an SM technique from a set of candidates, and to efficiently sample the design space to collect the data required to train an SM. The considerable influence of the sample distribution on SM accuracy motivates efforts to develop advanced strategies to improve for the sampling process. In particular, the adoption of sequential adaptive sampling techniques has been empirically shown to reduce the number of samples required to obtain an SM of specified accuracy. However, these techniques are typically challenging to implement, limited by assumptions about the response, and dependent on the SM formulation selected to supervise the sampling process (e.g. cross validation and Kriging based strategies), making them impracticable for most engineering design applications. In particular, model dependence — a common characteristic of most state-of-the-art adaptive sequential sampling techniques — may decrease the sampling efficiency if the guiding SM is inappropriately chosen. The proposed NNAS technique avoids the limitations of model dependence by introducing a new refinement metric — the Non Linearity Index (NLI) — which estimates the local nonlinear characteristics as the difference between the actual response value and the local function approximation represented by the hyperplane obtained via weighted least squares regression of the closest D+k neighbors, where D is the domain dimensionality. The use of local linear models to assess the nonlinear characteristics of the response without the need for a global SM is the key characteristic of NNAS that makes this strategy model independent. Additionally, NNAS introduces a new stochastic Pareto-ranking-based selection criterion to simultaneously maximize the refinement and exploration of the design space search, thereby ensuring a balance between the two behaviors. The initial NNAS and NLI formulations have also been expanded to include a form of directional sampling in which the algorithm identifies both region and direction of sampling. NNAS embodies the capabilities of sampling multi-response design spaces, working in batch-mode (i.e. adding more than one sample at time), and continuing the sampling process even in the event of a critical error in the function evaluation, e.g. the lack of convergence of a computational model at points in the design space.
These characteristics together with its ease of implementation make NNAS a valuable, efficient and robust sampling strategy to use during the early phases of engineering design. A comprehensive set of test cases from low to high complexity and from low to high dimensionality is used to compare the performance of the proposed technique with that of other state-of-the-art sampling strategies, specifically a standard Latin hypercube design, a model dependent technique, and a model independent strategy. Results show the sampling effectiveness and the reduced computational cost of NNAS even in multi-response applications or in situations of function evaluation failure.
Collections
Related items
Showing items related by title, author, creator and subject.
-
Ion Source And Sample Introduction Method And Apparatus Using Two Stage Ionization For Producing Sample Gas Ions
Eisele, Fred L.; Berresheim, Harald (6/8/1993)A high pressure interface device for introducing sample ions to a drift tube, an ion detection means or a mass mobility measurement means, having an ion source ionization region containing an isolated ionization source, a ... -
Challenges for the Heatshield Development of Sample Return Missions - An Overview on European Sample Return Studies and Requirements
Santovincenzo, A.; Ritter, Heiko; Walpot, L. (Georgia Institute of Technology, 2008-06-26)The atmospheric entry of the Earth return capsule of sample return mission is one of the most critical phases of sample return missions. The Earth return from extraterrestrial bodies (e.g. Mars, comets or asteroids) involves ... -
Summary report on sampling methods, sampling procedures, and a method for dirt analysis. Project 1850-8, final report to Jute Research Group
Institute of Paper Chemistry (Appleton, Wis.); Institute of Paper Chemistry (Appleton, Wis.) Jute Research Group. (Appleton, Wisconsin : the Institute,Georgia Institute of Technology, 1955-11-01)