Fuzzy clustering based hierarchical metamodeling for design space reduction and optimization (original) (raw)

Fuzzy Clustering Based Hierarchical Metamodeling For Space Reduction and Design Optimization

2004

For computation-intensive design problems, metamodeling techniques are commonly used to reduce the computational expense during optimization; however, they often have difficulty or even fail to model an unknown system in a large design space, especially when the number of available samples is limited. This paper proposes an intuitive method to systematically reduce the design space to a relatively small region. This method entails three main elements: 1) constructing surrogate approximations using either response surface or kriging models to capture unknown systems in the original large space; 2) calculating many inexpensive points from the obtained surrogate model, clustering these points using the Fuzzy c-means clustering method, and choosing an attractive cluster and its corresponding reduced design space; 3) progressively generating sample points to construct kriging models and identify the design optimum within the reduced design space. The proposed method is illustrated using ...

Development of metamodeling based optimization system for high nonlinear engineering problems

A metamodeling optimization system for nonlinear problems was developed in this study. Boundaries and best neighbors searching (BBNS) intelligent sampling method and fuzzy based progressive metamodeling for space reduction were integrated and applied for this system. The BBNS scheme generates new samples derived from information of boundaries and the best samples of initial sparse distributed samples. It is easy to obtain better samples and avoid local convergence due to boundary information. In order to construct accuracy metamodel, the fuzzy based progressive metamodeling method was implemented to cluster samples generated by BBNS several patches in optimization domain. Only better sets of them are involved in construction of metamodels in each patch by response surface and kriging method. The nonlinear problems with multi-humps as test functions were used for proving accuracy and efficiency of developed system. The practical nonlinear engineering problems were also successfully optimized by this system.

Review of metamodeling techniques in support of engineering design optimization

2007

Computation-intensive design problems are becoming increasingly common in manufacturing industries. The computation burden is often caused by expensive analysis and simulation processes in order to reach a comparable level of accuracy as physical testing data. To address such a challenge, approximation or metamodeling techniques are often used. Metamodeling techniques have been developed from many different disciplines including statistics, mathematics, computer science, and various engineering disciplines. The metamodels are initially developed as "surrogates" of the expensive simulation process in order to improve the overall computation efficiency. They are then found to be a valuable tool to support a wide scope of activities in modern engineering design, especially design optimization. This work reviews the state-of-the-art metamodel-based techniques from a practitioner's perspective according to the role of metamodeling in supporting design optimization, including model approximation, design space exploration, problem formulation, and solving various types of optimization problems. Challenges and future development of metamodeling in support of engineering design is also analyzed and discussed.

An optimization algorithm employing multiple metamodels and optimizers

International Journal of Automation and Computing, 2013

Modern engineering design optimization often relies on computer simulations to evaluate candidate designs, a setup which results in expensive black-box optimization problems. Such problems introduce unique challenges, which has motivated the application of metamodel-assisted computational intelligence algorithms to solve them. Such algorithms combine a computational intelligence optimizer which employs a population of candidate solutions, with a metamodel which is a computationally cheaper approximation of the expensive computer simulation. However, although a variety of metamodels and optimizers have been proposed, the optimal types to employ are problem dependant. Therefore, a priori prescribing the type of metamodel and optimizer to be used may degrade its effectiveness. Leveraging on this issue, this study proposes a new computational intelligence algorithm which autonomously adapts the type of the metamodel and optimizer during the search by selecting the most suitable types out of a family of candidates at each stage. Performance analysis using a set of test functions demonstrates the effectiveness of the proposed algorithm, and highlights the merit of the proposed adaptation approach.

A Clustering-Based Surrogate Model Updating Approach to Simulation-Based Engineering Design

Journal of Mechanical Design, 2008

This paper addresses the critical issue of effectiveness and efficiency in simulation-based optimization using surrogate models as predictive models in engineering design. Specifically, it presents a novel clustering-based multilocation search (CMLS) procedure to iteratively improve the fidelity and efficacy of Kriging models in the context of design decisions. The application of this approach will overcome the potential drawback in surrogate-model-based design optimization, namely, the use of surrogate models may result in suboptimal solutions due to the possible smoothing out of the global optimal point if the sampling scheme fails to capture the critical points of interest with enough fidelity or clarity. The paper details how the problem of smoothing out the best (SOB) can remain unsolved in multimodal systems, even if a sequential model updating strategy has been employed, and lead to erroneous outcomes. Alternatively, to overcome the problem of SOB defect, this paper presents the CMLS method that uses a novel clustering-based methodical procedure to screen out distinct potential optimal points for subsequent model validation and updating from a design decision perspective. It is embedded within a genetic algorithm setup to capture the buried, transient, yet inherent data pattern in the design evolution based on the principles of data mining, which are then used to improve the overall performance and effectiveness of surrogate-model-based design optimization. Four illustrative case studies, including a 21 bar truss problem, are detailed to demonstrate the application of the CMLS methodology and the results are discussed.

Exploration of Metamodeling Sampling Criteria for Constrained Global Optimization

Engineering Optimization, 2002

The use of surrogate models or metamodeling has lead to new areas of research in simulation-based design optimization. Metamodeling approaches have advantages over traditional techniques when dealing with the noisy responses and=or high computational cost characteristic of many computer simulations. This paper focuses on a particular algorithm, Efficient Global Optimization (EGO) that uses kriging metamodels. Several infill sampling criteria are reviewed, namely criteria for selecting design points at which the true functions are evaluated. The infill sampling criterion has a strong influence on how efficiently and accurately EGO locates the optimum. Variance-reducing criteria substantially reduce the RMS error of the resulting metamodels, while other criteria influence how locally or globally EGO searches. Criteria that place more emphasis on global searching require more iterations to locate optima and do so less accurately than criteria emphasizing local search.

Comparative studies of metamodelling techniques under multiple modelling criteria

Structural and Multidisciplinary Optimization, 2001

Despite advances in computer capacity, the enormous computational cost of running complex engineering simulations makes it impractical to rely exclusively on simulation for the purpose of design optimization. To cut down the cost, surrogate models, also known as metamodels, are constructed from and then used in place of the actual simulation models. In this paper, we systematically compare four popular metamodelling techniques -polynomial regression, multivariate adaptive regression splines, radial basis functions, and kriging -based on multiple performance criteria using fourteen test problems representing different classes of problems. Our objective in this study is to investigate the advantages and disadvantages of these four metamodelling techniques using multiple criteria and multiple test problems rather than a single measure of merit and a single test problem.

The use of metamodeling techniques for optimization under uncertainty

Structural and Multidisciplinary Optimization, 2003

Metamodeling techniques have been widely used in engineering design to improve efficiency in the simulation and optimization of design systems that involve computationally expensive simulation programs. Many existing applications are restricted to deterministic optimization. Very few studies have been conducted on studying the accuracy of using metamodels for optimization under uncertainty. In this paper, using a two-bar structure system design as an example, various metamodeling techniques are tested for different formulations of optimization under uncertainty. Observations are made on the applicability and accuracy of these techniques, the impact of sample size, and the optimization performance when different formulations are used to incorporate uncertainty. Some important issues for applying metamodels to optimization under uncertainty are discussed.

Comparative studies of metamodeling techniques under multiple modeling criteria

8th Symposium on Multidisciplinary Analysis and Optimization, 2000

Despite the advances in computer capacity, the enormous computational cost of complex engineering simulations makes it impractical to rely exclusively on simulation for the purpose of design optimization. To cut down the cost, surrogate models, also known as metamodels, are constructed from and then used in lieu of the actual simulation models. In the paper, we systematically compare four popular metamodeling techniques-Polynomial Regression, Multivariate Adaptive Regression Splines, Radial Basis Functions, and Kriging-based on multiple performance criteria using fourteen test problems representing different classes of problems. Our objective in this study is to investigate the advantages and disadvantages these four metamodeling techniques using multiple modeling criteria and multiple test problems rather than a single measure of merit and a single test problem.

Computational Intelligence and Its Applications in Uncertainty-Based Design Optimization

intechopen, 2019

The large computational cost, the curse of dimensionality and the multidisciplinary nature are known as the main challenges in dealing with real-world engineering optimization problems. The consideration of inevitable uncertainties in such problems will exacerbate mentioned difficulties as much as possible. Therefore, the computational intelligence methods (also known as surrogate-models or metamodels, which are computationally cheaper approximations of the true expensive function) have been considered as powerful paradigms to overcome or at least to alleviate the mentioned issues over the last three decades. This chapter presents an extensive survey on surrogate-assisted optimization (SAO) methods. The main focus areas are the working styles of surrogate-models and the management of the metamodels during the optimization process. In addition, challenges and future trends in this field of study are introduced. Then, a comparison study will be carried out by employing a novel evolution control strategies (ECS) and recently developed efficient global optimization (EGO) method in the framework of uncertainty-based design optimization (UDO).