Before optimization: Design space exploration

By Bruce Jenkins, President, Ora Research

Design optimization is a powerful technology for automating the search for solutions to engineering problems. But before moving to optimize a chosen design, it can be useful to employ design space exploration—a family of quantitative methods that help engineers gain a better, more complete understanding of a new product’s potential “design space” by discovering which design variables will have the greatest impact on the product’s performance.

The numerical methods that underpin design space exploration have been long known—and sometimes applied, when the attendant costs in expertise, time and labor could be justified. What’s changing now is the rapidly maturing generation of software tools transforming these powerful but formerly difficult-to-use methods into practical everyday engineering aids.

BruceJenkins_Blog_8-15-2015_image1
Design-of-experiments (DOE) study of an electronics heat-sink design reveals which design variables have the greatest impact on the design’s performance. Source: CD-adapco

Before diving into how design space exploration works, how does it relate to design optimization in a product development project? Dr. Chris Mattson, director of BYU’s Design Exploration Research Lab, offers this perspective: “Design optimization depends on a well-posed optimization problem formulation, which generally includes (i) a well-defined objective function, (ii) inequality and equality constraints, and (iii) the expression of stakeholder preference, all of which are likely to be multidisciplinary in nature. In an arguably real way, such a problem formulation predefines the optimum solution, thereby allowing the mathematical rigor of the optimization to lead to the optimum design by an iterative, computational search.

Mattson continues: “Design exploration, on the other hand, assumes that the optimal design is initially unknown and initially uncharacterizable. The process of design exploration discovers design conditions and little by little (often through some form of experimentation) characterizes what an optimal design looks like. Once this is known, the final solution can then be found through a convergent design optimization algorithm.

The essential quantitative method for design space exploration is design-of-experiment (DOE) studies. In a DOE study, an analysis model is automatically evaluated multiple times, with the design variables set to different values in each iteration. The results identify which variable(s) affect the design the most, and which least. This information allows variables that are not important to be ignored in subsequent phases of the design process, or set to values that are most convenient or least costly.

Concretely, a designed experiment is a structured set of tests of a system or process. Integral to a designed experiment are response(s), factor(s) and a model.

• A response is a measurable result—fuel mileage (automotive), deposition rate (semiconductor), reaction yield (chemical process).
• A factor is any variable that the experimenter judges may affect a response of interest. Common factor types include continuous (may take any value on an interval; e.g., octane rating), categorical (having a discrete number of levels; e.g., a specific company or brand) and blocking (categorical, but not generally reproducible; e.g., automobile driver-to-driver variability).
• A model is a mathematical surrogate for the system or process.
• The experiment consists of exercising the model across some range of values assigned to the defined factors.

In deciding what values to use—more precisely, in deciding on a statistical strategy for selecting values—the goal is to achieve coverage of the design space that will yield maximum information about its characteristics with least experimental (computational) effort, and with confidence that the set of points sampled gives a representative picture of the entire design space.

Numerous statistical sampling methods exist to do this. Which method to use depends on the nature of the problem being studied, and on the resources available—time, computational capacity, and how much is already known about the problem.

Examples of (a) random sampling, (b) full factorial sampling and (c) Latin hypercube sampling, for a simple case of 10 samples (samples for τ2 ~ U (6,10) and λ ~ N (0.4, 0.1) are shown). In random sampling, there are regions of the parameter space that are not sampled, and other regions that are heavily sampled. In full factorial sampling, a random value is chosen in each interval for each parameter, and every possible combination of parameter values is chosen. In Latin hypercube sampling, a value is chosen once and only once from every interval of every parameter; it is efficient, and adequately samples the entire parameter space. Source: Hoare et al., Theoretical Biology and Medical Modelling, 2008.
Examples of (a) random sampling, (b) full factorial sampling and (c) Latin hypercube sampling, for a simple case of 10 samples (samples for τ2 ~ U (6,10) and λ ~ N (0.4, 0.1) are shown). In random sampling, there are regions of the parameter space that are not sampled, and other regions that are heavily sampled. In full factorial sampling, a random value is chosen in each interval for each parameter, and every possible combination of parameter values is chosen. In Latin hypercube sampling, a value is chosen once and only once from every interval of every parameter; it is efficient, and adequately samples the entire parameter space. Source: Hoare et al., Theoretical Biology and Medical Modelling, 2008.

The results of a DOE sampling process are then used to generate an approximate model of the system being studied, called a response surface model (RSM). The RSM is generated by interpolating between the discrete DOE results to create a continuous surface map or model. The RSM is a convenient and efficient tool for visualizing the design space, examining relationships among design variables and their effects on key responses, and rapidly evaluating design alternatives—all without the need to perform additional expensive CAE evaluations or experiments.

Response surface model. Source: Noesis Solutions
Response surface model. Source: Noesis Solutions

Here are some of the leading design space exploration software solutions available today:

• Altair HyperStudy
• ANSYS DesignXplorer
• CD-adapco STAR-CCM+ /Enabling Optimate
• DATADVANCE pSeven
• DecisionVis ExplorerDV
• Dynamic Design Solutions FEMtools Optimization
• Dynardo optiSLang
• eArtius Pareto Explorer
• ESTECO modeFRONTIER
• Exa PowerFLOW Optimization Solution
• FRIENDSHIP SYSTEMS CAESES/FRIENDSHIP-Framework
• FunctionBay RecurDyn/AutoDesign
• iChrome Nexus
• InModelia Neuro Pex
• MSC Nastran Multi-run & Design Space Exploration
• Noesis Solutions Optimus
• OptiY GmbH OptiY
• Phoenix Integration ModelCenter
• PIDOTECH PIAnO
• PTC Creo BMX (Behavioral Modeling Extension)
• Red Cedar Technology HEEDS MDO
• Sigma Tech IOSO
• SIMULIA Isight
• Vanderplaats Research & Development VisualDOC

Written by

Paul Heney

Paul J. Heney is Vice President and Editorial Director of Design World magazine. A graduate of the Georgia Institute of Technology (Georgia Tech), Paul has a Bachelor of Science degree in Engineering Science & Mechanics with a minor in Technical Communications and Biomedical Engineering. He has written about fluid power, aerospace, robotics, medical, green engineering and general manufacturing topics for more than 25 years.