Numerical Methods Golden Section Search Method - Theory

Slides:



Advertisements
Similar presentations
Numerical Methods Fourier Transform Pair Part: Frequency and Time Domain
Advertisements

Optimization.
CSE 330: Numerical Methods
Copyright © 2006 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 One-Dimensional Unconstrained Optimization Chapter.
Civil Engineering Majors Author(s): Autar Kaw, Jai Paul
Optimization : The min and max of a function
Optimization 吳育德.
Optimization Introduction & 1-D Unconstrained Optimization
Thursday, April 25 Nonlinear Programming Theory Separable programming Handouts: Lecture Notes.
By Hrishikesh Gadre Session II Department of Mechanical Engineering Louisiana State University Engineering Equation Solver Tutorials.
ECIV 301 Programming & Graphics Numerical Methods for Engineers Lecture 7 Roots of Equations Bracketing Methods.
MIT and James Orlin © Nonlinear Programming Theory.
ECIV 301 Programming & Graphics Numerical Methods for Engineers Lecture 6 Roots of Equations Bracketing Methods.
Engineering Optimization
ENGR 351 Numerical Methods Instructor: Dr. L.R. Chevalier
Metamodeling Seminar X. CHAPTER Prof. O. Nierstrasz Spring Semester 2008.
INTEGRALS 5. INTEGRALS We saw in Section 5.1 that a limit of the form arises when we compute an area.  We also saw that it arises when we try to find.
ESE Einführung in Software Engineering X. CHAPTER Prof. O. Nierstrasz Wintersemester 2005 / 2006.
Maximum and Minimum Values (Section 3.1)
CP — Concurrent Programming X. CHAPTER Prof. O. Nierstrasz Wintersemester 2005 / 2006.
Copyright © Cengage Learning. All rights reserved. 5 Integrals.
12. eToys. © O. Nierstrasz PS — eToys 12.2 Denotational Semantics Overview:  … References:  …
SWOT Analysis Strengths Weaknesses SWOT Opportunities Threats.
Numerical Methods Newton’s Method for One - Dimensional Optimization - Theory
Numerical Methods Discrete Fourier Transform Part: Discrete Fourier Transform
Instructor: Prof.Dr.Sahand Daneshvar Presented by: Seyed Iman Taheri Student number: Non linear Optimization Spring EASTERN MEDITERRANEAN.
Elliptic Partial Differential Equations - Introduction
Newton-Raphson Method
ENCI 303 Lecture PS-19 Optimization 2
Numerical Methods Part: Cholesky and Decomposition
Numerical Methods Part: Simpson Rule For Integration.
Numerical Methods Fast Fourier Transform Part: Informal Development of Fast Fourier Transform
5/31/ Multi Dimensional Direct Search Methods Major: All Engineering Majors Authors: Autar Kaw, Ali Yalcin
Numerical Methods Multi Dimensional Direct Search Methods - Theory
Numerical Methods Fast Fourier Transform Part: Theoretical Development of Fast Fourier Transform
Numerical Methods Continuous Fourier Series Part: Continuous Fourier Series
11/17/ Introduction to Partial Differential Equations Transforming Numerical.
Numerical Methods Part: False-Position Method of Solving a Nonlinear Equation
Sketching Vocabulary Chapter 3.4 in Sketching User Experiences: The Workbook Drawing objects, people, and their activities.
Numerical Methods Newton’s Method for One - Dimensional Optimization - Theory
The Islamic University of Gaza Faculty of Engineering Civil Engineering Department Numerical Analysis ECIV 3306 Chapter 5 Bracketing Methods.
Iteration Methods “Mini-Lecture” on a method to solve problems by iteration Ch. 4: (Nonlinear Oscillations & Chaos). Some nonlinear problems are solved.
Optimization of functions of one variable (Section 2)
Numerical Methods Multidimensional Gradient Methods in Optimization- Theory
1/29/ Bisection Method Computer Engineering Majors Authors: Autar Kaw, Jai Paul
1/30/ Elliptic Partial Differential Equations – Lieberman Method – Part 1 of 2 Elliptic Partial Differential.
INTEGRALS We saw in Section 5.1 that a limit of the form arises when we compute an area. We also saw that it arises when we try to find the distance traveled.
2/13/ Elliptic Partial Differential Equations - Introduction Transforming.
2/24/ Golden Section Search Method Major: All Engineering Majors Authors: Autar Kaw, Ali Yalcin
Numerical Methods Part: False-Position Method of Solving a Nonlinear Equation
Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 Part 2 - Chapter 7 Optimization.
Numerical Methods Multidimensional Gradient Methods in Optimization- Example
EngageNY.org ©2012 Core Knowledge Foundation. This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License.
© 2015 Core Knowledge Foundation. This work is licensed under a Creative Commons Attribution- NonCommercial-ShareAlike 3.0 Unported License.
CSE 330: Numerical Methods. What is true error? True error is the difference between the true value (also called the exact value) and the approximate.
Morning Reflections / Today’s objectives
Numerical Methods Multi Dimensional Direct Search Methods - Example
Definition of a Polynomial Inequality
Numerical Methods Part: Cholesky and Decomposition
Pre and post workshop assessments
Elliptic Partial Differential Equations – Direct Method
Newton-Raphson Method
Newton-Raphson Method
Elliptic Partial Differential Equations – Gauss-Seidel Method
Numerical Methods Golden Section Search Method - Example
Numerical Methods Newton’s Method for One -Dimensional Optimization - Example
Part 4 - Chapter 13.
This material is based upon work supported by the National Science Foundation under Grant #XXXXXX. Any opinions, findings, and conclusions or recommendations.
Complexity Theory: Foundations
Presentation transcript:

Numerical Methods Golden Section Search Method - Theory http://nm

For more details on this topic Go to http://nm.mathforcollege.com Click on Keyword Click on Golden Section Search Method

You are free to Share – to copy, distribute, display and perform the work to Remix – to make derivative works

Under the following conditions Attribution — You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work). Noncommercial — You may not use this work for commercial purposes. Share Alike — If you alter, transform, or build upon this work, you may distribute the resulting work only under the same or similar license to this one.

Equal Interval Search Method Choose an interval [a, b] over which the optima occurs. Compute and If then the interval in which the maximum occurs is otherwise it occurs in x f(x) a b Figure 1 Equal interval search method. http://nm.mathforcollege.com

Golden Section Search Method The Equal Interval method is inefficient when  is small. Also, we need to compute 2 interior points ! The Golden Section Search method divides the search more efficiently closing in on the optima in fewer iterations. X2 XL X1 Xu fu f2 f1 fL Figure 2. Golden Section Search method http://nm.mathforcollege.com

Golden Section Search Method-Selecting the Intermediate Points b XL X1 Xu fu f1 fL a-b b X2 a XL X1 Xu fu f2 f1 fL b Determining the first intermediate point a Determining the second intermediate point Let ,hence Golden Ratio=> http://nm.mathforcollege.com

Golden Section Search Method Hence, after solving quadratic equation, with initial guess = (0, 1.5708 rad) =Initial Iteration Second Iteration Only 1 new inserted location need to be completed! http://nm.mathforcollege.com

Golden Section Search- Determining the new search region X2 XL X1 Xu fu f2 f1 fL X2 XL X1 Xu fu f2 f1 fL Case 1 Case 2 Case1: If then the new interval is Case2: http://nm.mathforcollege.com

Golden Section Search- Determining the new search region At each new interval ,one needs to determine only 1(not 2) new inserted location (either compute the new ,or new ) Max. Min. It is desirable to have automated procedure to compute and initially. http://nm.mathforcollege.com

Golden Section Search- (1-D) Line Search Method δ 2.618δ 5.232δ 9.468δ 1.618δ 1.6182δ Min.g(α)=Max.[-g(α)] α jth j-1th j-2th αL = Σδ(1.618)v V = 0 j - 2 αU = Σδ(1.618)v j • αL αa αb αU 0.382(αU - αl) 1st 2nd αa = αL + 0.382(αU – αl) = Σδ(1.618)v + 0.382δ(1.618)j-1(1+1.618) 3rd αa = Σδ(1.618)v + 1δ(1.618)j-1 = Σδ(1.618)v = already known ! j - 1 4th Figure 2.4 Bracketing the minimum point. Figure 2.5 Golden section partition. _ = αL http://nm.mathforcollege.com

Golden Section Search- (1-D) Line Search Method If , Then the minimum will be between αa & αb. If as shown in Figure 2.5, Then the minimum will be between & and . Notice that: And Thus αb (wrt αU & αL ) plays same role as αa(wrt αU & αL ) !! _ _ http://nm.mathforcollege.com

Golden Section Search- (1-D) Line Search Method Step 1 : For a chosen small step size δ in α,say ,let j be the smallest integer such that. The upper and lower bound on αi are and . Step 2: Compute g(αb) ,where αa= αL+ 0.382(αU- αL) ,and αb = αL+ 0.618(αU- αL). Note that , so g(αa) is already known. Step 3: Compare g(αa) and g(αb) and go to Step 4,5, or 6. Step 4: If g(αa)<g(αb),then αL ≤ αi ≤ αb. By the choice of αa and αb, the new points and have . Compute , where and go to Step 7. http://nm.mathforcollege.com

Golden Section Search- (1-D) Line Search Method Step 5: If g(αa) > g(αb), then αa ≤ αi ≤ αU. Similar to the procedure in Step 4, put and . Compute ,where and go to Step 7. Step 6: If g(αa) = g(αb) put αL = αa and αu = αb and return to Step 2. Step 7: If is suitably small, put and stop. Otherwise, delete the bar symbols on ,and and return to Step 3. http://nm.mathforcollege.com

The End http://nm.mathforcollege.com

Acknowledgement This instructional power point brought to you by Numerical Methods for STEM undergraduate http://nm.mathforcollege.com Committed to bringing numerical methods to the undergraduate

For instructional videos on other topics, go to http://nm.mathforcollege.com This material is based upon work supported by the National Science Foundation under Grant # 0717624. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.

The End - Really

Numerical Methods Golden Section Search Method - Example http://nm

For more details on this topic Go to http://nm.mathforcollege.com Click on Keyword Click on Golden Section Search Method

You are free to Share – to copy, distribute, display and perform the work to Remix – to make derivative works

Under the following conditions Attribution — You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work). Noncommercial — You may not use this work for commercial purposes. Share Alike — If you alter, transform, or build upon this work, you may distribute the resulting work only under the same or similar license to this one.

Example . 2 2   2 The cross-sectional area A of a gutter with equal base and edge length of 2 is given by (trapezoidal area): Find the angle  which maximizes the cross-sectional area of the gutter. Using an initial interval of find the solution after 2 iterations. Convergence achieved if “ interval length ” is within http://nm.mathforcollege.com

Solution The function to be maximized is Iteration 1: Given the values for the boundaries of we can calculate the initial intermediate points as follows: XL=X2 X2=X1 Xu X2 XL X1 Xu f2 f1 X1=? http://nm.mathforcollege.com

Solution Cont To check the stopping criteria the difference between and is calculated to be http://nm.mathforcollege.com

Solution Cont Iteration 2 XL X2 Xu X1 http://nm.mathforcollege.com

Theoretical Solution and Convergence Iteration xl xu x1 x2 f(x1) f(x2)  1 0.0000 1.5714 0.9712 0.6002 5.1657 4.1238 2 1.2005 5.0784 3 0.8295 4.9426 4 1.0588 5.1955 0.3710 5 1.1129 5.1740 0.2293 6 1.0253 5.1937 0.1417 7 1.0794 5.1908 0.0876 8 1.0460 5.1961 0.0541 9 1.0381 5.1957 0.0334 The theoretically optimal solution to the problem happens at exactly 60 degrees which is 1.0472 radians and gives a maximum cross-sectional area of 5.1962. http://nm.mathforcollege.com

The End http://nm.mathforcollege.com

Acknowledgement This instructional power point brought to you by Numerical Methods for STEM undergraduate http://nm.mathforcollege.com Committed to bringing numerical methods to the undergraduate

For instructional videos on other topics, go to http://nm.mathforcollege.com This material is based upon work supported by the National Science Foundation under Grant # 0717624. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.

The End - Really