A nonmonotone trust-region-approach with nonmonotone adaptive radius for solving nonlinear systems

Document Type : Research Article

Authors

• K. Amini ¹
• H. Esmaeili ²
• M. Kimiaei ³

¹ Department of Mathematics, Faculty of Science, Razi University, Kermanshah, Iran.

² Department of Mathematics, Bu-Ali Sina University, Hamedan, Iran.

³ Department of Mathematics, Asadabad Branch, Islamic Azad University, Asadabad, Iran.

10.22067/ijnao.v6i1.45607

Abstract

This paper presents a trust-region procedure for solving systems of nonlinear equations. The proposed approach takes advantages of an effective adaptive trust-region radius and a nonmonotone strategy by combining both of them appropriately. It is believed that selecting an appropriate adaptive radius based on a suitable nonmonotone strategy can improve the efficiency and robustness of the trust-region framework as well as can decrease the computational cost of the algorithm by decreasing the number of subproblems that must be solved. The global convergence to first order stationary points as well as the local q-quadratic convergence of the proposed approach are proved. Numerical experiments show that the new algorithm is promising and attractive for solving nonlinear systems.

Keywords

• Nonlinear equations
• Trust-region framework
• Adaptive radius
• Nonmonotone technique

20.1001.1.24236977.2016.6.1.6.8

---

References

1. Ahookhosh, M. and Amini K. A nonmonotone trust-region method with adaptive radius for unconstrained optimization, Computers and Mathematics with applications 60 (2010) 411-422.

2. Ahookhosh, M., Amini K. and Peyghami, M.R. A nonmonotone trustregion line search method for large-scale unconstrained optimization, Applied Mathematical Modelling 36 (2012) 478-487.

3. Ahookhosh, M., Amini, K. and Kimiaei, M. A globally convergent trustregion method for large-scale symmetric nonlinear systems, Numerical Functional Analysis and Optimization 36 (2015) 830-855.

4. Ahookhosh, M., Esmaeili, H. and Kimiaei, M. An effective trust-regionbased approach for symmetric nonlinear systems, International Journal of Computer Mathematics 90 (2013) 671-690.

5. Bellavia, S., Macconi, M. and Morini, B. STRSCNE: A scaled trust-region solver for constrained nonlinear equations, Computational Optimization and Applications 28, (2004) 31-50.

6. Bouaricha, A. and Schnabel, R.B. Tensor methods for large sparse systems of nonlinear equations, Mathematical Programming 82 (1998) 377-400.

7. Broyden, C.G. The convergence of an algorithm for solving sparse nonlinear systems, Mathematics of Computation 25 (114) (1971) 285-294.

8. Conn, A.R., Gould, N.I.M. and Toint, Ph.L. Trust-Region Methods, Society for Industrial and Applied Mathematics SIAM, Philadelphia, 2000.

9. Deng, N.Y., Xiao, Y. and Zhou, F.J. Nonmonotonic trust region algorithm, Journal of Optimization Theory and Applications 26 (1993) 259-285.

10. Dolan, E.D. and More, J.J. Benchmarking optimization software with performance proles, Mathematical Programming 91 (2002) 201-213.

11. Esmaeili, H. and Kimiaei, M. A new adaptive trust-region method for system of nonlinear equations, Appl. Math. Model. 38 (11-12) (2014)3003-3015.

12. Esmaeili, H. and Kimiaei, M. An efficient adaptive trust-region method for systems of nonlinear equations, International Journal of Computer Mathematics 92 (2015) 151-166.

13. Fan, J.Y. Convergence rate of the trust region method for nonlinear equations under local error bound condition, Computational Optimization and Applications. 34 (2005) 215-227.

14. Fan, J.Y. An improved trust region algorithm for nonlinear equations, Computational Optimization and Applications 48(1) (2011) 59-70.

15. Fan, J.Y. and Pan, J.Y A modied trust region algorithm for nonlinear equations with new updating rule of trust region radius, International Journal of Computer Mathematics 87 (14) (2010) 3186-3195.

16. Fasano, G., Lampariello, F. and Sciandrone, M. A truncated nonmonotone Gauss-Newton method for large-scale nonlinear least-squares problems, Computational Optimization and Applications 34 (3) (2006) 343-358.

17. Fischer, A., Shukla, P.K. andWang, M. On the inexactness level of robust Levenberg-Marquardt methods, Optimization 59 (2) (2010) 273-287.

18. Grippo, L., Lampariello, F. and Lucidi, S. A nonmonotone line search technique for Newton's method, SIAM Journal on Numerical Analysis 23(1986) 707-716.

19. Grippo, L., Lampariello, F. and Lucidi, S. A truncated Newton method with nonmonotone linesearch for unconstrained optimization, Journal of Optimization Theory and Applications 60 (3) (1989) 401-419.

20. Grippo, L., Lampariello, F. and Lucidi, S. A class of nonmonotone stabilization method in unconstrained optimization, Numer. Math. 59 (1991)779-805.

21. Grippo, L. and Sciandrone, M. Nonmonotone derivative-free methods for nonlinear equations, Computational Optimization and Applications 37(2007) 297-328.

22. Kanzow, C., Yamashita, N. and Fukushima, M. Levenberg-Marquardt methods for constrained nonlinear equations with strong local convergence properties, J Comput Appl Math. 172 (2004) 375-397.

23. Kanzow, C. and Kimiaei, M. A new class of nonmonotone adaptive trust-region methods for nonlinear equations with box constraints, Preprint 330, Institute of Mathematics, University of Wurzburg, Wurzburg, June 2015. http://www.mathematik.uniwuerzburg.de/ kanzow/paper/NonmonotoneTR FinalP.pdf 24. La Cruz, W. and Raydan, M. Nonmonotone spectral methods for largescale nonlinear systems, Optimization Methods and Software 18 (5)

(2003) 583-599.

25. La Cruz, W., Venezuela, C., Martnez, J.M. and Raydan, M. Spectral residual method without gradient information for solving large-scale nonlinear systems of equations: Theory and experiments, Technical Report RT-04-08, July 2004.

26. Li, D.H. and Fukushima, M. A derivative-free line search and global convergence of Broyden-like method for nonlinear equations, Optimization Methods and Software. 13 (2000) 181-201.

27. Luksan, L. and Vlcek, J. Sparse and partially separable test problems for unconstrained and equality constrained optimization, Technical Report, No. 767 (1999).

28. Luksan, L. and Vlcek, J. Truncated trust region methods based on preconditioned iterative subalgorithms for large sparse systems of nonlinear equations, Journal of Optimization Theory and Applications 95 (3) (1997)637-658.

29. Macconi, M., Morini, B. and Porcelli, M. A Gauss-Newton method for solving boundconstrained underdetermined nonlinear systems, Optimization Methods and Software 24 (2) (2009) 219-235.

30. Nesterov, YU. Modied Gauss-Newton scheme with worst case guarantees for global performance, Optimization Methods and Software 22 (3)(2007) 469-483.

31. Nocedal, J. andWright, S.J. Numerical Optimization, Springer, NewYork (2006).

32. Powell, M.J.D. Convergence properties of a class of minimization algorithms, in Nonlinear Programming, O.L. Mangasarian, R.R. Meyer, and S.M. Robinson, eds., Academic Press, NewYork, 1975, pp. 1-27.

33. Shi, Z.J. and Guo, J.H. A new trust region method with adaptive radius, Computational Optimization and Applications, 213 (2008) 509-520.

34. Toint, Ph.L.Numerical solution of large sets of algebraic nonlinear equations, Mathematics of Computation 46 (173) (1986) 175-189.

35. Toint, Ph.L. Non-monotone trust region algorithm for nonlinear optimization subject to convex constraints, Math. Program. 77 (1997) 69-94.

36. Toint, Ph.L. An assessment of nonmonotone line search technique for unconstrained optimization, SIAM J. Sci. Comput. 17 (1996) 725-739.

37. Xiao Y. and Chu, E.K.W. Nonmonotone trust region methods, Technical Report 95/17, Monash University, Clayton, Australia, 1995.

38. Xiao, Y. and Zhou, F.J. Nonmonotone trust region methods with curvilinear path in unconstrained optimization, Computing 48 (1992) 303-317.

39. Yamashita, N. and Fukushima, M. On the rate of convergence of the Levenberg-Marquardt method, Computing 15 (2001) 239-249.

40. Yuan, G., Lu, S. and Wei, Z. A new trust-region method with line search for solving symmetric nonlinear equations, International Journal of Computer Mathematics 88 (10) (2011) 2109-2123.

41. Yuan, G.L., Wei, Z.X. and Lu, X.W. A BFGS trust-region method for nonlinear equations, Computing 92 (4) (2011) 317-333.

42. Yuan, Y. Trust region algorithm for nonlinear equations, Information 1 (1998) 7-21.

43. Zhang, H.C. and Hager, W.W. A nonmonotone line search technique for unconstrained optimization, SIAM journal on Optimization 14 (4) (2004)1043-1056.

44. Zhang, J. and Wang, Y. A new trust region method for nonlinear equations, Mathematical Methods of Operation Research 58 (2003) 283-298.

45. Zhang, X.S., Zhang, J.L. and Liao, L.Z. An adaptive trust region method and its convergence, Science in China 45 (2002) 620-631.

46. Zhou, F. and Xiao, Y. A class of nonmonotone sta bilization trust region methods, Computing 53 (2) (1994) 119-136.