[Coin-ipopt] Scaling (nlp_scaling_method / obj_scaling_factor)
Graham Sparrow
g_sparrow at hotmail.com
Fri Jun 30 07:44:09 EDT 2006
Hi,
I have been noticing some behaviour that I can't explain relating to the scaling of the NLP problem.
I was having problems with slow convergence and after trying a few things, I switch the nlp_scaling_method option from the default ("gradient-based") to "none" and this seemed to improve the situation a lot.
I did some experiments and to simplify things, I kept the nlp_scaling_method switched to "none" and tried different values for the obj_scaling_factor. My problem was simple: 2 variables, a nonlinear objective, no nonlinear inequalities, min/max bounds for both variables.
It seems that for different obj_scaling_factor values...
- It always finds the same solution
- the rate of convergence varies a lot
- it *always* takes fewest iterations when the problem is unscaled (obj_scaling_factor=1.0)
- this is the case however I scale the original problem (e.g. I can increase the objective function by a few orders of magnitude in the original definition of the NLP problem, but still a scaling of 1.0 is best)
The following is an example...
obj_scaling_factor iterations0.1 2200.2 1180.4 580.6 350.8 231.0 111.2 211.4 311.6 501.8 98
I tried on a few different problems and got similar behaviour.
I am using the C++ interface, so it is difficult to post the example, but I checked gradients, hessian etc. and I am happy that I am getting the correct solution - it just looks like the automatic and manual scaling seems to be causing problems. Given that any scaling that is applied seems to make the convergence slower (no matter what the scale of the original problem), I am wondering whether there is an issue with the way in which the scaling is being applied?
Any suggestions would be most welcome. Has anybody else seen such problems?
I apologise in advance that shortly after sending this email, I am going to be away for a week and not able to collect emails, but I will follow up as soon as I get back.
Thanks in advance,
Graham
_________________________________________________________________
Try Live.com - your fast, personalized homepage with all the things you care about in one place.
http://www.live.com/getstarted
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://list.coin-or.org/pipermail/ipopt/attachments/20060630/eddd52db/attachment.html
More information about the Coin-ipopt
mailing list