[Ipopt-tickets] Re: [Ipopt] #46: How to determine success after running "make test"?

[Ipopt]

#46: How to determine success after running "make test"?
--------------------------------+-------------------------------------------
  Reporter:  jpfasano           |       Owner:  ipopt-team
      Type:  enhancement        |      Status:  closed    
  Priority:  normal             |   Component:  Ipopt     
   Version:  3.3 (C++ Version)  |    Severity:  normal    
Resolution:  fixed              |    Keywords:            
--------------------------------+-------------------------------------------
Changes (by andreasw):

  * status:  new => closed
  * resolution:  => fixed

Comment:

 {{{make test}}} actually invokes a shell script which starts a few
 programs that include Ipopt.  Whether a test has finish successfully is
 determined by whether a certain string is contained in the output.  The
 script will run all applicable tests (no AMPL test if compiled without
 ASL) even if programs crash.

 Now, the script ({{{run_unitTests}}}) will exit with a non-zero return
 value to the shell from make, if at least one test failed.  With this
 {{{make test}}} will now fail, as in:

 {{{
 [andreasw at flitzer test]$ make test
 chmod u+x ./run_unitTests
 ./run_unitTests

 Running unitTests...

 Testing AMPL Solver Executable...

  ---- 8< ---- Start of test program output ---- 8< ----

 ==> Warning: Treating 1 binary and 1 integer variables as continous.

 Exception of type: OPTION_INVALID in file "/home/andreasw/COIN-
 svn/Ipopt/trunk/Ipopt/src/Common/IpOptionsList.cpp" at line 618:
  Exception message: Read Option: asf. It is not a valid option. Check the
 list of available options.
 ampl_ipopt.cpp: Error in second Initialize!!!!
  ---- 8< ----  End of test program output  ---- 8< ----

     ******** Test FAILED! ********
 Output of the test program is above.
 Testing C++ Example...

  ---- 8< ---- Start of test program output ---- 8< ----
 Exception of type: OPTION_INVALID in file "/home/andreasw/COIN-
 svn/Ipopt/trunk/Ipopt/src/Common/IpOptionsList.cpp" at line 618:
  Exception message: Read Option: asf. It is not a valid option. Check the
 list of available options.


 *** Error during initialization!
  ---- 8< ----  End of test program output  ---- 8< ----

     ******** Test FAILED! ********
 Output of the test program is above.
 Testing C Example...

  ---- 8< ---- Start of test program output ---- 8< ----
 Exception of type: OPTION_INVALID in file "/home/andreasw/COIN-
 svn/Ipopt/trunk/Ipopt/src/Common/IpOptionsList.cpp" at line 618:
  Exception message: Read Option: asf. It is not a valid option. Check the
 list of available options.
  ---- 8< ----  End of test program output  ---- 8< ----

     ******** Test FAILED! ********
 Output of the test program is above.
 Testing Fortran Example...

  ---- 8< ---- Start of test program output ---- 8< ----
 Exception of type: OPTION_INVALID in file "/home/andreasw/COIN-
 svn/Ipopt/trunk/Ipopt/src/Common/IpOptionsList.cpp" at line 618:
  Exception message: Read Option: asf. It is not a valid option. Check the
 list of available options.

  An error occoured.
  The error code is          -12

  ---- 8< ----  End of test program output  ---- 8< ----

     ******** Test FAILED! ********
 Output of the test program is above.
 make: *** [test] Error 255
 }}}

 Hope this is what is necessary for automatic testing.

-- 
Ticket URL: <https://projects.coin-or.org/Ipopt/ticket/46#comment:1>
Ipopt <http://projects.coin-or.org/Ipopt>
Interior-point optimizer for nonlinear programs.