[Cbc] [External] Re: 2.10 version on Ubuntu
Naladimmu Sreelakshmi
naladimmu.sreelakshmi at fractal.ai
Thu Nov 14 03:08:41 EST 2019
Great thanks for the update Ted!
Thanks,
[1518440930887_PastedImage]
Sreelakshmi Naladimmu | Senior Consultant
+91 9176264380 | fractal.ai
Upcoming OOO: 18th Nov - 22nd Nov
[1518428993160_PastedImage]
________________________________
From: Ted Ralphs <ted at lehigh.edu>
Sent: 12 November 2019 21:39
To: Naladimmu Sreelakshmi <naladimmu.sreelakshmi at fractal.ai>
Cc: JP Fasano <jpfasano at gmail.com>; cbc <cbc at list.coin-or.org>
Subject: Re: [External] Re: [Cbc] 2.10 version on Ubuntu
This seems to be fixed now.
Ted
On Mon, Nov 11, 2019 at 9:31 AM Ted Ralphs <ted at lehigh.edu<mailto:ted at lehigh.edu>> wrote:
Yes, I'm aware and will have a solution soon. For now, you can add --skip='ThirdParty/Metis' to the coinbrew command line and it should work.
Ted
On Mon, Nov 11, 2019 at 2:43 AM Naladimmu Sreelakshmi <naladimmu.sreelakshmi at fractal.ai<mailto:naladimmu.sreelakshmi at fractal.ai>> wrote:
Hi Ted,
The installation is now failing because fetch for Metis is failing - the link for the download is not working. Is this temporary or there is an alternate link? These are the commands I used.
wget https://raw.githubusercontent.com/coin-or/coinbrew/master/coinbrew
chmod +x coinbrew
./coinbrew fetch Cbc:releases/2.10.3 --no-prompt
./coinbrew build Cbc --no-prompt --prefix=/usr/local --enable-cbc-parallel
sudo ./coinbrew install Cbc
http://glaros.dtc.umn.edu/gkhome/fetch/sw/metis/OLD/metis-4.0.3.tar.gz
Thanks,
Sree
________________________________
From: Naladimmu Sreelakshmi <naladimmu.sreelakshmi at fractal.ai<mailto:naladimmu.sreelakshmi at fractal.ai>>
Sent: 19 September 2019 14:06
To: Ted Ralphs <ted at lehigh.edu<mailto:ted at lehigh.edu>>
Cc: JP Fasano <jpfasano at gmail.com<mailto:jpfasano at gmail.com>>; cbc <cbc at list.coin-or.org<mailto:cbc at list.coin-or.org>>
Subject: Re: [External] Re: [Cbc] 2.10 version on Ubuntu
Understood! 100+n gives me same result on every iteration.
The difference in performance is not too drastic too, it takes 26 minutes for a problem of ~43,000 variables with 116 threads as against 24 minutes when threads is just 16.
Thanks
Sree
________________________________
From: Ted Ralphs <ted at lehigh.edu<mailto:ted at lehigh.edu>>
Sent: 19 September 2019 00:18
To: Naladimmu Sreelakshmi <naladimmu.sreelakshmi at fractal.ai<mailto:naladimmu.sreelakshmi at fractal.ai>>
Cc: JP Fasano <jpfasano at gmail.com<mailto:jpfasano at gmail.com>>; cbc <cbc at list.coin-or.org<mailto:cbc at list.coin-or.org>>
Subject: Re: [External] Re: [Cbc] 2.10 version on Ubuntu
The parallelism is non-deterministic by default. Determinism makes the parallelism a little less efficient, so non-determinism is usually preferred unless there is a reason it's unacceptable. To get deterministic parallel, you need to set the number of threads to 100+n, e.g., 104. I know, it's weird and not well-documented :).
I just installed the Ubuntu package and it behaves the same way. I get nondeterminism if I set the threads to something < 100.
Ted
On Wed, Sep 18, 2019 at 12:28 PM Naladimmu Sreelakshmi <naladimmu.sreelakshmi at fractal.ai<mailto:naladimmu.sreelakshmi at fractal.ai>> wrote:
Hi Ted,
While running using multiple threads (compiled using enable-cbc-parallel), have noticed that the result changes slightly on repetitions. Have not observed this if I were to use the binary files instead.
Want to understand why the convergence changes while using multiple threads.
I am using below options while running cbc:
opt.options['threads']=1
opt.options['randomC']=1234567
opt.options['randomS']=1234567
opt.options['ratio']=0.004
Thanks,
[1518440930887_PastedImage]
Sreelakshmi Naladimmu | Senior Consultant
+91 9176264380 | fractal.ai<http://fractal.ai>
[1518428993160_PastedImage]
________________________________
From: Ted Ralphs <ted at lehigh.edu<mailto:ted at lehigh.edu>>
Sent: 15 September 2019 21:46
To: JP Fasano <jpfasano at gmail.com<mailto:jpfasano at gmail.com>>
Cc: Naladimmu Sreelakshmi <naladimmu.sreelakshmi at fractal.ai<mailto:naladimmu.sreelakshmi at fractal.ai>>; cbc <cbc at list.coin-or.org<mailto:cbc at list.coin-or.org>>
Subject: Re: [External] Re: [Cbc] 2.10 version on Ubuntu
Yes, the uninstall should be done as sudo if the installation directory is not writable by the user. I now added a check and it will automatically prompt you for a sudo password if you forget to run it as sudo and this is needed. The same is actually true for the install, so there is technically no need to run anything as sudo.
I've detected a few more bugs for some uncommon edge cases, so better do an update. I hope it will be stable soon and then I will start making releases and do enhancements in separate feature branches so it's not such a moving target.
Cheers,
Ted
On Sun, Sep 15, 2019 at 7:04 AM JP Fasano <jpfasano at gmail.com<mailto:jpfasano at gmail.com>> wrote:
Ted,
Should the uninstall be done with sudo?
sudo ./coinbrew Cbc uninstall
If uninstall only removes the local files in the build directory, then leaving out sudo should be OK,
but I suspect uninstall also removes the files in /usr/local which should require sudo.
Thank you for doing all this work.
It is really helpful and appreciated.
JP
On Sat, Sep 14, 2019 at 10:43 PM Ted Ralphs <ted at lehigh.edu<mailto:ted at lehigh.edu>> wrote:
OK, it took a little digging, but I got everything fixed up and added a few more enhancements to coinbrew in the meantime. The errors similar to
rm: cannot remove '/usr/local/share/coin/Data/miplib3/harp2': Permission denied
during the build step were due to an embarassing bug that has now been fixed. The build should not need to be be run with sudo by design---that is the reason for separating the build and install steps.
As for the install, I was able to replicate what you saw. As far as I can tell, you most likely did successfully in installing the release version (despite Cbc's version message), but when Cbc was built, it seems to have pulled in the configuration header file from the previously installed master version and the wrong version string got injected into the code. I'm still verifying this, but in any case, it was almost certainly some sort of corruption due to the previous install.
This possibility never occurred to me, so thanks once again for the detailed reports! I have an idea how to fix it, but it may take a little work.
In general, it's best to uninstall one version before starting to build and install another. Just run
./coinbrew Cbc uninstall
With what I think happened, you should actually now be able to simply re-build and re-install Cbc itself (no need to rebuild the dependencies) and it will be fixed. I add the option now to rebuild a project, so you should in principle be able to do
./coinbrew build --rebuild Cbc --skip-dependencies
and it will rebuild. However, since I also just changed that way build configurations are cached (sorry for the moving target), I would actually suggest that you reconfigure and rebuild everything with
./coinbrew build --rebuild --reconfigure Cbc --prefix=/usr/local
Alternatively, you can also just remove the build directory altogether with "rm -rf build". After you rebuild, you can install again and everything should be fixed up.
Cheers,
Ted
On Fri, Sep 13, 2019 at 9:07 PM JP Fasano <jpfasano at gmail.com<mailto:jpfasano at gmail.com>> wrote:
I tried a fresh checkout of the latest released code and the build seemed to work, but didn't.
I did:
* wget https://raw.githubusercontent.com/coin-or/coinbrew/master/coinbrew
* chmod +x coinbrew
* ./coinbrew fetch Cbc:releases/2.10.3 --no-prompt >fetchConsole.log 2>&1
* ./coinbrew build Cbc --no-prompt --prefix=/usr/local >buildConsole.log 2>&1
* sudo ./coinbrew install Cbc >installConsole.log 2>&1
When I run cbc, I see
jpfasano at WitOpenSource:~/coinCbc$ cbc
Welcome to the CBC MILP Solver
Version: Trunk (unstable)
Build Date: Sep 13 2019
CoinSolver takes input from arguments ( - switches to stdin)
Enter ? for list of commands or help
Coin:
Notice that the version is Trunk (unstable).
So the released version of cbc didn't get installed.
The last lines of the buildConsole.log look suspicious:
jpfasano at WitOpenSource:~/coinCbc$ tail buildConsole.log
rm: cannot remove '/usr/local/share/coin/Data/miplib3/harp2': Permission denied
rm: cannot remove '/usr/local/share/coin/Data/miplib3/vpm1': Permission denied
rm: cannot remove '/usr/local/share/coin/Data/miplib3/set1ch': Permission denied
rm: cannot remove '/usr/local/share/coin/Data/miplib3/qnet1_o': Permission denied
rm: cannot remove '/usr/local/share/coin/Data/miplib3/pk1': Permission denied
rm: cannot remove '/usr/local/share/coin/Data/miplib3/misc03': Permission denied
rm: cannot remove '/usr/local/share/coin/Data/miplib3/fixnet6': Permission denied
rm: cannot remove '/usr/local/share/coin/Data/miplib3/gen': Permission denied
rm: cannot remove '/usr/local/share/coin/Data/miplib3/mitre': Permission denied
rm: cannot remove '/usr/local/share/coin/Data/miplib3/rout': Permission denied
Perhaps "./coinbrew build" needs to be run with sudo?
Here are links to the console logs:
* fetch: link<https://1drv.ms/u/s!ArBmlTcrk72FoL1xP8WgHK50ARsLTQ?e=OEkV7M>
* build: link<https://1drv.ms/u/s!ArBmlTcrk72FoL1ynKuLKJWe9Vzldw?e=cYyXr5>
* install: link<https://1drv.ms/u/s!ArBmlTcrk72FoL1wM48QUYfsbZNDRg?e=hU2jkV>
--
Dr. Ted Ralphs
Professor, Industrial and Systems Engineering
Lehigh University
(610) 628-1280
ted 'at' lehigh 'dot' edu
coral.ie.lehigh.edu/~ted<http://coral.ie.lehigh.edu/~ted>
--
Dr. Ted Ralphs
Professor, Industrial and Systems Engineering
Lehigh University
(610) 628-1280
ted 'at' lehigh 'dot' edu
coral.ie.lehigh.edu/~ted<http://coral.ie.lehigh.edu/~ted>
________________________________
This message contains information that may be privileged or confidential and is the property of the Fractal Analytics. It is intended only for the person to whom it is addressed. Access to this e-mail by anyone else is unauthorized. If you are not the intended recipient, you are not authorized to read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message in error, please notify the sender immediately and delete all copies of this message.
________________________________
--
Dr. Ted Ralphs
Professor, Industrial and Systems Engineering
Lehigh University
(610) 628-1280
ted 'at' lehigh 'dot' edu
coral.ie.lehigh.edu/~ted<http://coral.ie.lehigh.edu/~ted>
________________________________
This message contains information that may be privileged or confidential and is the property of the Fractal Analytics. It is intended only for the person to whom it is addressed. Access to this e-mail by anyone else is unauthorized. If you are not the intended recipient, you are not authorized to read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message in error, please notify the sender immediately and delete all copies of this message.
________________________________
--
Dr. Ted Ralphs
Professor, Industrial and Systems Engineering
Lehigh University
(610) 628-1280
ted 'at' lehigh 'dot' edu
coral.ie.lehigh.edu/~ted<http://coral.ie.lehigh.edu/~ted>
--
Dr. Ted Ralphs
Professor, Industrial and Systems Engineering
Lehigh University
(610) 628-1280
ted 'at' lehigh 'dot' edu
coral.ie.lehigh.edu/~ted<http://coral.ie.lehigh.edu/~ted>
________________________________
This message contains information that may be privileged or confidential and is the property of the Fractal Analytics. It is intended only for the person to whom it is addressed. Access to this e-mail by anyone else is unauthorized. If you are not the intended recipient, you are not authorized to read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message in error, please notify the sender immediately and delete all copies of this message.
________________________________
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://list.coin-or.org/pipermail/cbc/attachments/20191114/0d2e6cc8/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Outlook-1518440930.png
Type: image/png
Size: 1543 bytes
Desc: Outlook-1518440930.png
URL: <http://list.coin-or.org/pipermail/cbc/attachments/20191114/0d2e6cc8/attachment-0004.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Outlook-1518428993.png
Type: image/png
Size: 21399 bytes
Desc: Outlook-1518428993.png
URL: <http://list.coin-or.org/pipermail/cbc/attachments/20191114/0d2e6cc8/attachment-0005.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Outlook-1518440930.png
Type: image/png
Size: 1543 bytes
Desc: Outlook-1518440930.png
URL: <http://list.coin-or.org/pipermail/cbc/attachments/20191114/0d2e6cc8/attachment-0006.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Outlook-1518428993.png
Type: image/png
Size: 21399 bytes
Desc: Outlook-1518428993.png
URL: <http://list.coin-or.org/pipermail/cbc/attachments/20191114/0d2e6cc8/attachment-0007.png>
More information about the Cbc
mailing list