[Cbc] [External] Re: 2.10 version on Ubuntu

Tue Nov 12 11:09:26 EST 2019

This seems to be fixed now.

Ted

On Mon, Nov 11, 2019 at 9:31 AM Ted Ralphs <ted at lehigh.edu> wrote:

> Yes, I'm aware and will have a solution soon. For now, you can add
> --skip='ThirdParty/Metis' to the coinbrew command line and it should work.
>
> Ted
>
> On Mon, Nov 11, 2019 at 2:43 AM Naladimmu Sreelakshmi <
> naladimmu.sreelakshmi at fractal.ai> wrote:
>
>> Hi Ted,
>>
>> The installation is now failing because fetch for Metis is failing  - the
>> link for the download is not working. Is this temporary or there is an
>> alternate link? These are the commands I used.
>>
>> wget https://raw.githubusercontent.com/coin-or/coinbrew/master/coinbrew
>> chmod +x coinbrew
>> ./coinbrew fetch Cbc:releases/2.10.3 --no-prompt
>> ./coinbrew build Cbc --no-prompt --prefix=/usr/local --enable-cbc-parallel
>> sudo ./coinbrew install Cbc
>>
>>
>> http://glaros.dtc.umn.edu/gkhome/fetch/sw/metis/OLD/metis-4.0.3.tar.gz
>>
>> Thanks,
>> Sree
>>
>> ------------------------------
>> *From:* Naladimmu Sreelakshmi <naladimmu.sreelakshmi at fractal.ai>
>> *Sent:* 19 September 2019 14:06
>> *To:* Ted Ralphs <ted at lehigh.edu>
>> *Cc:* JP Fasano <jpfasano at gmail.com>; cbc <cbc at list.coin-or.org>
>> *Subject:* Re: [External] Re: [Cbc] 2.10 version on Ubuntu
>>
>> Understood! 100+n gives me same result on every iteration.
>>
>> The difference in performance is not too drastic too, it takes 26 minutes
>> for a problem of ~43,000 variables with 116 threads as against 24 minutes
>> when threads is just 16.
>>
>> Thanks
>> Sree
>>
>> ------------------------------
>> *From:* Ted Ralphs <ted at lehigh.edu>
>> *Sent:* 19 September 2019 00:18
>> *To:* Naladimmu Sreelakshmi <naladimmu.sreelakshmi at fractal.ai>
>> *Cc:* JP Fasano <jpfasano at gmail.com>; cbc <cbc at list.coin-or.org>
>> *Subject:* Re: [External] Re: [Cbc] 2.10 version on Ubuntu
>>
>> The parallelism is non-deterministic by default. Determinism makes the
>> parallelism a little less efficient, so non-determinism is usually
>> preferred unless there is a reason it's unacceptable. To get deterministic
>> parallel, you need to set the number of threads to 100+n, e.g., 104. I
>> know, it's weird and not well-documented :).
>>
>> I just installed the Ubuntu package and it behaves the same way. I get
>> nondeterminism if I set the threads to something < 100.
>>
>> Ted
>>
>> On Wed, Sep 18, 2019 at 12:28 PM Naladimmu Sreelakshmi <
>> naladimmu.sreelakshmi at fractal.ai> wrote:
>>
>> Hi Ted,
>>
>> While running using multiple threads (compiled using
>> enable-cbc-parallel), have noticed that the result changes slightly on
>> repetitions. Have not observed this if I were to use the binary files
>> instead.
>>
>> Want to understand why the convergence changes while using multiple
>> threads.
>>
>> I am using below options while running cbc:
>> opt.options['threads']=1
>> opt.options['randomC']=1234567
>> opt.options['randomS']=1234567
>> opt.options['ratio']=0.004
>>
>> Thanks,
>> [image: 1518440930887_PastedImage]
>> Sreelakshmi Naladimmu | Senior Consultant
>> +91 9176264380 | fractal.ai
>> [image: 1518428993160_PastedImage]
>>
>> ------------------------------
>> *From:* Ted Ralphs <ted at lehigh.edu>
>> *Sent:* 15 September 2019 21:46
>> *To:* JP Fasano <jpfasano at gmail.com>
>> *Cc:* Naladimmu Sreelakshmi <naladimmu.sreelakshmi at fractal.ai>; cbc <
>> cbc at list.coin-or.org>
>> *Subject:* Re: [External] Re: [Cbc] 2.10 version on Ubuntu
>>
>> Yes, the uninstall should be done as sudo if the installation directory
>> is not writable by the user. I now added a check and it will automatically
>> prompt you for a sudo password if you forget to run it as sudo and this is
>> needed. The same is actually true for the install, so there is technically
>> no need to run anything as sudo.
>>
>> I've detected a few more bugs for some uncommon edge cases, so better do
>> an update. I hope it will be stable soon and then I will start making
>> releases and do enhancements in separate feature branches so it's not such
>> a moving target.
>>
>> Cheers,
>>
>> Ted
>>
>> On Sun, Sep 15, 2019 at 7:04 AM JP Fasano <jpfasano at gmail.com> wrote:
>>
>> Ted,
>> Should the uninstall be done with sudo?
>>
>> *sudo* ./coinbrew Cbc uninstall
>>
>> If uninstall only removes the local files in the build directory, then
>> leaving out sudo should be OK,
>> but I suspect uninstall also removes the files in /usr/local which should
>> require sudo.
>>
>> Thank you for doing all this work.
>> It is really helpful and appreciated.
>>
>> JP
>>
>> On Sat, Sep 14, 2019 at 10:43 PM Ted Ralphs <ted at lehigh.edu> wrote:
>>
>> OK, it took a little digging, but I got everything fixed up and added a
>> few more enhancements to coinbrew in the meantime. The errors similar to
>>
>> rm: cannot remove '/usr/local/share/coin/Data/miplib3/harp2': Permission
>> denied
>>
>> during the build step were due to an embarassing bug that has now been
>> fixed. The build should not need to be be run with sudo by design---that is
>> the reason for separating the build and install steps.
>>
>> As for the install, I was able to replicate what you saw. As far as I can
>> tell, you most likely did successfully in installing the release version
>> (despite Cbc's version message), but when Cbc was built, it seems to have
>> pulled in the configuration header file from the previously installed
>> master version and the wrong version string got injected into the code. I'm
>> still verifying this, but in any case, it was almost certainly some sort of
>> corruption due to the previous install.
>>
>> This possibility never occurred to me, so thanks once again for the
>> detailed reports! I have an idea how to fix it, but it may take a little
>> work.
>>
>> In general, it's best to uninstall one version before starting to build
>> and install another. Just run
>>
>> ./coinbrew Cbc uninstall
>>
>> With what I think happened, you should actually now be able to simply
>> re-build and re-install Cbc itself (no need to rebuild the dependencies)
>> and it will be fixed. I add the option now to rebuild a  project, so you
>> should in principle be able to do
>>
>> ./coinbrew build --rebuild Cbc --skip-dependencies
>>
>> and it will rebuild. However, since I also just changed that way build
>> configurations are cached (sorry for the moving target), I would actually
>> suggest that you reconfigure and rebuild everything with
>>
>> ./coinbrew build --rebuild --reconfigure Cbc --prefix=/usr/local
>>
>> Alternatively, you can also just remove the build directory altogether
>> with "rm -rf build". After you rebuild, you can install again and
>> everything should be fixed up.
>>
>> Cheers,
>>
>> Ted
>>
>>
>>
>>
>>
>> On Fri, Sep 13, 2019 at 9:07 PM JP Fasano <jpfasano at gmail.com> wrote:
>>
>> I tried a fresh checkout of the latest released code and the build seemed
>> to work, but didn't.
>> I did:
>>
>>    - wget
>>    https://raw.githubusercontent.com/coin-or/coinbrew/master/coinbrew
>>    - chmod +x coinbrew
>>    - ./coinbrew fetch Cbc:releases/2.10.3 --no-prompt >fetchConsole.log
>>    2>&1
>>    - ./coinbrew build Cbc --no-prompt --prefix=/usr/local
>>    >buildConsole.log 2>&1
>>    - sudo ./coinbrew install Cbc  >installConsole.log 2>&1
>>
>> When I run cbc, I see
>>
>> jpfasano at WitOpenSource:~/coinCbc$ cbc
>> Welcome to the CBC MILP Solver
>> Version: Trunk (unstable)
>> Build Date: Sep 13 2019
>>
>> CoinSolver takes input from arguments ( - switches to stdin)
>> Enter ? for list of commands or help
>> Coin:
>>
>> Notice that the version is Trunk (unstable).
>> So the released version of cbc didn't get installed.
>>
>> The last lines of the buildConsole.log look suspicious:
>>
>> jpfasano at WitOpenSource:~/coinCbc$ tail buildConsole.log
>>
>> rm: cannot remove '/usr/local/share/coin/Data/miplib3/harp2': Permission
>> denied
>> rm: cannot remove '/usr/local/share/coin/Data/miplib3/vpm1': Permission
>> denied
>> rm: cannot remove '/usr/local/share/coin/Data/miplib3/set1ch': Permission
>> denied
>> rm: cannot remove '/usr/local/share/coin/Data/miplib3/qnet1_o':
>> Permission denied
>> rm: cannot remove '/usr/local/share/coin/Data/miplib3/pk1': Permission
>> denied
>> rm: cannot remove '/usr/local/share/coin/Data/miplib3/misc03': Permission
>> denied
>> rm: cannot remove '/usr/local/share/coin/Data/miplib3/fixnet6':
>> Permission denied
>> rm: cannot remove '/usr/local/share/coin/Data/miplib3/gen': Permission
>> denied
>> rm: cannot remove '/usr/local/share/coin/Data/miplib3/mitre': Permission
>> denied
>> rm: cannot remove '/usr/local/share/coin/Data/miplib3/rout': Permission
>> denied
>>
>> Perhaps "./coinbrew build" needs to be run with sudo?
>>
>> Here are links to the console logs:
>>
>>    - fetch: link
>>    <https://1drv.ms/u/s!ArBmlTcrk72FoL1xP8WgHK50ARsLTQ?e=OEkV7M>
>>    - build: link
>>    <https://1drv.ms/u/s!ArBmlTcrk72FoL1ynKuLKJWe9Vzldw?e=cYyXr5>
>>    - install: link
>>    <https://1drv.ms/u/s!ArBmlTcrk72FoL1wM48QUYfsbZNDRg?e=hU2jkV>
>>
>>
>>
>> --
>> Dr. Ted Ralphs
>> Professor, Industrial and Systems Engineering
>> Lehigh University
>> (610) 628-1280
>> ted 'at' lehigh 'dot' edu
>> coral.ie.lehigh.edu/~ted
>>
>>
>>
>> --
>> Dr. Ted Ralphs
>> Professor, Industrial and Systems Engineering
>> Lehigh University
>> (610) 628-1280
>> ted 'at' lehigh 'dot' edu
>> coral.ie.lehigh.edu/~ted
>>
>>
>>
>>
>> ------------------------------
>>
>> This message contains information that may be privileged or confidential
>> and is the property of the Fractal Analytics. It is intended only for the
>> person to whom it is addressed. Access to this e-mail by anyone else is
>> unauthorized. If you are not the intended recipient, you are not authorized
>> to read, print, retain, copy, disseminate, distribute, or use this message
>> or any part thereof. If you receive this message in error, please notify
>> the sender immediately and delete all copies of this message.
>> ------------------------------
>>
>>
>>
>>
>>
>> --
>> Dr. Ted Ralphs
>> Professor, Industrial and Systems Engineering
>> Lehigh University
>> (610) 628-1280
>> ted 'at' lehigh 'dot' edu
>> coral.ie.lehigh.edu/~ted
>>
>>
>>
>>
>> ------------------------------
>>
>> This message contains information that may be privileged or confidential
>> and is the property of the Fractal Analytics. It is intended only for the
>> person to whom it is addressed. Access to this e-mail by anyone else is
>> unauthorized. If you are not the intended recipient, you are not authorized
>> to read, print, retain, copy, disseminate, distribute, or use this message
>> or any part thereof. If you receive this message in error, please notify
>> the sender immediately and delete all copies of this message.
>> ------------------------------
>>
>>
>>
>
>
> --
> Dr. Ted Ralphs
> Professor, Industrial and Systems Engineering
> Lehigh University
> (610) 628-1280
> ted 'at' lehigh 'dot' edu
> coral.ie.lehigh.edu/~ted
>

-- 
Dr. Ted Ralphs
Professor, Industrial and Systems Engineering
Lehigh University
(610) 628-1280
ted 'at' lehigh 'dot' edu
coral.ie.lehigh.edu/~ted
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://list.coin-or.org/pipermail/cbc/attachments/20191112/1867a00c/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Outlook-1518440930.png
Type: image/png
Size: 1543 bytes
Desc: not available
URL: <http://list.coin-or.org/pipermail/cbc/attachments/20191112/1867a00c/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Outlook-1518428993.png
Type: image/png
Size: 21399 bytes
Desc: not available
URL: <http://list.coin-or.org/pipermail/cbc/attachments/20191112/1867a00c/attachment-0003.png>