[MacPorts] #58932: py-tensorflow: reduce build time
MacPorts
noreply at macports.org
Fri May 22 21:35:20 UTC 2020
#58932: py-tensorflow: reduce build time
----------------------------+--------------------------
Reporter: ryandesign | Owner: emcrisostomo
Type: enhancement | Status: assigned
Priority: Normal | Milestone:
Component: ports | Version:
Resolution: | Keywords:
Port: py-tensorflow |
----------------------------+--------------------------
Comment (by ryandesign):
Individual py-tensorflow and py-tensorflow1 subports are now taking
[https://build.macports.org/builders/ports-10.14_x86_64-builder/builds/59290
6],
[https://build.macports.org/builders/ports-10.15_x86_64-builder/builds/30060
12], or even
[https://build.macports.org/builders/ports-10.11_x86_64-builder/builds/114350
23] hours to build. Some builds are even getting
[https://build.macports.org/builders/ports-10.11_x86_64-builder/builds/114354
terminated by buildbot] because they did not print any output for an hour.
I noticed while logged in to one of the buildbot workers while one of the
tensorflow subports was building that one of the many clang processes was
taking over 5 GB of memory. I have also seen messages on the buildbot
workers' screens saying they have run out of application memory. This
suggests that we could improve the build time by giving the buildbot
workers more memory.
When I set up the buildbot system in late 2016 the workers were running
off SSDs and had 8 GB memory each (except 10.6 i386 which is limited to 4
GB). As workers for new versions of macOS have been added in the years
since then, I've had to reduce the memory given to some of them. In
addition, we've had SSD failures and some buildbot workers are temporarily
running on hard disks.
I am currently researching replacement SSDs and intend to rearrange the
worker VMs so that fewer VMs are on each server and so that we can give 9
or 10 GB of memory to the workers for at least the more recent OS
versions. If we need even more memory than that, there is room in the
servers to add more.
--
Ticket URL: <https://trac.macports.org/ticket/58932#comment:3>
MacPorts <https://www.macports.org/>
Ports system for macOS
More information about the macports-tickets
mailing list