[MacPorts] #58932: py-tensorflow: reduce build time

MacPorts noreply at macports.org
Fri May 22 21:35:20 UTC 2020


#58932: py-tensorflow: reduce build time
----------------------------+--------------------------
  Reporter:  ryandesign     |      Owner:  emcrisostomo
      Type:  enhancement    |     Status:  assigned
  Priority:  Normal         |  Milestone:
 Component:  ports          |    Version:
Resolution:                 |   Keywords:
      Port:  py-tensorflow  |
----------------------------+--------------------------

Comment (by ryandesign):

 Individual py-tensorflow and py-tensorflow1 subports are now taking
 [https://build.macports.org/builders/ports-10.14_x86_64-builder/builds/59290
 6],
 [https://build.macports.org/builders/ports-10.15_x86_64-builder/builds/30060
 12], or even
 [https://build.macports.org/builders/ports-10.11_x86_64-builder/builds/114350
 23] hours to build. Some builds are even getting
 [https://build.macports.org/builders/ports-10.11_x86_64-builder/builds/114354
 terminated by buildbot] because they did not print any output for an hour.

 I noticed while logged in to one of the buildbot workers while one of the
 tensorflow subports was building that one of the many clang processes was
 taking over 5 GB of memory. I have also seen messages on the buildbot
 workers' screens saying they have run out of application memory. This
 suggests that we could improve the build time by giving the buildbot
 workers more memory.

 When I set up the buildbot system in late 2016 the workers were running
 off SSDs and had 8 GB memory each (except 10.6 i386 which is limited to 4
 GB). As workers for new versions of macOS have been added in the years
 since then, I've had to reduce the memory given to some of them. In
 addition, we've had SSD failures and some buildbot workers are temporarily
 running on hard disks.

 I am currently researching replacement SSDs and intend to rearrange the
 worker VMs so that fewer VMs are on each server and so that we can give 9
 or 10 GB of memory to the workers for at least the more recent OS
 versions. If we need even more memory than that, there is room in the
 servers to add more.

-- 
Ticket URL: <https://trac.macports.org/ticket/58932#comment:3>
MacPorts <https://www.macports.org/>
Ports system for macOS


More information about the macports-tickets mailing list