[MacPorts] #60632: Reduce disk writes by extracting distfiles directly from fileserver
MacPorts
noreply at macports.org
Fri Jun 12 14:13:27 UTC 2020
#60632: Reduce disk writes by extracting distfiles directly from fileserver
---------------------------+---------------------
Reporter: ryandesign | Owner: admin@…
Type: enhancement | Status: new
Priority: Normal | Milestone:
Component: buildbot/mpbb | Version:
Keywords: | Port:
---------------------------+---------------------
I want to reduce disk writes on the buildbot worker machines (#60628) and
one idea is to avoid downloading distfiles to the buildworker's local
disk.
Currently the buildbot workers download distfiles from a local fileserver
over http when needed and they get written to the local disk as usual.
Instead, we might be able to mount the distfiles collection read-only from
the local fileserver via afp or smb and mpbb could symlink the files into
/opt/local/var/macports/distfiles. Ideally this should be resilient
against situations where some or all of the distfiles are not on the
fileserver or the fileserver is down; in these cases, the worker should be
allowed to download the distfiles via http as usual. There could be a
launchd plist that establishes the connection to the fileserver at system
startup and some method for reconnecting automatically in the event that
the fileserver has to be restarted for example.
Or instead of putting this functionality into mpbb we could try to add it
as a feature to MacPorts base so that the user can specify in
macports.conf possible alternate locations where distfiles can be found.
This is probably trickier since variables like `distpath` are exposed to
and used by portfiles and are expected to contain a single path value.
--
Ticket URL: <https://trac.macports.org/ticket/60632>
MacPorts <https://www.macports.org/>
Ports system for macOS
More information about the macports-tickets
mailing list