[MacPorts] #67308: ports tree on rsync is stale

[MacPorts]

#67308: ports tree on rsync is stale
-----------------------------+---------------------
  Reporter:  barracuda156    |      Owner:  admin@…
      Type:  defect          |     Status:  new
  Priority:  Normal          |  Milestone:
 Component:  server/hosting  |    Version:  2.8.1
Resolution:                  |   Keywords:
      Port:                  |
-----------------------------+---------------------
Changes (by ryandesign):

 * cc: ryandesign (removed)


Comment:

 We've had multiple occasions in the past couple days when the off-site
 Apple Silicon builder has unexpectedly lost the connection to the master,
 and I've also noticed some network issues on my machine on the same
 network. It's possible that FAU is experiencing similar unexpected network
 disconnections when trying to rsync from the main server. (All other
 mirrors sync from FAU.) Or perhaps all of the traffic from FAU is what was
 causing other services to disconnect.

 We have been building ~2000 R ports on each builder, in small batches,
 since about the time this issue started. It's not unusual for the builders
 to be busy for days at a time, e.g. when several clang ports are updated,
 so I'm not sure why this would be a problem now. Maybe the difference is
 that with clang, we spend several hours building each port during which
 time an rsync run could complete without any files having changed on the
 server, whereas now we're building many small ports and between the time
 an rsync run starts and the time it finishes new files have appeared on
 the packages server. I'm not sure how rsync handles that situation. Maybe
 it retries automatically to get the new files. There might be a limit to
 the number of retries. Or maybe it just returns an error, and maybe FAU is
 running a script that retries a number of times if it gets that specific
 error.

 Most buildbot builds have been paused due to a tornado watch but that
 seems to be done now. I'll take the opportunity to update and reboot the
 router before starting builds again.

 A sync was happening now, and it transferred many R packages before
 failing with `rsync: [sender] writer error: Broken pipe (32)`. I'll check
 what happens on the next sync.

-- 
Ticket URL: <https://trac.macports.org/ticket/67308#comment:11>
MacPorts <https://www.macports.org/>
Ports system for macOS