GitHub CI Jobs Slower than Usual?

[Ryan Schmidt]

On Apr 27, 2021, at 16:50, Christopher Nielsen wrote:

>> How do I access this log for a PR build?

> To get the detailed logs, you have to download the zipped log archive. Start by navigating here:
> 
> https://github.com/macports/macports-ports/pull/10781/checks?check_run_id=2427118047
> 
> Above the console view, there’s a dropdown labelled “Artifacts (2).” Click on that, and then download ‘logs-macos-10.15.zip’.
> 
> Extract the contents, and then open 'nomacs/logs/install-dependencies.log’. That’s where I pulled the detail from.


Thanks!

I see that for every one of the nondistributable archives, it tried three times to download from packages.macports.org, which failed, and after three tries MacPorts gives up on packages and builds from source.


--->  itstool-2.0.6_0+python39.darwin_20.noarch.tbz2 doesn't seem to exist in /opt/local/var/macports/incoming/verified
--->  Attempting to fetch itstool-2.0.6_0+python39.darwin_20.noarch.tbz2 from https://packages.macports.org/itstool
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
DEBUG: Fetching archive failed: The requested URL returned error: 404
--->  Attempting to fetch itstool-2.0.6_0+python39.darwin_20.noarch.tbz2 from https://packages.macports.org/itstool
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
DEBUG: Fetching archive failed: The requested URL returned error: 404
--->  Attempting to fetch itstool-2.0.6_0+python39.darwin_20.noarch.tbz2 from https://packages.macports.org/itstool
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
DEBUG: Fetching archive failed: The requested URL returned error: 404


I'm not sure why it didn't attempt to reach packages-private. I know there is a bug in base where the same host is tried twice, but I haven't seen it happen three times before.

https://trac.macports.org/ticket/57719


The timing of the start of the problem is not far off from this commit which I haven't announced yet but will soon:

https://github.com/macports/macports-ports/commit/f6770f901618118fa89562766cf528207e0c9794

The consequence of that commit is that packages.macports.org resolves to a different server now which has a different ping time than the old server. Probably packages.macports.org now has a lower pingtime than packages-private.macports.org as seen from the CI build machines, whereas before probably it had a higher pingtime. That might be significant.