[MacPorts] #71358: source/browser/repos links are 403 forbidden

MacPorts noreply at macports.org
Thu Nov 21 19:53:38 UTC 2024 

#71358: source/browser/repos links are 403 forbidden
-------------------------+------------------------
  Reporter:  ryandesign  |      Owner:  neverpanic
      Type:  defect      |     Status:  accepted
  Priority:  Normal      |  Milestone:
 Component:  trac        |    Version:
Resolution:              |   Keywords:
      Port:              |
-------------------------+------------------------

Comment (by neverpanic):

 Yeah, re-enabling just leads us down the same path again:

 [[Image(https://trac.macports.org/raw-attachment/ticket/71358/cpu-
 pinpoint-reenable.png)]]

 The drop at the very end is after I re-added the deny for `/browser`.

 Page load times shoot through the roof until they run into timeouts:

 [[Image(https://trac.macports.org/raw-attachment/ticket/71358
 /http_loadtime-reenable.png)]]

 I already have blocking based on user agents in the Apache config:

 {{{
         <Location ~ "/(timeline|report|query|changeset|log|browser)">
                 <If "%{HTTP_USER_AGENT} =~ /(Baiduspider|Sogou web
 spider|bingbot|SemrushBot|Amazonbot|okhttp)/">
                         Require all denied
                 </If>
         </Location>
 }}}

 Unfortunately the top user agents that cause those requests do not
 indicate that they are bots:

 {{{
 root at braeburn /etc # grep -P '(?<=GET )/browser'
 /var/log/apache2/trac.access.log | grep -Po '"[^"]+"$' | sort | uniq -c |
 sort -n | tail -n 7
     200 "Mozilla/5.0 (compatible; Googlebot/2.1;
 +http://www.google.com/bot.html)"
     267 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36
 (KHTML, like Gecko) Chrome/101.0.4951.67 Safari/537.36"
     267 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36
 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36"
     275 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36
 (KHTML, like Gecko) Chrome/101.0.4951.64 Safari/537.36 Edg/101.0.1210.47"
     292 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36
 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36"
     312 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36
 (KHTML, like Gecko) Chrome/110.0.0.0 Safari/537.36"
     714 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36
 (KHTML, like Gecko) Chrome/114.0.0.0 Safari/537.36 Edg/114.0.1823.43"
 }}}

 I'm fairly certain they are, though: the Chrome versions listed are all
 ancient, users with Edge probably have no business on MacPorts anyway, and
 the pages they request are very very old:

 {{{
 root at braeburn /etc # grep 'Chrome/114.0.0.0'
 /var/log/apache2/trac.access.log | awk '{print $7}' | grep /browser | head
 -n100
 /browser/trunk/dports/comms/libtelepathy
 /browser/trunk/dports/x11/xorg-server/files/include
 /browser/trunk/dports/x11/xorg-server/files/5005-fb-Revert-fb-changes-
 that-broke-XQuartz.patch
 /browser/trunk/dports/x11/xorg-server/files/0002-XQuartz-Cleanup-CPPFLAGS-
 that-are-no-longer-necessar.patch
 /browser/trunk/dports/x11/xorg-server/files/5001-Revert-dix-Restore-
 PaintWindow-screen-hook.patch
 /browser/trunk/dports/x11/xorg-server/files/5003-Use-old-miTrapezoids-and-
 miTriangles-routines.patch
 /browser/trunk/dports/x11/xorg-server/files/0003-os-connection-Improve-
 abstraction-for-launchd-secure.patch
 /browser/trunk/dports/x11/xorg-server/files/5004-fb-Revert-fb-changes-
 that-broke-XQuartz.patch
 /browser/trunk/dports/x11/xorg-server/files/5002-Workaround-the-GC-
 clipping-problem-in-miPaintWindow-.patch
 /browser/trunk/dports/x11/xorg-server/files/0001-XQuartz-Fix-the-issue-
 where-the-h-key-could-be-come-.patch
 /browser/trunk/dports/math/octave-devel/files/patch-liboctave-
 regexp.h.diff
 /browser/trunk/dports/math/octave-devel/files/patch-liboctave-eigs-
 base.cc.diff
 /browser/trunk/dports/python/py27-gtk
 /browser/trunk/dports/x11/xorg-server/files/5000-sdksyms.sh-Use-CPPFLAGS-
 not-CFLAGS.patch
 /browser/trunk/dports/python/py27-gtk/Portfile
 /browser/trunk/dports/science/fann/Portfile
 /browser/trunk/dports/x11/xorg-server-
 devel/files/dri/GL/internal/dri_interface.h
 /browser/trunk/dports/devel/argp-standalone/files
 /browser/trunk/dports/math/octave-devel/files/patch-configure.diff
 /browser/trunk/dports/devel/argp-standalone/files/patch-argp-fmtstream.h
 /browser/trunk/dports/devel/argp-standalone
 /browser/trunk/dports/python/py26-gobject/files
 /browser/trunk/dports/python/py26-gobject/files/patch-gi_pygi.h
 /browser/trunk/dports/python/py26-gtk
 /browser/trunk/dports/python/py-pyside/Portfile
 /browser/trunk/dports/aqua/Shiira2
 /browser/trunk/dports/devel/cloog-devel/files
 /browser/trunk/dports/lang/clojure
 /browser/trunk/dports/lang/clojure/files/completions.clj
 /browser/trunk/dports/lang/clojure/files/.clj_completions
 /browser/trunk/dports/lang/clojure/Portfile
 /browser/trunk/dports/lang/clojure/files/clj.sh
 /browser/trunk/dports/lang/clojure/files/clj-rlwrap.sh
 /browser/trunk/dports/lang/clojure/files/clj-jline.sh
 /browser/trunk/dports/lang/clojure/files/completions-contrib.clj
 /browser/trunk/dports/perl/p5-crypt-ciphersaber/Portfile
 /browser/trunk/dports/python/py-lightblue/files
 /browser/branches/release1/base/src/pextlib1.0/Pextlib.c
 /browser/branches/release1/base/Mk/dports.autoconf.mk.in
 /browser/branches/release1/base/configure
 /browser/trunk/dports/python/py26-lightblue/Portfile
 /browser/trunk/dports/zope/zope-mimetypesregistry/Portfile
 /browser/branches/release1/base/src/pextlib1.0/Makefile
 /browser/branches/release1/base/doc/portfile.7
 /browser/branches/release1/base/src/pextlib1.0/curl.h
 /browser/branches/release1/base/aclocal.m4
 /browser/branches/release1/base/src/port1.0/portfetch.tcl
 /browser/branches/release1/base/configure.ac
 /browser/branches/release1/base/src/port1.0/port_autoconf.tcl.in
 /browser/trunk/dports/textproc/cloc/files/patch-Makefile-perl.diff
 /browser/trunk/dports/textproc/yamcha/files
 /browser/trunk/dports/perl/p5-net-libidn/files/patch-Makefile.PL.diff
 /browser/trunk/dports/www/serf1/files/patch-SConstruct.diff
 /browser/trunk/dports/math/gnudatalanguage/Portfile
 /browser/trunk/dports/math/OpenBLAS-devel/files/patch-linkLib.diff
 /browser/users/devans/GNOME-3/unstable/dports/x11/gtkmm3
 /browser/users/devans/GNOME-3/stable-c%2B%2B11/dports/x11/gtkmm3
 /browser/users/devans/GNOME-3/unstable-c%2B%2B11/dports/x11/gtkmm3
 /browser/users/devans/GNOME-3/stable-c%2B%2B11/dports/x11/gtkmm3/Portfile
 /browser/trunk/dports/x11/x3270
 /browser/users/mojca/ports/science/root/files/patch-graf2d-asimage-src-
 libAfterImage-asfont.c.diff
 /browser/branches/gsoc11-statistics/base/src/package1.0
 /browser/branches/gsoc11-statistics/base/src/Makefile.in
 /browser/branches/gsoc11-statistics/base/src/images_to_archives.tcl
 /browser/branches/gsoc11-statistics/base/src/pkg_mkindex.sh.in
 /browser/users/mojca/ports/science/root5/files/patch-graf2d-asimage-src-
 libAfterImage-asfont.c.diff
 /browser/branches/gsoc11-statistics/base/src/cflib1.0
 /browser/branches/gsoc11-statistics/base/src/tclobjc1.0
 /browser/branches/gsoc11-statistics/base/src/machista1.0
 /browser/branches/gsoc11-statistics/base/src/thread2.6.diff
 /browser/branches/gsoc11-statistics/base/src/upgrade_sources_conf_default.tcl
 /browser/branches/gsoc11-statistics/base/src/config.h.in
 /browser/branches/gsoc11-statistics/base/src/thread2.6.tar.gz
 /browser/branches/gsoc11-statistics/base/src/pextlib1.0
 /browser/branches/gsoc11-statistics/base/src/cregistry
 /browser/branches/release_2_3/base/src/pextlib1.0
 /browser/trunk/dports/php/php5-xhprof/files
 /browser/branches/gsoc11-statistics/base/src/programs
 /browser/branches/gsoc11-statistics/base/src/registry2.0
 /browser/branches/gsoc11-statistics/base/src/darwintracelib1.0
 /browser/trunk/dports/mail/mutt-devel/files/patch-1.5.21.mp.xlabel_ext.9
 /browser/branches/gsoc11-statistics/base/src/port
 /browser/trunk/dports/textproc/irstlm/files/patch-configure.in.diff
 /browser/trunk/dports/textproc/irstlm/files/patch-scripts.diff
 /browser/trunk/dports/perl/p5-class-returnvalue
 /browser/trunk/dports/textproc/opencc/files
 /browser/trunk/dports/gnome/libgail-gnome/files/patch-Makefile.in.diff
 /browser/trunk/dports/perl/p5-text-quoted/Portfile
 /browser/trunk/dports/gnome/libgail-gnome
 /browser/trunk/dports/gnome/libgail-gnome/Portfile
 /browser/trunk/dports/net/gupnp-tools
 /browser/trunk/dports/net/gupnp-tools/Portfile
 /browser/trunk/dports/net/gupnp-tools/files
 /browser/users/dweber/textproc
 /browser/users/dweber/textproc/doxygen
 /browser/users/dweber/textproc/doxygen/Portfile
 /browser/users/dweber/textproc/doxygen/files
 /browser/users/dweber
 /browser/branches/mld-qt-481/www/localized/ru/includes/functions.inc
 /browser/branches/mld-qt-481/www/localized/ru/getdp/index.php
 }}}

-- 
Ticket URL: <https://trac.macports.org/ticket/71358#comment:6>
MacPorts <https://www.macports.org/>
Ports system for macOS

More information about the macports-tickets mailing list