[MacPorts] #30670: selfupdate and sync take a long time or seemingly hang in 2.0.1 (Lion)

[MacPorts]

#30670: selfupdate and sync take a long time or seemingly hang in 2.0.1 (Lion)
----------------------------+-----------------------------------------------
 Reporter:  sdavids@…       |       Owner:  macports-tickets@…                   
     Type:  defect          |      Status:  new                                  
 Priority:  High            |   Milestone:                                       
Component:  ports           |     Version:  2.0.1                                
 Keywords:  Lion            |        Port:                                       
----------------------------+-----------------------------------------------
 {{{
 dragonfly:~ sdavids$ sw_vers
 ProductName:    Mac OS X
 ProductVersion: 10.7
 BuildVersion:   11A511
 dragonfly:~ sdavids$ port version
 Version: 2.0.1
 dragonfly:~ sdavids$ date && sudo port -dv selfupdate && date
 Tue Aug  9 13:50:13 CEST 2011
 --->  Updating the ports tree
 DEBUG: Synchronizing ports tree(s)
 Synchronizing local ports tree from
 rsync://rsync.macports.org/release/tarballs/ports.tar
 DEBUG: /usr/bin/rsync -rtzv --delete-after
 rsync://rsync.macports.org/release/tarballs/ports.tar
 /opt/local/var/macports/sources/rsync.macports.org/release/tarballs
 receiving file list ... done

 sent 36 bytes  received 70 bytes  14.13 bytes/sec
 total size is 45267456  speedup is 427051.47
 DEBUG: /usr/bin/rsync -rtzv --delete-after
 rsync://rsync.macports.org/release/tarballs/ports.tar.rmd160
 /opt/local/var/macports/sources/rsync.macports.org/release/tarballs
 receiving file list ... done

 sent 36 bytes  received 77 bytes  45.20 bytes/sec
 total size is 512  speedup is 4.53
 DEBUG: successful verification with key /opt/local/share/macports
 /macports-pubkey.pem
 DEBUG: /usr/bin/tar -C
 /opt/local/var/macports/sources/rsync.macports.org/release/tarballs/tmp
 -xf
 /opt/local/var/macports/sources/rsync.macports.org/release/tarballs/ports.tar
 Creating port index in
 /opt/local/var/macports/sources/rsync.macports.org/release/tarballs/ports

 Total number of ports parsed:   0
 Ports successfully parsed:      0
 Ports failed:                   0
 Up-to-date ports skipped:       8301

 DEBUG: MacPorts sources location:
 /opt/local/var/macports/sources/rsync.macports.org/release/tarballs
 --->  Updating MacPorts base sources using rsync
 receiving file list ... done

 sent 36 bytes  received 69 bytes  30.00 bytes/sec
 total size is 3219456  speedup is 30661.49
 receiving file list ... done

 sent 36 bytes  received 76 bytes  32.00 bytes/sec
 total size is 512  speedup is 4.57
 DEBUG: successful verification with key /opt/local/share/macports
 /macports-pubkey.pem
 DEBUG: /usr/bin/tar -C
 /opt/local/var/macports/sources/rsync.macports.org/release/tarballs/tmp
 -xf
 /opt/local/var/macports/sources/rsync.macports.org/release/tarballs/base.tar
 MacPorts base version 2.0.1 installed,
 DEBUG: Rebuilding and reinstalling MacPorts if needed
 MacPorts base version 2.0.1 downloaded.
 --->  MacPorts base is already the latest version
 DEBUG: Setting MacPorts sources ownership to root

 The ports tree has been updated. To upgrade your installed ports, you
 should run
   port upgrade outdated
 Tue Aug  9 13:56:18 CEST 2011
 dragonfly:~ sdavids$ echo $PATH
 /opt/local/bin:/usr/bin:/bin:/opt/local/sbin:/usr/sbin:/sbin:/usr/local/bin:/usr/X11/bin
 dragonfly:~ sdavids$ tar --version
 bsdtar 2.8.3 - libarchive 2.8.3
 dragonfly:~ sdavids$ ls -la /usr/bin/tar
 lrwxr-xr-x  1 root  wheel  6 Jul 21 23:45 /usr/bin/tar -> bsdtar
 dragonfly:~ sdavids$ otool -hLv /usr/bin/bsdtar
 /usr/bin/bsdtar:
 Mach header
       magic cputype cpusubtype  caps    filetype ncmds sizeofcmds
 flags
 MH_MAGIC_64  X86_64        ALL LIB64     EXECUTE    15       2040
 NOUNDEFS DYLDLINK TWOLEVEL PIE
         /usr/lib/libarchive.2.dylib (compatibility version 9.0.0, current
 version 9.2.0)
         time stamp 2 Thu Jan  1 01:00:02 1970
         /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current
 version 159.0.0)
         time stamp 2 Thu Jan  1 01:00:02 1970
 dragonfly:~ sdavids$ ls -la
 /opt/local/var/macports/sources/rsync.macports.org/release/tarballs
 total 103816
 drwxr-xr-x  10 root  admin       340 Aug  9 13:56 .
 drwxr-xr-x   3 root  admin       102 Jul 25 15:54 ..
 -rw-r--r--   1 root  admin   4649199 Aug  9 09:00 PortIndex
 -rw-r--r--   1 root  admin       512 Aug  9 13:32 PortIndex.rmd160
 drwxr-xr-x  24 root  wheel       816 Aug  2 07:30 base
 -rw-r--r--   1 root  admin   3219456 Aug  9 13:32 base.tar
 -rw-r--r--   1 root  admin       512 Aug  9 13:32 base.tar.rmd160
 drwxr-xr-x  51 root  wheel      1734 Aug  9 13:56 ports
 -rw-r--r--   1 root  admin  45267456 Aug  9 13:32 ports.tar
 -rw-r--r--   1 root  admin       512 Aug  9 13:32 ports.tar.rmd160
 }}}

 The bulk of the time (~ 5 minutes) is between these two lines:

 {{{
 DEBUG: /usr/bin/tar -C
 /opt/local/var/macports/sources/rsync.macports.org/release/tarballs/tmp
 -xf
 /opt/local/var/macports/sources/rsync.macports.org/release/tarballs/ports.tar
 Creating port index in
 /opt/local/var/macports/sources/rsync.macports.org/release/tarballs/ports
 }}}

 It appears as if not only the delta is extracted but always the entire
 posts tar.

-- 
Ticket URL: <https://trac.macports.org/ticket/30670>
MacPorts <http://www.macports.org/>
Ports system for Mac OS