<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div class=""><br class=""></div><div><br class=""><blockquote type="cite" class=""><div class="">On 6 Jul 2020, at 5:22 pm, Steven Smith <<a href="mailto:steve.t.smith@gmail.com" class="">steve.t.smith@gmail.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><meta http-equiv="Content-Type" content="text/html; charset=utf-8" class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">I am not using --max_idle_secs=60.<div class=""><br class=""></div><div class="">Also, neither is port py-tensorflow </div></div></div></blockquote><div><br class=""></div><div>yes, it does. See</div><div><br class=""></div><div><a href="https://github.com/macports/macports-ports/blob/master/python/py-tensorflow/Portfile#L187" class="">https://github.com/macports/macports-ports/blob/master/python/py-tensorflow/Portfile#L187</a></div><div><br class=""></div><div>Chris</div><br class=""><blockquote type="cite" class=""><div class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div class="">nor the repo tensorflow/tensorflow itself, nor any other MacPorts repo, and these all build fine without this option:</div><div class=""><ul class=""><li class=""><a href="https://github.com/macports/macports-ports/blob/master/python/py-tensorflow/Portfile" class="">https://github.com/macports/macports-ports/blob/master/python/py-tensorflow/Portfile</a></li><li class=""><a href="https://github.com/tensorflow/tensorflow/search?q=max_idle_secs&type=Code" class="">https://github.com/tensorflow/tensorflow/search?q=max_idle_secs&type=Code</a></li><li class=""><a href="https://github.com/macports/macports-ports/search?q=max_idle_secs&type=Code" class="">https://github.com/macports/macports-ports/search?q=max_idle_secs&type=Code</a></li></ul></div><div class=""><br class=""></div><div class="">I’m happy to try adding it, but my expectation is that some other issue is causing the hang when run within the port command (the build itself only takes few seconds when run by hand).</div><div class=""><br class=""></div><div class="">I must also add the bazel-based builds tensorflow-probability and others, so getting a robust bazel build approach would be very helpful and useful.</div><div class=""><br class=""></div><div class="">Steve<br class=""><div class=""><br class=""><div class=""><br class=""><blockquote type="cite" class=""><div class="">On Jul 6, 2020, at 11:57 AM, Christopher Jones <<a href="mailto:jonesc@hep.phy.cam.ac.uk" class="">jonesc@hep.phy.cam.ac.uk</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><meta http-equiv="Content-Type" content="text/html; charset=utf-8" class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">Hi,<div class=""><br class=""></div><div class="">Are you using this option </div><div class=""><br class=""></div><div class="">bazel --max_idle_secs=60</div><div class=""><br class=""></div><div class="">when building with bazel ?</div><div class=""><br class=""></div><div class="">Bazel builds start an underlying ’server’ process, that by default hangs around for 3600 secs (yes, 1hour) before disappearing. Without the above your build will hang around waiting for this to happen…</div><div class=""><br class=""></div><div class="">Chris</div><div class=""><br class=""><div class=""><blockquote type="cite" class=""><div class="">On 6 Jul 2020, at 2:57 am, Steven Smith <<a href="mailto:steve.t.smith@gmail.com" class="">steve.t.smith@gmail.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><meta http-equiv="Content-Type" content="text/html; charset=utf-8" class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><meta http-equiv="Content-Type" content="text/html; charset=utf-8" class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">I’m preparing a PR for the Google Magenta project <<a href="https://magenta.tensorflow.org/" class="">https://magenta.tensorflow.org</a>>, and am running into this issue for the “dm-tree” dependent package with the bazel build.<div class=""><br class=""></div><div class="">The command `port -dv test py37-dm-tree` hangs during the bazel build.</div><div class=""><ul class="MailOutline"><li class="">I can’t even Ctl-C out of the process—it requires a full ps command then a kill -9 to shut down everything.</li><li class="">However, running the build by hand works:</li><ul class=""><li class="">sudo -u macports bash -c '/opt/local/Library/Frameworks/Python.framework/Versions/3.7/bin/python3.7 setup.py --no-user-cfg build'</li></ul></ul></div><div class=""><br class=""></div><div class="">Any pointers or help would be appreciated. I’ve never used bazel, so I copied a bunch of relevant stuff from the py-tensorflow Portfile and attempted a few obvious hacks, but nothing changes the underlying problem of a hung port command.</div><div class=""><br class=""></div><div class="">Relevant files:</div><div class=""><div class=""><div class=""><br class=""></div></div><div class=""><a href="https://github.com/deepmind/tree/blob/master/setup.py" class="">https://github.com/deepmind/tree/blob/master/setup.py</a></div><div class=""><a href="https://github.com/deepmind/tree/blob/master/bazel/BUILD" class="">https://github.com/deepmind/tree/blob/master/bazel/BUILD</a></div><div class=""><br class=""></div><div class="">Bazel process (hung when called from MacPorts):</div><div class=""><br class=""></div><div class=""><blockquote type="cite" class=""><div style="margin: 0px; font-stretch: normal; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures; font-size: 12px;" class="">bazel(tree-0.1.6.20200524) -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/private/var/tmp/_bazel_root/54b8ea352146bad8adc65c2e363d519a -Xverify:none -Djava.util.logging.config.file=/private/var/tmp/_bazel_root/54b8ea352146bad8adc65c2e363d519a/javalog.properties -Dcom.google.devtools.build.lib.util.LogHandlerQuerier.class=com.google.devtools.build.lib.util.SimpleLogHandler$HandlerQuerier -XX:-MaxFDLimit -Djava.library.path=/var/tmp/_bazel_root/install/e3bdf1a360e6d6cc38da72ec898bd905/embedded_tools/tools/objc:/var/tmp/_bazel_root/install/e3bdf1a360e6d6cc38da72ec898bd905/ -Dfile.encoding=ISO-8859-1 -jar /var/tmp/_bazel_root/install/e3bdf1a360e6d6cc38da72ec898bd905/A-server.jar --max_idle_secs=10800 --noshutdown_on_low_sys_mem --connect_timeout_secs=30 --output_user_root=/var/tmp/_bazel_root --install_base=/var/tmp/_bazel_root/install/e3bdf1a360e6d6cc38da72ec898bd905 --install_md5=e3bdf1a360e6d6cc38da72ec898bd905 --output_base=/private/var/tmp/_bazel_root/54b8ea352146bad8adc65c2e363d519a --workspace_directory=/opt/local/var/macports/build/_opt_local_ports_python_py-dm-tree/py37-dm-tree/work/tree-0.1.6.20200524 --default_system_javabase=/Library/Java/JavaVirtualMachines/openjdk13/Contents/Home --failure_detail_out=/private/var/tmp/_bazel_root/54b8ea352146bad8adc65c2e363d519a/failure_detail.rawproto --deep_execroot --expand_configs_in_place --idle_server_tasks --write_command_log --nowatchfs --nofatal_event_bus_exceptions --nowindows_enable_symlinks --client_debug=false --product_name=Bazel --noincompatible_enable_execution_transition --option_sources=</span></div></blockquote></div><div class=""><br class=""></div><div class="">Draft Portfile:</div><div class=""><br class=""></div><div class=""><blockquote type="cite" class=""><div class=""><font face="Menlo" style="font-size: 14px;" class=""># -*- coding: utf-8; mode: tcl; tab-width: 4; indent-tabs-mode: nil; c-basic-offset: 4 -*- vim:fenc=utf-8:ft=tcl:et:sw=4:ts=4:sts=4</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""><br class=""></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">PortSystem          1.0</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">PortGroup           compilers 1.0</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">PortGroup           compiler_blacklist_versions 1.0</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">PortGroup           github 1.0</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">PortGroup           java 1.0</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">PortGroup           python 1.0</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">PortGroup           xcodeversion 1.0</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">PortGroup           xcode_workaround 1.0</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""><br class=""></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">github.setup        deepmind tree 2b81872</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""># no official release; version from __init__.py plus github commit date</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">version             0.1.6.20200524</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">name                py-dm-${github.project}</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">revision 0</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""><br class=""></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">platforms           darwin</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">license             Apache-2</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">maintainers         nomaintainer</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""><br class=""></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">description         Deepmind tree is a library for working with nested\</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">                    data structures.</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">long_description    ${description} In a way, tree generalizes the builtin\</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">                    map function which only supports flat sequences, and\</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">                    allows to apply a function to each "leaf" preserving\</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">                    the overall structure.</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""><br class=""></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">homepage            <a href="https://github.com/deepmind/tree" class="">https://github.com/deepmind/tree</a></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">distname            ${github.project}-${version}</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""><br class=""></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">checksums           rmd160  40518b306e8f5a80b12ef5e76ca9e2f8ef232de3 \</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">                    sha256  0748428f70fae2209b8763bf99cadaf22276a4391851ba919dce9d3d0bc047bf \</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">                    size    35176</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""><br class=""></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">python.versions     37 38</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""><br class=""></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""># Required java version</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">java.version        11+</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""># JDK port to install if required java not found</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">java.fallback       openjdk14</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""># JDK only needed at build time, but java PG sets lib dependency so</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""># declare no conflict to allow redistribution of binaries.</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">license_noconflict  ${java.fallback}</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""><br class=""></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""># require c++14</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">compiler.cxx_standard 2014</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""><br class=""></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""># The oldest Xcode version to use default Xcode compiler</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""># <a href="https://github.com/tensorflow/tensorflow/issues/39262" class="">https://github.com/tensorflow/tensorflow/issues/39262</a></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">set tf_min_xcode    10.2</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">compiler.blacklist-append {clang < 1001}</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""># Work out if we should be using macports clang</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">set use_mp_clang [ expr ( [ string match macports-clang-* ${configure.compiler} ] || [ vercmp ${xcodeversion} ${tf_min_xcode} ] < 0 ) ]</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""><br class=""></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">use_parallel_build  no</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""><br class=""></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">if {${name} ne ${subport}} {</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">    depends_build-append \</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">                    port:bazel \</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">                    port:py${python.version}-setuptools</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""><br class=""></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">    depends_run-append \</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">                    port:py${python.version}-six \</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""><br class=""></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">    depends_test-append \</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">                    port:py${python.version}-absl \</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">                    port:py${python.version}-attrs \</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">                    port:py${python.version}-numpy \</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">                    port:py${python.version}-pytest \</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">                    port:py${python.version}-wrapt</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""><br class=""></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">    # diff -NaurdwB ./dm-tree-orig/setup.py ./dm-tree-new/setup.py | sed -E -e 's/\.\/dm-tree-(orig|new)*\/(setup\.py)(\.[[:alnum:]]+)*/\.\/setup.py/' > ./setup.py.patch</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">    # patchfiles      setup.py.patch</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""><br class=""></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">    # set bazel_output_base   ${workpath}/tmp/_bazel_root</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">    # xinstall -d     ${bazel_output_base}</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">    # post-patch {</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">    #     reinplace \</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">    #         "s|@BAZEL_OUTPUT_USER_ROOT@|${bazel_output_base}|g" \</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">    #         ${worksrcpath}/setup.py</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">    # }</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""><br class=""></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">    build.env-append \</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">                    BAZEL_USE_CPP_ONLY_TOOLCHAIN=1 \</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">                    JAVA_HOME=${java.home}</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""><br class=""></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">    test.run        yes</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">    test.cmd        py.test-${python.branch}</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">    test.target</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">    test.env-append \</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">                    "PATH=$env(PATH):${workpath}/bin" \</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">                    PYTHONPATH=${worksrcpath}/build/lib</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""><br class=""></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">    post-destroot {</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">        set docdir ${prefix}/share/doc/${subport}</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">        xinstall -d ${destroot}${docdir}</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">        xinstall -m 0644 -W ${worksrcpath} LICENSE README.md \</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">            ${destroot}${docdir}</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">    }</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class=""><br class=""></font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">    livecheck.type      none</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">} else {</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">    livecheck.type      pypi</font></div><div class=""><font face="Menlo" style="font-size: 14px;" class="">}</font></div></blockquote><div class=""><div class=""><br class=""></div></div></div></div></div></div></div></blockquote></div><br class=""></div></div></div></blockquote></div><br class=""></div></div></div></div></blockquote></div><br class=""></body></html>