[MacPorts] #74014: ollama @0.24.0_0+completion+mlx cannot load mlx models

MacPorts noreply at macports.org
Wed May 20 19:37:19 UTC 2026


#74014: ollama @0.24.0_0+completion+mlx cannot load mlx models
------------------------+--------------------
 Reporter:  jonasjonas  |      Owner:  (none)
     Type:  defect      |     Status:  new
 Priority:  Normal      |  Milestone:
Component:  ports       |    Version:
 Keywords:              |       Port:
------------------------+--------------------
 I have installed

 {{{
 ollama                         @0.24.0_0+completion+mlx
 ollama-bash-completion-plugin  @20250428_0
 mlx                            @0.31.2_0
 mlx-c                          @0.6.0_0
 }}}

 I also installed the MetalToolChain with
 {{{
 xcodebuild -downloadComponent MetalToolchain
 }}}

 and
 {{{
 sudo -u macports xcodebuild -downloadComponent MetalToolchain
 }}}

 (otherwise it could not compile.)

 But when I try to load a MLX model, the following errors thrown:

 {{{
 time=2026-05-20T20:29:03.069+02:00 level=INFO source=sched.go:484
 msg="system memory" total="36.0 GiB" free="23.5 GiB" free_swap="0 B"
 time=2026-05-20T20:29:03.069+02:00 level=INFO source=sched.go:491 msg="gpu
 memory" id=0 library=Metal available="27.6 GiB" free="28.1 GiB"
 minimum="512.0 MiB" overhead="0 B"
 time=2026-05-20T20:29:03.071+02:00 level=INFO source=client.go:359
 msg="starting mlx runner subprocess" model=qwen3.6:27b-coding-nvfp4
 port=59915
 time=2026-05-20T20:29:03.072+02:00 level=INFO source=sched.go:561
 msg="loaded runners" count=1
 time=2026-05-20T20:29:03.084+02:00 level=ERROR source=dynamic.go:31
 msg="failed to load MLX dynamic library:
 path=/opt/local/lib/libmlxc.dylib"
 Error: MLX not available: failed to load MLX dynamic library (searched:
 [/opt/local/bin/lib/ollama /opt/local/lib /Users/jonas/build/lib/ollama])
 time=2026-05-20T20:29:03.085+02:00 level=ERROR source=sched.go:567
 msg="error loading llama server" error="mlx runner failed: Error: MLX not
 available: failed to load MLX dynamic library (searched:
 [/opt/local/bin/lib/ollama /opt/local/lib /Users/jonas/build/lib/ollama])
 (exit: exit status 1)"
 time=2026-05-20T20:29:03.085+02:00 level=INFO source=client.go:126
 msg="stopping mlx runner subprocess" pid=18053
 }}}


 But the file exists:

 {{{
 -rwxr-xr-x  1 root  wheel   660K Apr  5 13:38
 /opt/local/lib/libmlxc.dylib*
 }}}

 With the Ollama.app (downloaded from ollama.com, I can load these models
 without problems.

 The macports version got loaded as a background service with {{{ port load
 ollama }}}

-- 
Ticket URL: <https://trac.macports.org/ticket/74014>
MacPorts <https://www.macports.org/>
Ports system for macOS


More information about the macports-tickets mailing list