Metal execution
Add the PRO Q4 routed-expert Metal path and distributed runtime changes needed to run the full model across two hosts.
Sliced GGUF loading
Allow distributed engines to bind only their local layer range, with token embeddings and the output head required only on the sides that need them.
Split artifacts
Document the two-file PRO Q4 setup and add download_model.sh targets for the coordinator half, worker half, and combined split download.
(cherry picked from commit a782cfba894c6a44af11e1b5fc69ccfc000ab39d)
Luigi Colluto
antirez
user