The Vibeary — tag

local-llm

1 resources in The Vibeary tagged "local-llm" — tools, libraries and references pulled from across the library's shelves, each one checked by hand before it was added.

Gems in this collection

slotstream

Streams MoE experts from SSD so a 125B 4-bit Qwen can run on Macs with far less RAM, via MLX/Swift with an Ollama-compatible API.

Carlos Galarza (@carloslfu)MIT