Better to Just Rent
You can decentralize compute and rent out your Mac at night for LLM inference — but the math says renting beats owning.
I just had muse do some deep research. Turns out you can ask some complicated questions, like “can I rent out my computer at night, or could you decentralize compute with open source models?”
The answer is, ofc you can. But it’s not worth your money. So if a Mac mini can’t be amortized and sold on the secondary market, that means you can always get cheaper inference using third party providers. Privacy is a benefit, but it has a cost. So the only benefit is control.
Better to just rent! Get some cheap hardware and rent out the inference.
Read more here.
Other Ideas