local inference is genuinely good now. what's missing is a control plane, so you're not manually juggling ports and shell scripts every time you want to swap models. I built Athanor to solve this problem. mylesborins.com/blog/local-i... github.com/MylesBorins/...
MylesBorins.com
portfolio and blog of myles borins
mylesborins.com