Embedding models keep getting cheaper - what required ~300M parameters three years ago now requires only 11M. In practice, that means that what runs on the server today could run in the browser tomorrow.
The best embedding score available at the end of 2023 needed a 304M-parameter model. Today the same score comes from an 11M one — 28x fewer active parameters.