2026-11-11 14:34 UTC
Self host is your only option. Companies can make all the privacy claims in the world, but nothing prevents them stealing your data.
e2e encryption is meaningless when the other end is the company, and has to be able to read your inputs in order to inference with them. Anyone claiming e2e encryption is straight up lying to you.
If you are actually based in Palestine, it doesnt seem likely you would be able to purchase GPUs (and keep the running/safe), so you are more realistically looking at GPU rental, which can be pricy. And it may not be secure either.
A nvidia P100 can be had from aliexpress for relatively cheap, and gives you 16GB vram. You won’t be running fable level models, but there are models that will work. If your budget can stretch to 2, there is lots more options available. I dont know what kind of questions you want to ask, but I’m happy to throw a sample at my p100 system if you want?
Replies (1)
-
@Osm@lemmy.ml 2026-11-11 14:57
I agree with what you said, but the hosting option isn’t available right now, and it’s not available to everyone either. So what I’m looking for is the least harmful option. Because, to my knowledge, there are models that don’t use user data to improve their services—they’re trained on either historical data or open-source data, or they rely more on web searches for their answers. (Many people recommend thaura.ai)