cross-posted from: https://reddthat.com/post/76421889
Linux doesn’t deserve this
Imagine taking the lightweight, privacy-focused appeal of Linux and completely ruining it by hardwiring AI models straight into the OS. Nobody is switching from Windows for more forced AI features.
This is funny to me because I highly doubt the LLM runs locally, which means the OS
becausebecomes unusable if there’s no internet.Edit: spelling
Exact opposite. KORA with Cortex is local first by default where “local” can be an on-machine LLM and / or ones that located on the same local network. So it’s Hybrid with local first and the added party trick that you can tap an LLM on another machine that is also running Cortex.
Good luck finding hardware that will reliably run local LLMs in this insane RAM pricing climate.
If it has local LLMs and other models it is gonna have gigantic minimum requirements.