This community [email protected] is dedicated to local LLMs but the one on reddit, with the same name, is much larger. The guides are a bit dated but should suffice for a start.
AI models that can perform well without sending everything off to the cloud to do so are going to be high on my wish list. Partly for privacy, partly for responsiveness, partly for resilience when the internet goes down. I’ve heard some rumors that this is a focus for the AI that will drive the next upgrade to Siri, and I hope that turns out to be true.
A privacy-enhanced personal assistant that doesn’t send anything to the cloud.
There’s a number to chose from, depending on your hardware and preferences.
On this here server, you could go to [email protected] for a start.
This community [email protected] is dedicated to local LLMs but the one on reddit, with the same name, is much larger. The guides are a bit dated but should suffice for a start.
AI models that can perform well without sending everything off to the cloud to do so are going to be high on my wish list. Partly for privacy, partly for responsiveness, partly for resilience when the internet goes down. I’ve heard some rumors that this is a focus for the AI that will drive the next upgrade to Siri, and I hope that turns out to be true.