Getting these advanced AI models running on phones hasn't been quite as straightforward (hence why the most advanced Siri AI features need one of the latest iPhones), but we're now at the point where most of the handsets are powerful enough, and some of the models are small and efficient enough that it's actually practically feasible.
Even with those compromises, the local AI you'll be able to get up and running on your phone is still going to be more than capable of everyday tasks and chats—and that means you can give Gemini or Siri (and perhaps your AI subscription) a rest.
The phone you need to run a local LLM
RAM is actually a bigger consideration than chipset performance when it comes to running an AI model. You're going to need 6GB or above for this to work at a satisfactory level, and 8GB or more is better for the larger models. Below 8GB, stick to 1-2B models—that B is for billion, and refers to the number of parameters in a model (essentially, how smart and versatile it's going to be).
Phones like the Pixel 11 Pro come with AI models on board, but they're locked away. Credit: GoogleIf you buy a new flagship-level iPhone or Android phone today, it will actually come with local AI models preinstalled for quick tasks that can be done without pinging the cloud. However, these Apple and Google-made models aren't available directly to you, the user—they're used as and when Siri AI and Gemini think they're the best option.
The apps and models you need to run a local LLM
As for models themselves—sometimes called SLMs or Small Language Models because they're designed to work in more limited environments—you've got plenty of choice here, too. For instance, Gemma is the umbrella name of the open-source models that Google makes available for free, and some of these are specifically engineered for working in tighter spaces with fewer resources (like on your phone).
PocketPal AI will guide you to the right local model for your needs. Credit: LifehackerAt the moment, these SLMs are mostly text-only, although some of the newer, larger, and more advanced ones can analyze images and files. If you want to be able to generate images and videos, you're going to have to use the conventional cloud-based AI models, at least until the next leap forward in the technology.
Putting a local LLM to the test
Once I'd downloaded and installed a couple of models, it was simple enough to load them up and get started. PocketPal AI also gives you access to optional "pals" (hence the app name) that can tailor AI models for your use—the default Pip option seems fine as a stand-in for what you might be used to with the standard Gemini or Siri AI apps. Prompting and following-up works as normal, with your chat history saved by default.
These smaller LLMs are best suited for quick answers and information requests. Credit: LifehackerWith no web search or up-to-date knowledge available, this is best for brainstorming ideas, analyzing and refining existing text, composing new text, and getting fast facts or comparisons ("give me a film like..."). As always, watch out for those hallucinations, and don't take the word of any AI to be guaranteed as accurate.
Hence then, the article about how to run a local llm on your phone and why you d want to was published today ( ) and is available on Live Hacker ( Middle East ) The editorial team at PressBee has edited and verified it, and it may have been modified, fully republished, or quoted. You can read and follow the updates of this news or article from its original source.
Read More Details
Finally We wish PressBee provided you with enough information of ( How to Run a Local LLM on Your Phone (and Why You’d Want To) )
Also on site :
- “She Left This World Far Too Soon”: Wladimir Klitschko Issues Statement On Ex Hayden Panettiere’s Death & Promises To Keep Her Memory Alive For Their Daughter Kaya
- DeWine, Tressel Tout Ohio’s Economic Success
- The global ‘freedom of the seas’ is dying in the Strait of Hormuz—and everyone, everywhere, could pay the tolls