On-device AI runs models inside your phone, tablet, or PC — enabling private, low-latency features without constant cloud calls.
On-device AI means the model executes on the same hardware you are holding or typing on — not on a remote server.
Apple Intelligence, Google Gemini Nano, and Windows Copilot+ PC features are consumer examples: transcription, photo search, and writing help that work with minimal or no cloud dependency.
On-device AI is the phone-and-laptop slice of localized AI. Developers ship it through Apple Core ML, ONNX Runtime, Qualcomm AI Engine SDK, and local runtimes like MLC LLM.