
I have been seeing many reports/rumors that Google might be working on local on-device LLMs
The LLM feature can be a combination of on-device and cloud-based processing, but must include some on-device functionality.
ps: i will participate in this market because it is very objective - in case some subjective interpretation is required I will delegate to one of the moderators
🏅 Top traders
# | Name | Total profit |
---|---|---|
1 | Ṁ81 | |
2 | Ṁ46 | |
3 | Ṁ32 | |
4 | Ṁ19 | |
5 | Ṁ17 |
People are also trading
Resolving YES — the Pixel 9 (2024) lineup features Gemini, an on-device LLM chatbot that replaces Google Assistant. It’s powered by the Tensor G4 chip and handles many tasks directly on-device. While some features still use the cloud, the core chatbot functionality is on-device.
Sources:
@Soli As someone who works on Gemini on mobile, I don’t think this is correct. While there are on-device models, all or most “chatbot” functionality is still in the cloud. You could check it by turning the phone to flight mode and seeing what works and what doesn’t.
They've already got this in their plans, I believe: https://blog.google/products/assistant/google-assistant-bard-generative-ai/