Will Apple market its NPU by token/s in its September iPhone 16 announcement?
13
240Ṁ7953resolved Sep 9
Resolved
NO1D
1W
1M
ALL
When running a LLM model locally, token/s is a new metric. For example when running the open source Llama3 8B:
-a typical multi core Xeon server processor reach about 10T/s.
-RTX 2070 GPU reach 20T/s
-RTX 4070 GPU reach 40T/s
-8 Groq’s specialized LPU connected together reach 750T/s
I haven’t seen a mobile phone brand market its neural processor by token/s.
This question is managed and resolved by Manifold.
Get 
1,000 to start trading!
1,000🏅 Top traders
| # | Name | Total profit |
|---|---|---|
| 1 | Ṁ200 | |
| 2 | Ṁ65 | |
| 3 | Ṁ28 | |
| 4 | Ṁ15 | |
| 5 | Ṁ9 |
People are also trading
Related questions
Will Apple have a top tier AI tool developed in house and available to consumers by the of 2025?
28% chance
Will Apple Intelligence be a bigger value add than Google Pixel's on-phone AI on 7/1/2025?
30% chance
What will be true about the new iPhone 16?
Apple opens public APIs for using the Apple Neural Engine in 2023 or 2024?
62% chance
DID Apple announce a partnership with OpenAI regarding Siri during WWDC 2024? [PERMANENT MARKET/STOCK, DOES NOT RESOLVE]
54% chance