Edge devices can’t run high performance models because they use too much power, compute and memory. For smartphones it’s a problem. But for watches, headphones, and glasses it’s a dealbreake. In smartwatches, the total SoC area is typically limited to 50-70 mm², with AI accelerators needing to fit within 2-3 mm². Power budgets for AI tasks are often constrained to 50-100 mW, necessitating performance in the range of 1-2 TOPS/W. The constraints become even more severe for devices like earbuds or glasses. In these form factors, the entire SoC, including the AI accelerator, might need to fit within 10-20 mm². Power consumption for AI tasks must be limited to 10-20 mW to maintain acceptable battery life, pushing the efficiency requirements to 5-10 TOPS/W or higher.

5.1. Edge AI Chips

5.2. Edge AI Power Management

5.3. Mobile Batteries