端侧具身智能系统:挑战与展望
On-Device Embodied Intelligence System:Challenges and Opportunities
摘要
端侧具身智能将具身大模型从云端远程推理下沉至设备本体并实现闭环执行,是机器人进入真实物理世界的关键系统基础.揭示视觉-语言-动作模型(VLA)与世界-动作模型(WAM)两类模型在多模态感知、扩散动作生成及世界模型滚动中产生的高计算与高访存开销,与端侧硬件在10~100 Hz控制频率、有限功耗及网络不稳定条件下可靠运行之间的系统性矛盾.针对该矛盾,提出以动作成功率、闭环时延与能效为共同优化目标,围绕少步化生成、动作感知压缩、缓存复用、异步分块执行与专用运行时等策略,开展算法与系统层面的协同设计.
Endowing embodied intelligence on the device side shifts large embodied models from cloud-based remote inference to on-device closed-loop execution,serving as a crucial system foundation for robots to operate in real physical environments.Two representative model families—vision-language-action models(VLA)and world-action models(WAM)—introduce high computational and memory-access overheads through multimodal perception,diffusion-based action generation,and world model rolling.These overheads create a sys-tematic contradiction with the requirements of end-side hardware,which must support 10-100 Hz control frequencies,operate under lim-ited power budgets,and maintain reliability despite unstable network conditions.To address this contradiction,action success rate,closed-loop latency,and energy efficiency are adopted as the joint optimization objectives.Algorithm-system co-design strategies are proposed,centering on few-step generation,action-aware compression,cache reuse,asynchronous chunk execution,and specialized runtimes.
年,卷(期):
2026, 32(4)
机标分类号:
S154
TP391.41
R149
在线出版日期:
2026年10月21日
基金项目:
62522202:国家自然科学基金,