AI & ML interests

LLM, VLM, Omni Model, Agent, VLA

Recent Activity

Organization Card

XPENG AI logo XPENG AI

Open-source models and research for intelligent mobility.
Official Website · GitHub · X-AuT · OmniGUI


About

XPENG AI shares selected models, research, and practical tools with the open-source community. Our work explores efficient AI systems for intelligent mobility, speech, and multimodal interaction.

Featured Projects

X-AuT

Progressive Audio-Encoder Compression for Speech LLMs with Cross-Scale Distillation

X-AuT is a compact automatic speech recognition model based on Qwen3-ASR-0.6B. It reduces the audio encoder from 18 to 14 Transformer blocks through progressive compression and cross-scale knowledge transfer.

The release includes full model weights, standalone inference, and a compact LoRA finetuning example.

Resource Link
Model weights XPENG-AI/X-AuT
Project website xpeng-ai.github.io/x-aut
Source code XPENG-AI/X-AuT

OmniGUI

Benchmarking GUI Agents in Omni-Modal Smartphone Environments

OmniGUI is a step-level benchmark for GUI agents operating in smartphone environments with interleaved screenshots, audio, video, and action history. It evaluates localization, semantic understanding, cross-modal discrimination, temporal reasoning, and instant response across 29 applications.

Resource Link
Project website omni-gui.github.io
Paper arXiv:2605.18758
Source code omni-gui/OmniGUI
Dataset OmniGUI/OmniGUI

More to Come

New models and research projects will be added here as they become publicly available.

datasets 0

None public yet