Evaluate

WirelessMathBench-XL: An Auditable Benchmark for Wireless Mathematical Reasoning

Xin Li, Mengbing Liu, Yiyang Zhu, Wenhe Zhang, Li Wei, Jiancheng An, Chau Yuen

A benchmark that ships its own audit: every problem carries 13-gram contamination-overlap evidence against public pretraining text. 4,027 problems drawn from 836 arXiv papers across 20 wireless subfields; frontier models cluster at 86.5–91.3%.

Scope A rerunnable audit producing per-problem evidence for one lexical channel — not a proof that the benchmark is clean.

ProjectarXiv

Local Success Does Not Compose: Benchmarking Large Language Models for Compositional Formal Verification

Xu Xu^*, Xin Li^*, Xingwei Qu, Jie Fu, Binhang Yuan

A model can verify a function on its own and still fail once the specifications have to compose. The benchmark measures the distance between those two results.

ProjectOpenReviewarXiv

LiveCANNBench: Benchmark SWE AI Coding for Ascend CANN

Sijie Wang, Kai Zhao, Wee Peng Tay, Shuo Zhang, Chengwen Liu, Quanjiang Guo, Ren Junhao, Xin Li, Heng Lian, Jingdi Lei, Rui She, Huacan Wang, Ronghao Chen

400+ SWE-level task instances built from real Ascend CANN repositories — multi-file, multi-language and execution-aware — on a live benchmarking paradigm that mitigates leakage.

AnthologyPDF

RobustMAD: Evaluating Real-World Robustness of Multimodal Small Language Models for Deployable Anomaly Detection Assistants

Anushiya Arunan, Xin Li, Yan Qin, U-Xuan Tan, Nhu Khue Vuong, Xiaoli Li, Chau Yuen

ProjectOpenReviewCode

WirelessMathBench: A Mathematical Modeling Benchmark for LLMs in Wireless Communications

Xin Li, Mengbing Liu, Li Wei, Jiancheng An, Mérouane Debbah, Chau Yuen

The first benchmark for LLM mathematical reasoning in wireless communications, and the work WirelessMathBench-XL extends.

ProjectarXiv