A living collection of frontier research on autonomous code agents, from the code we build to the worlds we act in.
Image Credit: ChatGPT.
🔥 We are actively tracking the frontier research of code agents.
🧹 The list below shows the past year; the full paper list holds the complete collection.
📚 Currently collected: 470 papers. (Last update: 2026-07-12)
- 🧠 Foundation Models
- 📊 Surveys & Empirical Studies
- 🧱 Code as Artifact: Building the Digital World
- 🌍 Code as Agency: Acting in the Real World
Flagship frontier models that both write code and act through it.
-
LoopCoder-v2: Only Loop Once for Efficient Test-Time Computation Scaling.
Jian Yang, Shawn Guo, Wei Zhang, Tianyu Zheng, Yaxin Du, Haau-Sing Li, Jiajun Wu, Yue Song, Yan Xing, Qingsong Cai, et al. arXiv 2026/06.
-
KAT-Coder Technical Report.
Zizheng Zhan, Ken Deng, Jinghui Wang, Xiaojiang Zhang, Huaixi Tang, Minglei Zhang, Zhiyi Lai, Haoyang Huang, Wen Xiang, Kun Wu, et al. arXiv 2025/10.
-
Kimi K2: Open Agentic Intelligence.
Kimi Team: Yifan Bai, Yiping Bao, Guanduo Chen, Jiahao Chen, Ningxin Chen, Ruijue Chen, Yanru Chen, Yuankun Chen, Yutian Chen, Zhuofu Chen, et al. arXiv 2025/07.
… plus 1 earlier paper(s): see the full list.
Research that studies and surveys code agents themselves.
-
3100 Opinions on Code Review in an AI World: Building Causal Theory from Practitioner Discourse.
Shyam Agarwal, Courtney Miller, Christian Kästner, Bogdan Vasilescu. arXiv 2026/07.
-
From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontier.
Eric Jiang, Xiao Liang, Yikai Zhang, Yingjia Wan, Mengting Li, Haikang Deng, Alexander K. Taylor, Justin Baker, Rushil Raghavan, Junyi Zhang, et al. arXiv 2026/07.
-
How Coding Agents Fail Their Users: A Large-Scale Analysis of Developer-Agent Misalignment in 20,574 Real-World Sessions.
Ningzhi Tang, Chaoran Chen, Gelei Xu, Yiyu Shi, Yu Huang, Collin McMillan, Tao Dong, Toby Jia-Jun Li. arXiv 2026/05.
-
TrajAudit: Automated Failure Diagnosis for Agentic Coding Systems.
Minxing Wang, Xiaofei Xie, Yintong Huo. arXiv 2026/05.
-
SpecBench: Measuring Reward Hacking in Long-Horizon Coding Agents.
Bingchen Zhao, Dhruv Srikanth, Yuxiang Wu, Zhengyao Jiang. arXiv 2026/05.
-
Overeager Coding Agents: Measuring Out-of-Scope Actions on Benign Tasks.
Yubin Qu, Ying Zhang, Yanjun Zhang, Gelei Deng, Yuekang Li, Leo Yu Zhang, Yi Liu. arXiv 2026/05.
-
Code as Agent Harness.
Xuying Ning, Katherine Tieu, Dongqi Fu, Tianxin Wei, Zihao Li, Yuanchen Bei, Jiaru Zou, Mengting Ai, Zhining Liu, Ting-Wei Li, et al. arXiv 2026/05.
-
SWE-chat: Coding Agent Interactions From Real Users in the Wild.
Joachim Baumann, Vishakh Padmakumar, Xiang Li, John Yang, Diyi Yang, Sanmi Koyejo. arXiv 2026/04.
-
Dive into Claude Code: The Design Space of Today's and Future AI Agent Systems.
Jiacheng Liu, Xiaohan Zhao, Xinyi Shang, Zhiqiang Shen. arXiv 2026/04.
-
CodeTracer: Towards Traceable Agent States.
Han Li, Yifan Yao, Letian Zhu, Rili Feng, Hongyi Ye, Jiaming Wang, Yancheng He, Pengyu Zou, Lehan Zhang, Xinping Lei, et al. arXiv 2026/04.
-
Programming by Chat: A Large-Scale Behavioral Analysis of 11,579 Real-World AI-Assisted IDE Sessions.
Ningzhi Tang, Chaoran Chen, Zihan Fang, Gelei Xu, Maria Dhakal, Yiyu Shi, Collin McMillan, Yu Huang, Toby Jia-Jun Li. arXiv 2026/04.
-
How Do Developers Interact with AI? An Exploratory Study on Modeling Developer Programming Behavior.
Yinan Wu, Ze Shi Li, Kathryn Thomasset Stolee, Bowen Xu. arXiv 2026/03.
-
SWE-Skills-Bench: Do Agent Skills Actually Help in Real-World Software Engineering?
Tingxu Han, Yi Zhang, Wei Song, Chunrong Fang, Zhenyu Chen, Youcheng Sun, Lijie Hu. arXiv 2026/03.
-
Fingerprinting AI Coding Agents on GitHub.
Taher A. Ghaleb. arXiv 2026/01.
-
Agent READMEs: An Empirical Study of Context Files for Agentic Coding.
Worawalan Chatlatanagulchai, Hao Li, Yutaro Kashiwa, Brittany Reid, Kundjanasith Thonglek, Pattara Leelaprute, Arnon Rungsawang, Bundit Manaskasemsak, Bram Adams, Ahmed E. Hassan, et al. arXiv 2025/11.
-
Does AI-Assisted Coding Deliver? A Difference-in-Differences Study of Cursor's Impact on Software Projects.
Hao He, Courtney Miller, Shyam Agarwal, Christian Kästner, Bogdan Vasilescu. arXiv 2025/11.
-
A Comprehensive Empirical Evaluation of Agent Frameworks on Code-centric Software Engineering Tasks.
Zhuowen Yin, Cuifeng Gao, Chunsong Fan, Wenzhang Yang, Yinxing Xue, Lijun Zhang. arXiv 2025/11.
-
A Survey of Vibe Coding with Large Language Models.
Yuyao Ge, Lingrui Mei, Zenghao Duan, Tianhao Li, Yujia Zheng, Yiwei Wang, Lexin Wang, Jiayu Yao, Tianyu Liu, Yujun Cai, et al. arXiv 2025/10.
-
How can we assess human-agent interactions? Case studies in software agent design.
Valerie Chen, Rohit Malhotra, Xingyao Wang, Juan Michelini, Xuhui Zhou, Aditya Bharat Soni, Hoang H. Tran, Calvin Smith, Ameet Talwalkar, Graham Neubig. arXiv 2025/10.
-
A Comprehensive Survey on Benchmarks and Solutions in Software Engineering of LLM-Empowered Agentic System.
Jiale Guo, Suizhi Huang, Mei Li, Dong Huang, Xingsheng Chen, Regina Zhang, Zhijiang Guo, Han Yu, Siu-Ming Yiu, Christian Jensen, et al. arXiv 2025/10.
-
On the Use of Agentic Coding: An Empirical Study of Pull Requests on GitHub.
Miku Watanabe, Hao Li, Yutaro Kashiwa, Brittany Reid, Hajimu Iida, Ahmed E. Hassan. arXiv 2025/09.
-
Agentic Software Engineering: Foundational Pillars and a Research Roadmap.
Ahmed E. Hassan, Hao Li, Dayi Lin, Bram Adams, Tse-Hsun Chen, Yutaro Kashiwa, Dong Qiu. arXiv 2025/09.
-
"My productivity is boosted, but ..." Demystifying Users' Perception on AI Coding Assistants.
Yunbo Lyu, Zhou Yang, Jieke Shi, Jianming Chang, Yue Liu, David Lo. ASE 2025.
-
A Survey on Code Generation with LLM-based Agents.
Yihong Dong, Xue Jiang, Jiaru Qian, Tian Wang, Kechi Zhang, Zhi Jin, Ge Li. arXiv 2025/07.
-
The Rise of AI Teammates in Software Engineering (SE) 3.0: How Autonomous Coding Agents Are Reshaping Software Engineering.
Hao Li, Haoxiang Zhang, Ahmed E. Hassan. arXiv 2025/07.
-
Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity.
Joel Becker, Nate Rush, Elizabeth Barnes, David Rein. arXiv 2025/07.
… plus 9 earlier paper(s): see the full list.
Agents that build software, from one function to an entire system.
Writing and maintaining general-purpose software.
Reproducing, locating, and fixing reported bugs.
-
AgentLens: Production-Assessed Trajectory Reviews for Coding Agent Evaluation.
Andrey Podivilov, Vadim Lomshakov, Sergey Savin, Matvei Startsev, Roman Pozharskiy, Maksim Parshin, Sergey Nikolenko. arXiv 2026/07.
-
Dockerless: Environment-Free Program Verifier for Coding Agents.
Wenhao Zeng, Yuling Shi, Xiaodong Gu, Chao Hu, Chaofan Wang, Yuhao Cui, Hongting Zhou, Mengnan Qi, Jianqiao Wangni, Zhaojian Yu, et al. arXiv 2026/06.
-
FastContext: Training Efficient Repository Explorer for Coding Agents.
Shaoqiu Zhang, Maoquan Wang, Yuling Shi, Yuhang Wang, Xiaodong Gu, Yongqiang Yao, Tori Gong, Sheng Chen, Rao Fu, Anisha Agarwal, et al. arXiv 2026/06.
-
Claw-SWE-Bench: A Benchmark for Evaluating OpenClaw-style Agent Harnesses on Coding Tasks.
Mengyu Zheng, Kai Han, Boxun Li, Haiyang Xu, Yuchuan Tian, Wei He, Hang Zhou, Jianyuan Guo, Hailin Hu, Lin Ma, et al. arXiv 2026/06.
-
SWE-Explore: Benchmarking How Coding Agents Explore Repositories.
Shaoqiu Zhang, Yuhang Wang, Jialiang Liang, Yuling Shi, Wenhao Zeng, Maoquan Wang, Shilin He, Ningyuan Xu, Siyu Ye, Kai Cai, et al. arXiv 2026/06.
-
CODESKILL: Learning Self-Evolving Skills for Coding Agents.
Yanzhou Li, Yiran Zhang, Xiaoyu Zhang, Xiaoxia Liu, Yang Liu. arXiv 2026/05.
-
AgentLens: Revealing The Lucky Pass Problem in SWE-Agent Evaluation.
Priyam Sahoo, Gaurav Mittal, Xiaomin Li, Shengjie Ma, Benjamin Steenhoek, Pingping Lin, Yu Hu. arXiv 2026/05.
-
TACT: Mitigating Overthinking and Overacting in Coding Agents via Activation Steering.
Yuan Sui, Yulin Chen, Yibo Li, Xue Jiang, Yufei He, Yihong Dong, Xiaoxin He, Tianyu Gao, Bryan Hooi. arXiv 2026/05.
-
Empowering Autonomous Debugging Agents with Efficient Dynamic Analysis.
Jiahong Xiang, Xiaoyang Xu, Xiaopan Chu, Hongliang Tian, Yuqun Zhang. arXiv 2026/04.
-
Asking What Matters: Reward-Driven Clarification for Software Engineering Tasks.
Sanidhya Vijayvargiya, Vijay Viswanathan, Graham Neubig. arXiv 2026/04.
-
Scaling Test-Time Compute for Agentic Coding.
Joongwon Kim, Wannan Yang, Kelvin Niu, Hongming Zhang, Yun Zhu, Eryk Helenowski, Ruan Silva, Zhengxing Chen, Srinivasan Iyer, Manzil Zaheer, et al. arXiv 2026/04.
-
How and Why Agents Can Identify Bug-Introducing Commits.
Niklas Risse, Marcel Böhme. arXiv 2026/03.
-
Coherence Collapse: Diagnosing Why Code Agents Fail After Reaching the Right Code.
Myeongsoo Kim, Dingmin Wang, Siwei Cui, Farima Farmahinifarahani, Terry Yue Zhuo, Shweta Garg, Baishakhi Ray, Rajdeep Mukherjee, Varun Kumar. arXiv 2026/03.
-
SWE-Next: Scalable Real-World Software Engineering Tasks for Agents.
Jiarong Liang, Zhiheng Lyu, Zijie Liu, Xiangchao Chen, Ping Nie, Kai Zou, Wenhu Chen. arXiv 2026/03.
-
daVinci-Env: Open SWE Environment Synthesis at Scale.
Dayuan Fu, Shenyu Wu, Yunze Wu, Zerui Peng, Yaxing Huang, Jie Sun, Ji Zeng, Mohan Jiang, Lin Zhang, Yukun Li, et al. arXiv 2026/03.
-
BeyondSWE: Can Current Code Agent Survive Beyond Single-Repo Bug Fixing?
Guoxin Chen, Fanzhe Meng, Jiale Zhao, Minghao Li, Daixuan Cheng, Huatong Song, Jie Chen, Yuzhi Lin, Hui Chen, Xin Zhao, et al. arXiv 2026/03.
-
SWE-ABS: Adversarial Benchmark Strengthening Exposes Inflated Success Rates on Test-based Benchmark.
Boxi Yu, Yang Cao, Yuzhong Zhang, Liting Lin, Junjielong Xu, Zhiqing Zhong, Qinghua Xu, Guancheng Wang, Jialun Cao, Shing-Chi Cheung, et al. arXiv 2026/02.
-
SWE-rebench V2: Language-Agnostic SWE Task Collection at Scale.
Ibragim Badertdinov, Maksim Nekrashevich, Anton Shevtsov, Alexander Golubev. arXiv 2026/02.
-
SWE-MiniSandbox: Container-Free Reinforcement Learning for Building Software Engineering Agents.
Danlong Yuan, Wei Wu, Enhan Zhao, Zhengren Wang, Xueliang Zhao, Huishuai Zhang, Dongyan Zhao. arXiv 2026/02.
-
Immersion in the GitHub Universe: Scaling Coding Agents to Mastery.
Jiale Zhao, Guoxin Chen, Fanzhe Meng, Minghao Li, Jie Chen, Hui Xu, Yongshuai Sun, Wayne Xin Zhao, Ruihua Song, Yuan Zhang, et al. arXiv 2026/02.
-
Rethinking the Value of Agent-Generated Tests for LLM-Based Software Engineering Agents.
Zhi Chen, Zhensu Sun, Yuling Shi, Chao Peng, Xiaodong Gu, David Lo, Lingxiao Jiang. arXiv 2026/02.
-
SWE-Universe: Scale Real-World Verifiable Environments to Millions.
Mouxiang Chen, Lei Zhang, Yunlong Feng, Xuwu Wang, Wenting Zhao, Ruisheng Cao, Jiaxi Yang, Jiawei Chen, Mingze Li, Zeyao Ma, et al. arXiv 2026/02.
-
Closing the Loop: Universal Repository Representation with RPG-Encoder.
Jane Luo, Chengyu Yin, Xin Zhang, Qingtao Li, Steven Liu, Yiming Huang, Jie Wu, Hao Liu, Yangyu Huang, Yu Kang, et al. arXiv 2026/02.
-
SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolving.
Chaofan Tao, Jierun Chen, Yuxin Jiang, Kaiqi Kou, Shaowei Wang, Ruoyu Wang, Xiaohui Li, Sidi Yang, Yiming Du, Jianbo Dai, et al. arXiv 2026/01.
-
Toward Training Superintelligent Software Agents through Self-Play SWE-RL.
Yuxiang Wei, Zhiqing Sun, Emily McMilin, Jonas Gehring, David Zhang, Gabriel Synnaeve, Daniel Fried, Lingming Zhang, Sida Wang. arXiv 2025/12.
-
Confucius Code Agent: Scalable Agent Scaffolding for Real-World Codebases.
Zhaodong Wang, Zhenting Qi, Sherman Wong, Nathan Hu, Samuel Lin, Jun Ge, Erwin Gao, Wenlin Chen, Yilun Du, Minlan Yu, et al. arXiv 2025/12.
-
InfCode: Adversarial Iterative Refinement of Tests and Patches for Reliable Software Issue Resolution.
KeFan Li, Mengfei Wang, Hengzhi Zhang, Zhichao Li, Yuan Yuan, Mu Li, Xiang Gao, Hailong Sun, Chunming Hu, Weifeng Lv. arXiv 2025/11.
-
Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?
Chunqiu Steven Xia, Zhe Wang, Yan Yang, Yuxiang Wei, Lingming Zhang. arXiv 2025/11.
-
SWE-Compass: Towards Unified Evaluation of Agentic Coding Abilities for Large Language Models.
Jingxuan Xu, Ken Deng, Weihao Li, Songwei Yu, Huaixi Tang, Haoyang Huang, Zhiyi Lai, Zizheng Zhan, Yanan Wu, Chenchen Zhang, et al. arXiv 2025/11.
-
The OpenHands Software Agent SDK: A Composable and Extensible Foundation for Production Agents.
Xingyao Wang, Simon Rosenberg, Juan Michelini, Calvin Smith, Hoang Tran, Engel Nyst, Rohit Malhotra, Xuhui Zhou, Valerie Chen, Robert Brennan, et al. arXiv 2025/11.
-
SWE-Sharp-Bench: A Reproducible Benchmark for C# Software Engineering Tasks.
Sanket Mhatre, Yasharth Bajpai, Sumit Gulwani, Emerson Murphy-Hill, Gustavo Soares. arXiv 2025/11.
-
HAFixAgent: History-Aware Automated Program Repair Agent.
Yu Shi, Hao Li, Bram Adams, Ahmed E. Hassan. arXiv 2025/11.
-
Understanding Code Agent Behaviour: An Empirical Study of Success and Failure Trajectories.
Oorja Majgaonkar, Zhiwei Fei, Xiang Li, Federica Sarro, He Ye. arXiv 2025/10.
-
TDFlow: Agentic Workflows for Test Driven Software Engineering.
Kevin Han, Siddharth Maddikayala, Tim Knappe, Om Patel, Austen Liao, Amir Barati Farimani. arXiv 2025/10.
-
BugPilot: Complex Bug Generation for Efficient Learning of SWE Skills.
Atharv Sonwane, Isadora White, Hyunji Lee, Matheus Pereira, Lucas Caccia, Minseon Kim, Zhengyan Shi, Chinmay Singh, Alessandro Sordoni, Marc-Alexandre Côté, et al. arXiv 2025/10.
-
When Old Meets New: Evaluating the Impact of Regression Tests on SWE Issue Resolution.
Yang Chen, Toufique Ahmed, Reyhaneh Jabbarvand, Martin Hirzel. arXiv 2025/10.
-
More with Less: An Empirical Study of Turn-Control Strategies for Efficient Coding Agents.
Pengfei Gao, Chao Peng. arXiv 2025/10.
-
SIADAFIX: issue description response for adaptive program repair.
Xin Cao, Nan Yu. arXiv 2025/10.
-
Lingxi: Repository-Level Issue Resolution Framework Enhanced by Procedural Knowledge Guided Scaling.
Xu Yang, Jiayuan Zhou, Michael Pacheco, Wenhan Zhu, Pengfei He, Shaowei Wang, Kui Liu, Ruiqi Pan. arXiv 2025/10.
-
Saving SWE-Bench: A Benchmark Mutation Approach for Realistic Agent Evaluation.
Spandan Garg, Ben Steenhoek, Yufan Huang. arXiv 2025/10.
-
REFINE: Enhancing Program Repair Agents through Context-Aware Patch Refinement.
Anvith Pabba, Simin Chen, Alex Mathai, Anindya Chakraborty, Baishakhi Ray. arXiv 2025/10.
-
Abstain and Validate: A Dual-LLM Policy for Reducing Noise in Agentic Program Repair.
José Cambronero, Michele Tufano, Sherry Shi, Renyao Wei, Grant Uy, Runxiang Cheng, Chin-Jung Liu, Shiying Pan, Satish Chandra, Pat Rondon. arXiv 2025/10.
-
Improving Code Localization with Repository Memory.
Boshi Wang, Weijian Xu, Yunsheng Li, Mei Gao, Yujia Xie, Huan Sun, Dongdong Chen. arXiv 2025/10.
-
ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memory.
Siru Ouyang, Jun Yan, I-Hung Hsu, Yanfei Chen, Ke Jiang, Zifeng Wang, Rujun Han, Long T. Le, Samira Daruki, Xiangru Tang, et al. arXiv 2025/09.
-
Kimi-Dev: Agentless Training as Skill Prior for SWE-Agents.
Zonghan Yang, Shengjie Wang, Kelin Fu, Wenyang He, Weimin Xiong, Yibo Liu, Yibo Miao, Bofei Gao, Yejie Wang, Yingwei Ma, et al. arXiv 2025/09.
-
A Benchmark for Localizing Code and Non-Code Issues in Software Projects.
Zejun Zhang, Jian Wang, Qingyun Yang, Yifan Pan, Yi Tang, Yi Li, Zhenchang Xing, Tian Zhang, Xuandong Li, Guoan Zhang. arXiv 2025/09.
-
Extracting Conceptual Knowledge to Locate Software Issues.
Ying Wang, Wenjun Mao, Chong Wang, Zhenhao Zhou, Yicheng Zhou, Wenyun Zhao, Yiling Lou, Xin Peng. arXiv 2025/09.
-
SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
Xiang Deng, Jeff Da, Edwin Pan, Yannis Yiming He, Charles Ide, Kanak Garg, Niklas Lauffer, Andrew Park, Nitin Pasari, Chetan Rane, et al. arXiv 2025/09.
-
An Empirical Study on Failures in Automated Issue Solving.
Simiao Liu, Fang Liu, Liehao Li, Xin Tan, Yinghao Zhu, Xiaoli Lian, Li Zhang. arXiv 2025/09.
-
SWE-Effi: Re-Evaluating Software AI Agent System Effectiveness Under Resource Constraints.
Zhiyu Fan, Kirill Vasilevski, Dayi Lin, Boyuan Chen, Yihao Chen, Zhiqing Zhong, Jie M. Zhang, Pinjia He, Ahmed E. Hassan. arXiv 2025/09.
-
SWE-Mirror: Scaling Issue-Resolving Datasets by Mirroring Issues Across Repositories.
Junhao Wang, Daoguang Zan, Shulin Xin, Siyao Liu, Yurong Wu, Kai Shen. arXiv 2025/09.
-
Automated Generation of Issue-Reproducing Tests by Combining LLMs and Search-Based Testing.
Konstantinos Kitsios, Marco Castelluccio, Alberto Bacchelli. ASE 2025.
-
Execution-Feedback Driven Test Generation from SWE Issues.
Toufique Ahmed, Jatin Ganhotra, Avraham Shinnar, Martin Hirzel. arXiv 2025/08.
-
Tool-integrated Reinforcement Learning for Repo Deep Search.
Zexiong Ma, Chao Peng, Qunhong Zeng, Pengfei Gao, Yanzhen Zou, Bing Xie. arXiv 2025/08.
-
Training Long-Context, Multi-Turn Software Engineering Agents with Reinforcement Learning.
Alexander Golubev, Maria Trofimova, Sergei Polezhaev, Ibragim Badertdinov, Maksim Nekrashevich, Anton Shevtsov, Simon Karasik, Sergey Abramov, Andrei Andriushchenko, Filipp Fisin, et al. arXiv 2025/08.
-
SE-Agent: Self-Evolution Trajectory Optimization in Multi-Step Reasoning with LLM-Based Agents.
Jiaye Lin, Yifu Guo, Yuzhen Han, Sen Hu, Ziyi Ni, Licheng Wang, Mingguang Chen, Hongzhang Liu, Ronghao Chen, Yangfan He, et al. NeurIPS 2025.
-
RepoForge: Training a SOTA Fast-thinking SWE Agent with an End-to-End Data Curation Pipeline Synergizing SFT and RL at Scale.
Zhilong Chen, Chengzong Zhao, Boyuan Chen, Dayi Lin, Yihao Chen, Arthur Leung, Gopi Krishnan Rajbahadur, Gustavo Oliva, Haoxiang Zhang, Aadi Bhatia, et al. arXiv 2025/08.
-
Leveraging Large Language Model for Information Retrieval-based Bug Localization.
Moumita Asad, Rafed Muhammad Yasir, Sam Malek. arXiv 2025/08.
-
Trae Agent: An LLM-based Agent for Software Engineering with Test-time Scaling.
Trae Research Team: Pengfei Gao, Zhao Tian, Xiangxin Meng, Xinchen Wang, Ruida Hu, Yuanan Xiao, Yizhou Liu, Zhao Zhang, Junjie Chen, Cuiyun Gao, et al. arXiv 2025/07.
-
SWE-Exp: Experience-Driven Software Issue Resolution.
Silin Chen, Shaoxin Lin, Xiaodong Gu, Yuling Shi, Heng Lian, Longfei Yun, Dong Chen, Weiguo Sun, Lin Cao, Qianxiang Wang. arXiv 2025/07.
-
SWE-Debate: Competitive Multi-Agent Debate for Software Issue Resolution.
Han Li, Yuling Shi, Shaoxin Lin, Xiaodong Gu, Heng Lian, Xin Wang, Yantao Jia, Tao Huang, Qianxiang Wang. arXiv 2025/07.
-
AutoCodeSherpa: Symbolic Explanations in AI Coding Agents.
Sungmin Kang, Haifeng Ruan, Abhik Roychoudhury. arXiv 2025/07.
-
Prometheus: Unified Knowledge Graphs for Issue Resolution in Multilingual Codebases.
Zimin Chen, Yue Pan, Siyu Lu, Jiayi Xu, Claire Le Goues, Martin Monperrus, He Ye. arXiv 2025/07.
-
Agentic Program Repair from Test Failures at Scale: A Neuro-symbolic approach with static analysis and test execution feedback.
Chandra Maddila, Adam Tait, Claire Chang, Daniel Cheng, Nauman Ahmad, Vijayaraghavan Murali, Marshall Roch, Arnaud Avondet, Aaron Meltzer, Victor Montalvao, et al. TSE 2025.
-
AssertFlip: Reproducing Bugs via Inversion of LLM-Generated Passing Tests.
Lara Khatib, Noble Saji Mathews, Meiyappan Nagappan. arXiv 2025/07.
-
SWE-MERA: A Dynamic Benchmark for Agenticly Evaluating Large Language Models on Software Engineering Tasks.
Pavel Adamenko, Mikhail Ivanov, Aidar Valeev, Rodion Levichev, Pavel Zadorozhny, Ivan Lopatin, Dmitry Babayev, Alena Fenogenova, Valentin Malykh. arXiv 2025/07.
-
SPICE: An Automated SWE-Bench Labeling Pipeline for Issue Clarity, Test Coverage, and Effort Estimation.
Gustavo A. Oliva, Gopi Krishnan Rajbahadur, Aaditya Bhatia, Haoxiang Zhang, Yihao Chen, Zhilong Chen, Arthur Leung, Dayi Lin, Boyuan Chen, Ahmed E. Hassan. ASE 2025.
… plus 86 earlier paper(s): see the full list.
Generating and completing code, from a function to a whole repository.
-
ATM: CID-Brokered Pre-Write Admission for Multi-Agent Code Co-Synthesis.
Eagl Huang. arXiv 2026/06.
-
DeNovoSWE: Scaling Long-Horizon Environments for Generating Entire Repositories from Scratch.
Jiale Zhao, Guoxin Chen, Fanzhe Meng, Wayne Xin Zhao, Ruihua Song, Ji-Rong Wen, Kai Jia. arXiv 2026/06.
-
Code2LoRA: Hypernetwork-Generated Adapters for Code Language Models under Software Evolution.
Liliana Hotsko, Yinxi Li, Yuntian Deng, Pengyu Nie. arXiv 2026/06.
-
CoRe-Code: Collaborative Reinforcement Learning for Code Generation.
Zhihao Dou, Qinjian Zhao, Zhongwei Wan, Xiaoyu Xia, Sumon Biswas. arXiv 2026/05.
-
RepoZero: Can LLMs Generate a Code Repository from Scratch?
Zhaoxi Zhang, Yiming Xu, Jiahui Liang, Weikang Li, Xiaoshuai Chen, Liwei Qian, Xin Pei, Jizhou Huang, Run Sun, Yunfang Wu. arXiv 2026/05.
-
PlayCoder: Making LLM-Generated GUI Code Playable.
Zhiyuan Peng, Wei Tao, Xin Yin, Chenhao Ying, Yuan Luo, Yiwen Guo. arXiv 2026/04.
-
Benchmarking PhD-Level Coding in 3D Geometric Computer Vision.
Wenyi Li, Renkai Luo, Yue Yu, Huan-ang Gao, Mingju Gao, Li Yuan, Chaoyou Fu, Hao Zhao. arXiv 2026/03.
-
InCoder-32B: Code Foundation Model for Industrial Scenarios.
Jian Yang, Wei Zhang, Jiajun Wu, Junhang Cheng, Shawn Guo, Haowen Wang, Weicheng Gu, Yaxin Du, Joseph Li, Fanglin Xu, et al. arXiv 2026/03.
-
SWE-AGI: Benchmarking Specification-Driven Software Construction with MoonBit in the Era of Autonomous Agents.
Zhirui Zhang, Hongbo Zhang, Haoxiang Fei, Zhiyuan Bao, Yubin Chen, Zhengyu Lei, Ziyue Liu, Yixuan Sun, Mingkun Xiao, Zihang Ye, et al. arXiv 2026/02.
-
DevBench: A Realistic, Developer-Informed Benchmark for Code Generation Models.
Adarsh Kumarappan, Pareesa Ameneh Golnari, Wen Wen, Xiaoyu Liu, Gabriel Ryan, Yuting Sun, Shengyu Fu, Elsie Nallipogu. arXiv 2026/01.
-
Smarter Together: Creating Agentic Communities of Practice through Shared Experiential Learning.
Valentin Tablan, Scott Taylor, Gabriel Hurtado, Kristoffer Bernhem, Anders Uhrenholt, Gabriele Farei, Karo Moilanen. arXiv 2025/11.
-
Towards Realistic Project-Level Code Generation via Multi-Agent Collaboration and Semantic Architecture Modeling.
Qianhui Zhao, Li Zhang, Fang Liu, Junhang Cheng, Chengru Wu, Junchen Ai, Qiaoyuanhe Meng, Lichen Zhang, Xiaoli Lian, Shubin Song, et al. arXiv 2025/11.
-
JanusCoder: Towards a Foundational Visual-Programmatic Interface for Code Intelligence.
Qiushi Sun, Jingyang Gong, Yang Liu, Qiaosheng Chen, Lei Li, Kai Chen, Qipeng Guo, Ben Kao, Fei Yuan. arXiv 2025/10.
-
SpecAgent: A Speculative Retrieval and Forecasting Agent for Code Completion.
George Ma, Anurag Koul, Qi Chen, Yawen Wu, Sachit Kuhar, Yu Yu, Aritra Sengupta, Varun Kumar, Murali Krishna Ramanathan. arXiv 2025/10.
-
Vibe Checker: Aligning Code Evaluation with Human Preference.
Ming Zhong, Xiang Zhou, Ting-Yun Chang, Qingze Wang, Nan Xu, Xiance Si, Dan Garrette, Shyam Upadhyay, Jeremiah Liu, Jiawei Han, et al. arXiv 2025/10.
-
Retrieval-Augmented Code Generation: A Survey with Focus on Repository-Level Approaches.
Yicheng Tao, Yao Qin, Yepang Liu. arXiv 2025/10.
-
CWM: An Open-Weights LLM for Research on Code Generation with World Models.
FAIR CodeGen team, Jade Copet, Quentin Carbonneaux, Gal Cohen, Jonas Gehring, Jacob Kahn, Jannik Kossen, Felix Kreuk, Emily McMilin, Michel Meyer, et al. arXiv 2025/09.
-
RPG: A Repository Planning Graph for Unified and Scalable Codebase Generation.
Jane Luo, Xin Zhang, Steven Liu, Jie Wu, Jianfeng Liu, Yiming Huang, Yangyu Huang, Chengyu Yin, Ying Xin, Yuefeng Zhan, et al. arXiv 2025/09.
-
GRACE: Graph-Guided Repository-Aware Code Completion through Hierarchical Code Fusion.
Xingliang Wang, Baoyi Wang, Chen Zhi, Junxiao Han, Xinkui Zhao, Jianwei Yin, Shuiguang Deng. arXiv 2025/09.
-
VisCodex: Unified Multimodal Code Generation via Merging Vision and Coding Models.
Lingjie Jiang, Shaohan Huang, Xun Wu, Yixia Li, Dongdong Zhang, Furu Wei. arXiv 2025/08.
-
Next Edit Prediction: Learning to Predict Code Edits from Context and Interaction History.
Ruofan Lu, Yintong Huo, Meng Zhang, Yichen Li, Michael R. Lyu. arXiv 2025/08.
-
SimdBench: Benchmarking Large Language Models for SIMD-Intrinsic Code Generation.
Yibo He, Shuoran Zhao, Jiaming Huang, Yingjie Fu, Hao Yu, Cunjian Huang, Tao Xie. arXiv 2025/07.
… plus 39 earlier paper(s): see the full list.
Setting up environments, builds, CI/CD, and version control.
-
SetupX: Can LLM Agents Learn from Past Failures in Functionality-Correct Code Repository Setup?
Zihang Zhou, Ziqian Ren, Yukai Wu, Yingjie Xiong, Wei Zhou, Chao Peng, Dong Zhang, Bingheng Yan, Xuanhe Zhou, Fan Wu. arXiv 2026/05.
-
DevOps-Gym: Benchmarking AI Agents in Software DevOps Cycle.
Yuheng Tang, Kaijie Zhu, Bonan Ruan, Chuqi Zhang, Michael Yang, Hongwei Li, Suyue Guo, Tianneng Shi, Zekun Li, Christopher Kruegel, et al. arXiv 2026/01.
-
Exploring and Unleashing the Power of Large Language Models in CI/CD Configuration Translation.
Chong Wang, Chen Zhang, Jiajun Wu, Wunan Guo, Jianfeng Qu, Yewen Tian, Yang Liu. arXiv 2025/11.
-
Can Language Models Go Beyond Coding? Assessing the Capability of Language Models to Build Real-World Systems.
Chenyu Zhao, Shenglin Zhang, Zeshun Huang, Weilin Jin, Yongqian Sun, Dan Pei, Chaoyun Zhang, Qingwei Lin, Chetan Bansal, Saravan Rajmohan, et al. arXiv 2025/11.
-
Process-Level Trajectory Evaluation for Environment Configuration in Software Engineering Agents.
Jiayi Kuang, Yinghui Li, Xin Zhang, Yangning Li, Di Yin, Xing Sun, Ying Shen, Philip S. Yu. arXiv 2025/10.
… plus 12 earlier paper(s): see the full list.
Refactoring, migrating, and optimizing existing code.
-
SWE-CI: Evaluating Agent Capabilities in Maintaining Codebases via Continuous Integration.
Jialong Chen, Xander Xu, Hu Wei, Chuan Chen, Bing Zhao. arXiv 2026/03.
-
Controlled Self-Evolution for Algorithmic Code Optimization.
Tu Hu, Ronghao Chen, Shuo Zhang, Jianghao Yin, Mou Xiao Feng, Jingping Liu, Shaolei Zhang, Wenqi Jiang, Yuqi Fang, Sen Hu, et al. arXiv 2026/01.
-
RefAgent: A Multi-agent LLM-based Framework for Automatic Software Refactoring.
Khouloud Oueslati, Maxime Lamothe, Foutse Khomh. arXiv 2025/11.
-
What a diff makes: automating code migration with large language models.
Katherine A. Rosenfeld, Cliff C. Kerr, Jessica Lundin. arXiv 2025/10.
-
MatchFixAgent: Language-Agnostic Autonomous Repository-Level Code Translation Validation and Repair.
Ali Reza Ibrahimzada, Brandon Paulsen, Reyhaneh Jabbarvand, Joey Dodds, Daniel Kroening. arXiv 2025/09.
-
SWE-Perf: Can Language Models Optimize Code Performance on Real-World Repositories?
Xinyi He, Qian Liu, Mingzhe Du, Lin Yan, Zhijie Fan, Yiming Huang, Zejian Yuan, Zejun Ma. arXiv 2025/07.
… plus 4 earlier paper(s): see the full list.
Reviewing code changes and pull requests.
-
Automating Low-Risk Code Review at Meta: RADAR, Risk Calibration, and Review Efficiency.
Chris Adams, Arjun Singh Banga, Parveen Bansal, Souvik Bhattacharya, Rujin Cao, Pedro Canahuati, Nate Cook, Brian Ellis, Prabhakar Goyal, Gurinder Grewal, et al. arXiv 2026/05.
-
Issue-Oriented Agent-Based Framework for Automated Review Comment Generation.
Shuochuan Li, Dong Wang, Patanamon Thongtanunam, Zan Wang, Jiuqiao Yu, Junjie Chen. arXiv 2025/11.
-
Benchmarking and Studying the LLM-based Code Review.
Zhengran Zeng, Ruikai Shi, Keke Han, Yixin Li, Kaicheng Sun, Yidong Wang, Zhuohao Yu, Rui Xie, Wei Ye, Shikun Zhang. arXiv 2025/09.
… plus 4 earlier paper(s): see the full list.
Detecting and fixing security vulnerabilities in code.
-
VulnLLM-R: Specialized Reasoning LLM with Agent Scaffold for Vulnerability Detection.
Yuzhou Nie, Hongwei Li, Chengquan Guo, Ruizhe Jiang, Zhun Wang, Bo Li, Dawn Song, Wenbo Guo. arXiv 2025/12.
-
Is Vibe Coding Safe? Benchmarking Vulnerability of Agent-Generated Code in Real-World Tasks.
Songwen Zhao, Danqing Wang, Kexun Zhang, Jiaxuan Luo, Zhuo Li, Lei Li. arXiv 2025/12.
-
When “Correct” Is Not Safe: Can We Trust Functionally Correct Patches Generated by Code Agents?
Yibo Peng, James Song, Lei Li, Xinyu Yang, Mihai Christodorescu, Ravi Mangal, Corina Pasareanu, Haizhong Zheng, Beidi Chen. arXiv 2025/10.
-
From Trace to Line: LLM Agent for Real-World OSS Vulnerability Localization.
Haoran Xi, Minghao Shao, Brendan Dolan-Gavitt, Muhammad Shafique, Ramesh Karri. arXiv 2025/09.
-
SecureAgentBench: Benchmarking Secure Code Generation under Realistic Vulnerability Scenarios.
Junkai Chen, Huihui Huang, Yunbo Lyu, Junwen An, Jieke Shi, Chengran Yang, Ting Zhang, Haoye Tian, Yikun Li, Zhenhao Li, et al. arXiv 2025/09.
-
Locus: Agentic Predicate Synthesis for Directed Fuzzing.
Jie Zhu, Chihao Shen, Ziyang Li, Jiahao Yu, Yizheng Chen, Kexin Pei. arXiv 2025/08.
… plus 4 earlier paper(s): see the full list.
Understanding, documenting, and searching code.
-
SWE Atlas: Benchmarking Coding Agents Beyond Issue Resolution.
Mohit Raghavendra, Soham Dan, Miguel Romero Calvo, Yannis Yiming He, Johannes Baptist Mols, Gautam Anand, Cole McCollum, Edgar Arakelyan, Vijay Bharadwaj, Andrew Park, et al. arXiv 2026/05.
-
Lost in Code Generation: Reimagining the Role of Software Models in AI-driven Software Engineering.
Jürgen Cito, Dominik Bork. arXiv 2025/11.
-
Gistify! Codebase-Level Understanding via Runtime Execution.
Hyunji Lee, Minseon Kim, Chinmay Singh, Matheus Pereira, Atharv Sonwane, Isadora White, Elias Stengel-Eskin, Mohit Bansal, Zhengyan Shi, Alessandro Sordoni, et al. arXiv 2025/10.
-
RANGER: Repository-Level Agent for Graph-Enhanced Retrieval.
Pratik Shah, Rajat Ghosh, Aryan Singhal, Debojyoti Dutta. arXiv 2025/09.
-
SWE-QA: Can Language Models Answer Repository-level Code Questions?
Weihan Peng, Yuling Shi, Yuhang Wang, Xinyun Zhang, Beijun Shen, Xiaodong Gu. arXiv 2025/09.
… plus 5 earlier paper(s): see the full list.
Writing tests and finding bugs before release.
-
Sakura: An Approach for Generating Complex Tests from Natural Language Test Descriptions.
Tyler Stennett, Rangeet Pan, Bridget McGinn, Alessandro Orso, Saurabh Sinha. arXiv 2026/05.
-
SWE-Mutation: Can LLMs Generate Reliable Test Suites in Software Engineering?
Yuxuan Sun, Yuze Zhao, Yufeng Wang, Yao Du, Zhiyuan Ma, Jinbo Wang, Mengdi Zhang, Kai Zhang, Zhenya Huang. arXiv 2026/05.
-
WebTestPilot: Agentic End-to-End Web Testing against Natural Language Specification by Inferring Oracles with Symbolized GUI Elements.
Xiwen Teoh, Yun Lin, Duc-Minh Nguyen, Ruofei Ren, Wenjie Zhang, Jin Song Dong. arXiv 2026/02.
-
Position: Vibe Coding Needs Vibe Reasoning: Improving Vibe Coding with Formal Verification.
Jacqueline Mitchell, Yasser Shaaban. arXiv 2025/10.
-
Benchmarking LLMs for Unit Test Generation from Real-World Functions.
Dong Huang, Jie M. Zhang, Mark Harman, Qianru Zhang, Mingzhe Du, See-Kiong Ng. arXiv 2025/08.
-
Intention-Driven Generation of Project-Specific Test Cases.
Binhang Qi, Yun Lin, Xinyi Weng, Yuhuan Huang, Chenyan Liu, Hailong Sun, Zhi Jin, Jin Song Dong. arXiv 2025/07.
… plus 2 earlier paper(s): see the full list.
Adding new features to an existing codebase.
-
U2F: Encouraging SWE-Agent to Seize Novelty without Losing Feasibility.
Wencheng Ye, Yan Liu. arXiv 2025/11.
-
EvoDev: An Iterative Feature-Driven Framework for End-to-End Software Development with LLM-based Agents.
Junwei Liu, Chen Xu, Chong Wang, Tong Bai, Weitong Chen, Kaseng Wong, Yiling Lou, Xin Peng. arXiv 2025/11.
-
CodeClash: Benchmarking Goal-Oriented Software Engineering.
John Yang, Kilian Lieret, Joyce Yang, Carlos E. Jimenez, Ofir Press, Ludwig Schmidt, Diyi Yang. arXiv 2025/11.
-
Automatically Benchmarking LLM Code Agents through Agent-Driven Annotation and Evaluation.
Lingyue Fu, Bolun Zhang, Hao Guan, Yaoming Zhu, Lin Qiu, Weiwen Liu, Xuezhi Cao, Xunliang Cai, Weinan Zhang, Yong Yu. arXiv 2025/10.
-
NoCode-bench: A Benchmark for Evaluating Natural Language-Driven Feature Addition.
Le Deng, Zhonghao Jiang, Jialun Cao, Michael Pradel, Zhongxin Liu. arXiv 2025/07.
-
Think Like an Engineer: A Neuro-Symbolic Collaboration Agent for Generative Software Requirements Elicitation and Self-Review.
Sai Zhang, Zhenchang Xing, Jieshan Chen, Dehai Zhao, Zizhong Zhu, Xiaowang Zhang, Zhiyong Feng, Xiaohong Li. arXiv 2025/07.
… plus 3 earlier paper(s): see the full list.
Generating 3D models and CAD programs.
-
3DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Code.
Yipeng Gao, Lei Shu, Genzhi Ye, Xi Xiong, Ameesh Makadia, Meiqi Guo, Laurent Itti, Jindong Chen. arXiv 2026/05.
-
SceneCode: Executable World Programs for Editable Indoor Scenes with Articulated Objects.
Puyi Wang, Yuhao Wang, Linjie Li, Zhengyuan Yang, Kevin Qinghong Lin, Yangguang Li, Yu Cheng. arXiv 2026/05.
-
Code-as-Room: Generating 3D Rooms from Top-Down View Images via Agentic Code Synthesis.
Yixuan Yang, Zhen Luo, Wanshui Gan, Jinkun Hao, Junru Lu, Jinghao Yan, Zhaoyang Lyu, Xudong Xu. arXiv 2026/05.
-
Agentic Design of Compositional Machines.
Wenqian Zhang, Weiyang Liu, Zhen Liu. arXiv 2025/10.
-
MetaGen: A DSL, Database, and Benchmark for VLM-Assisted Metamaterial Generation.
Liane Makatura, Benjamin Jones, Siyuan Bian, Wojciech Matusik. arXiv 2025/08.
-
MeshCoder: LLM-Powered Structured Mesh Code Generation from Point Clouds.
Bingquan Dai, Li Ray Luo, Qihong Tang, Jie Wang, Xinyu Lian, Hao Xu, Minghan Qin, Xudong Xu, Bo Dai, Haoqian Wang, et al. arXiv 2025/08.
-
CADDesigner: Conceptual Design of CAD Models Based on General-Purpose Agent.
Jingzhe Ni, Xiaolong Yin, Xingyu Lu, Xintong Li, Ji Wei, Ruofeng Tong, Min Tang, Peng Du. arXiv 2025/08.
… plus 16 earlier paper(s): see the full list.
Building websites, front-ends, and back-end services.
-
I-WebGenBench : Evaluating Interactivity in LLM-Generated Scientific Web Applications.
Dasen Dai, Biao Wu, Meng Fang, Shuoqi Li, Wenhao Wang. arXiv 2026/05.
-
WebCompass: Towards Multimodal Web Coding Evaluation for Code Language Models.
Xinping Lei, Xinyu Che, Junqi Xiong, Chenchen Zhang, Yukai Huang, Chenyu Zhou, Haoyang Huang, Minghao Liu, Letian Zhu, Hongyi Ye, et al. arXiv 2026/04.
-
Figma2Code: Automating Multimodal Design to Code in the Wild.
Yi Gui, Jiawan Zhang, Yina Wang, Tianran Ma, Yao Wan, Shilin He, Dongping Chen, Zhou Zhao, Wenbin Jiang, Xuanhua Shi, et al. arXiv 2026/04.
-
ReLook: Vision-Grounded RL with a Multimodal LLM Critic for Agentic Web Coding.
Yuhang Li, Chenchen Zhang, Ruilin Lv, Ao Liu, Ken Deng, Yuanxing Zhang, Jiaheng Liu, Wiggin Zhou, Bo Zhou. arXiv 2025/10.
-
InteractScience: Programmatic and Visually-Grounded Evaluation of Interactive Scientific Demonstration Code Generation.
Qiaosheng Chen, Yang Liu, Lei Li, Kai Chen, Qipeng Guo, Gong Cheng, Fei Yuan. arXiv 2025/10.
-
Automatically Generating Web Applications from Requirements Via Multi-Agent Test-Driven Development.
Yuxuan Wan, Tingshuo Liang, Jiakai Xu, Jingyu Xiao, Yintong Huo, Michael R. Lyu. arXiv 2025/09.
-
WebGen-Agent: Enhancing Interactive Website Generation with Multi-Level Feedback and Step-Level Reinforcement Learning.
Zimu Lu, Houxing Ren, Yunqiao Yang, Ke Wang, Zhuofan Zong, Junting Pan, Mingjie Zhan, Hongsheng Li. arXiv 2025/09.
-
EfficientUICoder: Efficient MLLM-based UI Code Generation via Input and Output Token Compression.
Jingyu Xiao, Zhongyi Zhang, Yuxuan Wan, Yintong Huo, Yang Liu, Michael R.Lyu. arXiv 2025/09.
-
WebMMU: A Benchmark for Multimodal Multilingual Website Understanding and Code Generation.
Rabiul Awal, Mahsa Massoud, Aarash Feizi, Zichao Li, Suyuchen Wang, Christopher Pal, Aishwarya Agrawal, David Vazquez, Siva Reddy, Juan A. Rodriguez, et al. EMNLP 2025.
-
LaTCoder: Converting Webpage Design to Code with Layout-as-Thought.
Yi Gui, Zhen Li, Zhongyi Zhang, Guohao Wang, Tianpeng Lv, Gaoyang Jiang, Yi Liu, Dongping Chen, Yao Wan, Hongyu Zhang, et al. arXiv 2025/08.
-
ScreenCoder: Advancing Visual-to-Code Generation for Front-End Automation via Modular Multimodal Agents.
Yilei Jiang, Yaozhi Zheng, Yuxuan Wan, Jiaming Han, Qunzhong Wang, Michael R. Lyu, Xiangyu Yue. arXiv 2025/07.
… plus 12 earlier paper(s): see the full list.
Generating SQL queries and database code.
-
BADGER: Bridging Agentic and Deterministic Evaluation for Generative Enterprise Reasoning.
Shannon Serrao, Soumitra Chatterjee, Dorina Strori, Abhishek Sharma, Nathan Miller. arXiv 2026/06.
-
Learning to Retrieve: Dual-Level Long-Term Memory for Text-to-SQL Agents.
Yibo Wang, Nikki Lijing Kuang, Philip S. Yu, Zhewei Yao, Yuxiong He. arXiv 2026/05.
-
Rethinking Agentic Workflows: Evaluating Inference-Based Test-Time Scaling Strategies in Text2SQL Tasks.
Jiajing Guo, Kenil Patel, Jorge Piazentin Ono, Wenbin He, Liu Ren. arXiv 2025/10.
-
AGENTIQL: An Agent-Inspired Multi-Expert Framework for Text-to-SQL Generation.
Omid Reza Heidari, Siobhan Reid, Yassine Yaakoubi. arXiv 2025/10.
-
MTSQL-R1: Towards Long-Horizon Multi-Turn Text-to-SQL via Agentic Training.
Taicheng Guo, Hai Wang, ChaoChun Liu, Mohsen Golalikhani, Xin Chen, Xiangliang Zhang, Chandan K. Reddy. arXiv 2025/10.
-
Agent Bain vs. Agent McKinsey: A New Text-to-SQL Benchmark for the Business Domain.
Yue Li, Ran Tao, Derek Hommel, Yusuf Denizay Dönder, Sungyong Chang, David Mimno, Unso Eun Seo Jo. arXiv 2025/10.
… plus 1 earlier paper(s): see the full list.
Generating vector graphics, animation, and chart code.
-
Towards Reliable Agentic Progressive Text-to-Visualization with Verification Rules.
Wenxin Xu, Chen Jason Zhang, Xiaoyong Wei, Haoyang Li, Hwanhee Kim, Yuanfeng Song, Raymond Chi-Wing Wong. arXiv 2026/05.
-
From Charts to Code: A Hierarchical Benchmark for Multimodal Models.
Jiahao Tang, Henry Hengyuan Zhao, Lijian Wu, Yifei Tao, Dongxing Mao, Yang Wan, Jingru Tan, Min Zeng, Min Li, Alex Jinpeng Wang. arXiv 2025/10.
-
OpusAnimation: Code-Based Dynamic Chart Generation.
Bozheng Li, Miao Yang, Zhenhan Chen, Jiawang Cao, Mushui Liu, Yi Lu, Yongliang Wu, Bin Zhang, Yangguang Ji, Licheng Tang, et al. arXiv 2025/10.
… plus 4 earlier paper(s): see the full list.
Writing systems code: OS, kernels, compilers, networking.
-
PithTrain: A Compact and Agent-Native MoE Training System.
Ruihang Lai, Hao Kang, Haozhan Tang, Akaash R. Parthasarathy, Zichun Yu, Junru Shao, Todd C. Mowry, Chenyan Xiong, Tianqi Chen. arXiv 2026/05.
-
HTAM: Hierarchical Transition-Attended Memory for Operator Optimization.
Yining Zhang, Mingyang Yi, Chen Wang, Xuwen Xiang, Tianhe Jia, Zedong Dan, Chengqing Zong, Yue Wang. arXiv 2026/05.
-
Towards Feedback-to-Plan Decisions for Self-Evolving LLM Agents in CUDA Kernel Generation.
Yee Hin Chong, Jiaming Wu, Youhui Zhang, Peng Qu. arXiv 2026/05.
-
PerfDojo: Automated ML Library Generation for Heterogeneous Architectures.
Andrei Ivanov, Siyuan Shen, Gioele Gottardo, Marcin Chrapek, Afif Boudaoud, Timo Schneider, Luca Benini, Torsten Hoefler. arXiv 2025/11.
-
Man-Made Heuristics Are Dead. Long Live Code Generators!
Rohit Dwivedula, Divyanshu Saxena, Aditya Akella, Swarat Chaudhuri, Daehyeok Kim. arXiv 2025/10.
… plus 2 earlier paper(s): see the full list.
Generating game code and full game projects.
-
OpenGame: Open Agentic Coding for Games.
Yilei Jiang, Jinyuan Hu, Qianyin Xiao, Yaozhi Zheng, Ruize Ma, Kaituo Feng, Jiaming Han, Tianshuo Peng, Kaixuan Fan, Manyuan Zhang, et al. arXiv 2026/04.
-
90% Faster, 100% Code-Free: MLLM-Driven Zero-Code 3D Game Development.
Runxin Yang, Yuxuan Wan, Shuqing Li, Michael R. Lyu. arXiv 2025/09.
… plus 1 earlier paper(s): see the full list.
Generating hardware description code like RTL and HDL.
- Focus: Better Verilog Generation from Large Language Model via Focused Reasoning.
Zhuorui Zhao, Bing Li, Grace Li Zhang, Ulf Schlichtmann. SOCC 2025.
… plus 2 earlier paper(s): see the full list.
Agents that use code to act in the world.
Running experiments and analysis to make discoveries.
-
Can We Predict Before Executing Machine Learning Agents?
Jingsheng Zheng, Jintian Zhang, Yujie Luo, Yuren Mao, Yunjun Gao, Lun Du, Huajun Chen, Ningyu Zhang. arXiv 2026/01.
-
Deploy-Master: Automating the Deployment of 50,000+ Agent-Ready Scientific Tools in One Day.
Yi Wang, Zhenting Huang, Zhaohan Ding, Ruoxue Liao, Yuan Huang, Xinzijian Liu, Jiajun Xie, Siheng Chen, Linfeng Zhang. arXiv 2026/01.
-
ArchPilot: A Proxy-Guided Multi-Agent Approach for Machine Learning Engineering.
Zhuowen Yuan, Tao Liu, Yang Yang, Yang Wang, Feng Qi, Kaushik Rangadurai, Bo Li, Shuang Yang. arXiv 2025/11.
-
DeepAnalyze: Agentic Large Language Models for Autonomous Data Science.
Shaolei Zhang, Ju Fan, Meihao Fan, Guoliang Li, Xiaoyong Du. arXiv 2025/10.
-
Agentic generative AI for media content discovery at the national football league.
Henry Wang, Md Sirajus Salekin, Jake Lee, Ross Claytor, Shinan Zhang, Michael Chi. arXiv 2025/10.
-
MLE-Smith: Scaling MLE Tasks with Automated Multi-Agent Pipeline.
Rushi Qiang, Yuchen Zhuang, Anikait Singh, Percy Liang, Chao Zhang, Sherry Yang, Bo Dai. arXiv 2025/10.
-
LLM-Based Data Science Agents: A Survey of Capabilities, Challenges, and Future Directions.
Mizanur Rahman, Amran Bhuiyan, Mohammed Saidul Islam, Md Tahmid Rahman Laskar, Ridwan Mahbub, Ahmed Masry, Shafiq Joty, Enamul Hoque. arXiv 2025/10.
-
Reinforcement Learning for Machine Learning Engineering Agents.
Sherry Yang, Joy He-Yueya, Percy Liang. arXiv 2025/09.
-
WebDS: An End-to-End Benchmark for Web-based Data Science.
Ethan Hsu, Hong Meng Yam, Ines Bouissou, Aaron Murali John, Raj Thota, Josh Koe, Vivek Sarath Putta, G K Dharesan, Alexander Spangher, Shikhar Murty, et al. arXiv 2025/08.
… plus 17 earlier paper(s): see the full list.
Completing tasks in terminals and operating systems.
-
TUA-Bench: A Benchmark for General-Purpose Terminal-Use Agents.
Shoufa Chen, Luyuan Wang, Xuan Yang, Zhiheng Liu, Yuren Cong, Yuanfeng Ji, Feiyan Zhou, Xiaohui Zhang, Fanny Yang, Belinda Zeng. arXiv 2026/06.
-
What Makes Interaction Trajectories Effective for Training Terminal Agents?
Sidi Yang, Chaofan Tao, Jierun Chen, Tiezheng Yu, Ruoyu Wang, Yuxin Jiang, Yiming Du, Wendong Xu, Jing Xiong, Taiqiang Wu, et al. arXiv 2026/06.
-
LiteCoder-Terminal: Scaling Long-Horizon Terminal Environments for Learning Language Agents.
Xiaoxuan Peng, Kaiqi Zhang, Xinyu Lu, Boxi Cao, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun. arXiv 2026/05.
-
ECHO: Terminal Agents Learn World Models for Free.
Vaishnavi Shrivastava, Piero Kauffmann, Ahmed Awadallah, Dimitris Papailiopoulos. arXiv 2026/05.
-
TerminalWorld: Benchmarking Agents on Real-World Terminal Tasks.
Zhaoyang Chu, Jiarui Hu, Xingyu Jiang, Pengyu Zou, Han Li, Chao Peng, Peter O'Hearn, Earl T. Barr, Mark Harman, Federica Sarro, et al. arXiv 2026/05.
-
LITMUS: Benchmarking Behavioral Jailbreaks of LLM Agents in Real OS Environments.
Chiyu Zhang, Huiqin Yang, Bendong Jiang, Xiaolei Zhang, Yiran Zhao, Ruyi Chen, Lu Zhou, Xiaogang Xu, Jiafei Wu, Liming Fang, et al. arXiv 2026/05.
-
Learning CLI Agents with Structured Action Credit under Selective Observation.
Haoyang Su, Ying Wen. arXiv 2026/05.
-
MMTB: Evaluating Terminal Agents on Multimedia-File Tasks.
Chiyeong Heo, Jaechang Kim, Junhyuk Kwon, Hoyoung Kim, Dongmin Park, Jonghyun Lee, Jungseul Ok. arXiv 2026/05.
-
Terminus-4B: Can a Smaller Model Replace Frontier LLMs at Agentic Execution Tasks?
Spandan Garg, Vikram Nitin, Yufan Huang. arXiv 2026/05.
-
What Makes a Good Terminal-Agent Benchmark Task: A Guideline for Adversarial, Difficult, and Legible Evaluation Design.
Ivan Bercovich. arXiv 2026/04.
-
Toward Scalable Terminal Task Synthesis via Skill Graphs.
Zhiyuan Fan, Tinghao Yu, Yuanjun Cai, Jiangtao Guan, Yun Yang, Dingxin Hu, Jiang Zhou, Xing Wu, Zhuo Han, Feng Zhang, et al. arXiv 2026/04.
-
A Self-Evolving Framework for Efficient Terminal Agents via Observational Context Compression.
Jincheng Ren, Siwei Wu, Yizhi Li, Kang Zhu, Shu Xu, Boyu Feng, Ruibin Yuan, Wei Zhang, Riza Batista-Navarro, Jian Yang, et al. arXiv 2026/04.
-
Terminal Wrench: A Dataset of 331 Reward-Hackable Environments and 3,632 Exploit Trajectories.
Ivan Bercovich, Ivgeni Segal, Kexun Zhang, Shashwat Saxena, Aditi Raghunathan, Ziqian Zhong. arXiv 2026/04.
-
Terminal Agents Suffice for Enterprise Automation.
Patrice Bechard, Orlando Marquez Ayala, Emily Chen, Jordan Skelton, Sagar Davasam, Srinivas Sunkara, Vikas Yadav, Sai Rajeswar. arXiv 2026/03.
-
On Data Engineering for Scaling LLM Terminal Capabilities.
Renjie Pi, Grace Lam, Mohammad Shoeybi, Pooya Jannaty, Bryan Catanzaro, Wei Ping. arXiv 2026/02.
-
TermiGen: High-Fidelity Environment and Robust Trajectory Synthesis for Terminal Agents.
Kaijie Zhu, Yuzhou Nie, Yijiang Li, Yiming Huang, Jialian Wu, Jiang Liu, Ximeng Sun, Zhenfei Yin, Lun Wang, Zicheng Liu, et al. arXiv 2026/02.
-
Large-Scale Terminal Agentic Trajectory Generation from Dockerized Environments.
Siwei Wu, Yizhi Li, Yuyang Song, Wei Zhang, Yang Wang, Riza Batista-Navarro, Xian Yang, Mingjie Tang, Bryan Dai, Jian Yang, et al. arXiv 2026/02.
-
Endless Terminals: Scaling RL Environments for Terminal Agents.
Kanishk Gandhi, Shivam Garg, Noah D. Goodman, Dimitris Papailiopoulos. arXiv 2026/01.
-
Computer Environments Elicit General Agentic Intelligence in LLMs.
Daixuan Cheng, Shaohan Huang, Yuxian Gu, Huatong Song, Guoxin Chen, Li Dong, Wayne Xin Zhao, Ji-Rong Wen, Furu Wei. arXiv 2026/01.
-
Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces.
Mike A. Merrill, Alexander G. Shaw, Nicholas Carlini, Boxuan Li, Harsh Raj, Ivan Bercovich, Lin Shi, Jeong Yeon Shin, Thomas Walshe, E. Kelly Buchanan, et al. 2026.
-
Let It Flow: Agentic Crafting on Rock and Roll, Building the ROME Model within an Open Agentic Learning Ecosystem.
Weixun Wang, XiaoXiao Xu, Wanhe An, Fangwen Dai, Wei Gao, Yancheng He, Ju Huang, Qiang Ji, Hanqi Jin, Xiaoyang Li, et al. arXiv 2025/12.
-
Agent Data Protocol: Unifying Datasets for Diverse, Effective Fine-tuning of LLM Agents.
Yueqi Song, Ketan Ramaneti, Zaid Sheikh, Ziru Chen, Boyu Gou, Tianbao Xie, Yiheng Xu, Danyang Zhang, Apurva Gandhi, Fan Yang, et al. arXiv 2025/10.
-
GitTaskBench: A Benchmark for Code Agents Solving Real-World Tasks Through Code Repository Leveraging.
Ziyi Ni, Huacan Wang, Shuo Zhang, Shuo Lu, Ziyang He, Wang You, Zhenheng Tang, Yuntao Du, Bill Sun, Hongzhang Liu, et al. arXiv 2025/08.
… plus 6 earlier paper(s): see the full list.
Controlling robots and physical systems with code.
… plus 9 earlier paper(s): see the full list.
Playing games by writing and running code.
- One Life to Learn: Inferring Symbolic World Models for Stochastic Environments from Unguided Exploration.
Zaid Khan, Archiki Prasad, Elias Stengel-Eskin, Jaemin Cho, Mohit Bansal. arXiv 2025/10.
… plus 2 earlier paper(s): see the full list.
Operating web browsers to get things done online.
… plus 3 earlier paper(s): see the full list.
Operating desktop, mobile, and professional software.
-
GenClaw: Code-Driven Agentic Image Generation.
Junyan Ye, Jun He, Zilong Huang, Dongzhi Jiang, Xuan Yang, Rui Chen, Weijia Li. arXiv 2026/05.
-
OSWorld-MCP: Benchmarking MCP Tool Invocation In Computer-Use Agents.
Hongrui Jia, Jitong Liao, Xi Zhang, Haiyang Xu, Tianbao Xie, Chaoya Jiang, Ming Yan, Si Liu, Wei Ye, Fei Huang. arXiv 2025/10.
… plus 1 earlier paper(s): see the full list.
We are a young team fascinated by where code agents are headed, and we love trading ideas with the community. The field moves fast: since 2023 it has grown from autocompletion and single-function synthesis into agents that use code both to build the digital world and to act in the real one, drawing software engineering, machine learning, and every domain code touches into a single fast-moving frontier.
Code is becoming the universal medium of intelligent action. Our north star is general-purpose agents for which writing code is how they both build the digital world (software, and beyond it: web, databases, systems, hardware, games, graphics, and 3D/CAD) and act in the real world (terminals, browsers, applications, game worlds, the physical world, and scientific discovery). Not agents that merely finish a coding task, but agents that wield code as the language of creation and of agency, to understand, construct, and reshape the worlds we live and work in.
- Long-horizon planning: Reasoning and acting coherently over many steps, whether inside a large codebase or an open-ended environment.
- Grounding and environment interaction: Holding persistent, faithful context over evolving multi-file repositories and over live worlds (a terminal, a browser, a robot) where every action changes state.
- Robust evaluation: Benchmarks and metrics that reflect real-world complexity and generalization across domains and worlds, not brittle snippet-level scores.
- Generalization across domains and worlds: Agents whose skills transfer from one artifact domain, or one world of action, to the next instead of being retrained for each.
- Reliability and safety: Understandable, controllable, and safe behavior, which matters most exactly when the code an agent writes goes on to act on real systems.
- Human-agent collaboration: Fluid teamwork between people and multiple agents, with humans in the loop where it counts.
- Resource efficiency: Meeting the compute and memory demands of long, large-scale agentic work.
Major venues where code-agent research appears, by area.
- International Conference on Software Engineering (ICSE) [SE]
- Foundations of Software Engineering (FSE) [SE]
- International Conference on Automated Software Engineering (ASE) [SE]
- International Symposium on Software Testing and Analysis (ISSTA) [SE]
- Programming Language Design and Implementation (PLDI) [PL]
- Principles of Programming Languages (POPL) [PL]
- Object-Oriented Programming, Systems, Languages, and Applications (OOPSLA) [PL]
- Neural Information Processing Systems (NeurIPS) [ML]
- International Conference on Machine Learning (ICML) [ML]
- International Conference on Learning Representations (ICLR) [ML]
- Conference on Language Modeling (COLM) [ML]
- Annual Meeting of the Association for Computational Linguistics (ACL) [NLP]
- Empirical Methods in Natural Language Processing (EMNLP) [NLP]
- North American Chapter of the ACL (NAACL) [NLP]
- AAAI Conference on Artificial Intelligence (AAAI) [AI]
- International Joint Conference on Artificial Intelligence (IJCAI) [AI]
- Operating Systems Design and Implementation (OSDI) [Systems]
- Symposium on Operating Systems Principles (SOSP) [Systems]
- Architectural Support for Programming Languages and Operating Systems (ASPLOS) [Systems]
- IEEE Symposium on Security and Privacy (S&P) [Security]
- USENIX Security Symposium (USENIX Security) [Security]
- Computer and Communications Security (CCS) [Security]
- Network and Distributed System Security Symposium (NDSS) [Security]
- Knowledge Discovery and Data Mining (KDD) [Data Mining]
- Very Large Data Bases (VLDB) [Databases]
- International Conference on Management of Data (SIGMOD) [Databases]
- The Web Conference (WWW) [Web]
- International Conference on Robotics and Automation (ICRA) [Robotics]
- Conference on Robot Learning (CoRL) [Robotics]
- Robotics: Science and Systems (RSS) [Robotics]
- International Symposium on Computer Architecture (ISCA) [Hardware]
- International Symposium on Microarchitecture (MICRO) [Hardware]
- Design Automation Conference (DAC) [Hardware]
- Conference on Human Factors in Computing Systems (CHI) [HCI]
Contributing a paper takes one step: drop its arXiv abstract link in the paper inbox (issue #4).
That is all. A pipeline takes it from there: it fetches the metadata, classifies the paper into the right category, and queues it for a quick maintainer review before it appears in the list. No pull request, no template, no manual formatting. The list (categories, ordering, badges) is fully generated, so please do not edit the tables by hand: hand edits are overwritten on the next render.
You can drop several links in one comment, and anything on topic is welcome: a new paper, a technical report, or one we have missed. Suggestions for venues we should track are welcome too.
We're grateful to everyone who suggests papers and helps shape this collection.
Questions or problems? Open an issue and we will help.
- Thanks to all contributors and the research community.
- We would also like to thank the maintainers of many inspiring awesome agent repositories, including:
- awesome-llm-based-agent4code
- awesome-engineering-agents
- awesome-vibe-coding
- awesome-ai-coding-tools
- awesome-code-agents
- awesome-ai-software-development-agents
- Awesome-Repo-Level-Code-Generation
- awesome-devins
- awesome-AI-driven-development
- Awesome-Vibe-Coding
- Awesome-Code-LLM
- CodeLLMSurvey
- Awesome-Multimodal-LLM-for-Code
- awesome-copilot
- awesome-web-agents
- GUI-Agents-Paper-List
- Awesome-Agent-Papers
- LLMAgentPapers
- LLM-Agents-Papers
- Self-Evolving-Agents
- Awesome-Self-Evolving-Agents
- OS-Agent-Survey
- Awesome-AI4Research
- Awesome-LLM
- LLMSurvey
- open-llms
- LLMsPracticalGuide
- Awesome-LLM-Reasoning-with-NeSy
- Awesome-LLMOps
- Awesome-VLA-Papers
- Awesome-Neural-CAD
- Awesome-3D-Generation
- Awesome-AIGC-3D
- Awesome-Indoor-Scene-Synthesis
- Awesome-World-Model
- Awesome-World-Models
- Awesome-World-Models
- AwesomeWorldModels
- Awesome-World-Models
- awesome-llm-based-agent4code