Xinwei Gao

I am a Ph.D. student at the College of Computing and Data Science, Nanyang Technological University (NTU), where I am advised by Prof. Arvind Easwaran in the Cyber-Physical Systems Research Group.

My research focuses on improving the performance of real-time systems decision-making in uncertain environments under constraints such as limited computational resources, timing requirements, and safety considerations. I aim to design reliable intelligent systems that can safely and effectively collaborate with humans in the real world.

I also go by Sherwin. My previous academic email (xinwei.gao@ntu.edu.sg) is no longer active. Please use my current email listed below instead. Feel free to contact me regarding research collaborations, internships, or academic discussions.

News

Aug 02, 2026	I started my Ph.D. journey at the College of Computing and Data Science, Nanyang Technological University.
Feb 06, 2025	One paper for autonomous driving has been accepted by AAMAS2025.

Latest Posts

Mar 05, 2025	Notes: You and Your Research by Richard Hamming
Sep 01, 2024	Notes: How to Write Your PhD Proposal - A Step-By-Step Guide
May 26, 2024	Notes: Reinforcement and Imitation Learning via Interactive No-Regret Learning

Selected Publications

AAMAS
CRLLK: Constrained Reinforcement Learning for Lane Keeping in Autonomous Driving

Xinwei Gao, Arambam James Singh, Gangadhar Royyuru, and 2 more authors

In Proceedings of the 24th International Conference on Autonomous Agents and Multiagent Systems, 2025

Abs DOI Bib PDF Video Code

Lane keeping in autonomous driving systems requires scenario-specific weight tuning for different objectives. We formulate lane-keeping as a constrained reinforcement learning problem, where weight coefficients are automatically learned along with the policy, eliminating the need for scenario-specific tuning. Empirically, our approach outperforms traditional RL in efficiency and reliability. Additionally, real-world demonstrations validate its practical value for real-world autonomous driving.
@inproceedings{gao2025crllk, title = {CRLLK: Constrained Reinforcement Learning for Lane Keeping in Autonomous Driving}, author = {Gao, Xinwei and Singh, Arambam James and Royyuru, Gangadhar and Yuhas, Michael and Easwaran, Arvind}, booktitle = {Proceedings of the 24th International Conference on Autonomous Agents and Multiagent Systems}, pages = {3026--3028}, year = {2025}, doi = {10.65109/lfce1407} }