Sihong He

Toward General Embodied AI.

prof_pic.jpg
sihonghe.ai at gmail.com https://sihonghe.com

I am Sihong He, an Assistant Professor in Computer Science at UTA.

I am looking for highly motivated Ph.D. students, research interns, visiting students to join my lab. If you are passionate about related research topics, please email me your CV, transcripts, and a brief description of your research interests to my Gmail. Please include ‘Future-Maverick’ in the email subject or body. (this is my email filter), and please don’t send cold emails to my UTA email unless you are a UTA student.

I received my Ph.D. degree from the Department of Computer Science and Engineering, University of Connecticut, working with Dr. Fei Miao. Before my Ph.D. journey at UConn, I received my M.S. degree in Statistics at UC Irvine in 2019 and my B.E. degree in Financial Mathematics in 2017 at SUSTC (南方科技大学) which was newly established in 2011 at Shenzhen, China. (click to read a short story about it).

My long-term research goal is to achieve General Embodied AI. Currently, I mainly focus on developing efficient, robust, secure, adaptive, and explainable decision-making strategies to advance General Embodied AI. My research interests include:

  • Reinforcement Learning (RL): robust RL, multi-agent RL, federated RL, explainable RL, etc.
  • Cyber-Physical Systems (CPS): smart city, intelligent transportation, connected autonomous vehicles, smart logistics, robotics, etc.
  • Intelligent Decision-Making: LLM/Foundation models for decision making, explainable and safe decision-making.
  • Control and Optimization: optimal control, robust optimization, distributionally robust optimization.

So far, my research has focused on robust multi-agent reinforcement learning for robust interconnected CPS, data-driven robust optimization for efficient mobile CPS, and on the security and safety of CPS. In addition to system modeling, theoretical analysis, and algorithm design, my work involves experimental validation of real-world data. My work has been published in prestigious journals and conferences including IROS, ICRA, ICML, NeurIPS, TITS, TCPS, TMC, and TMLR.

I am open to research discussions and collaboration. Please feel free to shoot me an email!

news

Oct 7, 2024 📖 One paper is accepted to NeurIPS 2024!
Aug 19, 2024 👩‍🏫 I officially begin my role as a TTAP in the Computer Science & Engineering Department at UTA.
Aug 9, 2024 🏅 Our paper “Adaptive Uncertainty Quantification for Trajectory Prediction Under Distributional Shift” gets the Best Paper Award in the AI4TS workshop at IJCAI 2024, Jeju, South Korea. Available on Arxiv.
Jun 25, 2024 📖 One paper is accepted to ICML 2024 Workshop on LLMs and Cognition!
Jun 3, 2024 📖 One paper is accepted as an oral presentation to the AI4TS Workshop@IJCAI 2024!
May 20, 2024 🏅 It’s my honor to be awarded Pratt & Whitney Institute for Advanced Systems Engineering Travel Fellowship.
May 8, 2024 🏅 It’s my honor to be awarded 2024 Taylor L. Booth Fellowship (school’s top honor) for outstanding scholarly achievement and demonstrated potential for a successful academic career in the US.
May 1, 2024 📖 Two papers are accepted to ICML 2024!
Apr 17, 2024 I am looking for highly motivated Ph.D. students/summer interns/visiting students to join my lab. If you are passionate about related research topics, please email with your CV, transcripts, and several sentences about your research interest. Please include “Future-Maverick” in your email subject/context (this is my email filter).
Apr 15, 2024 👩‍🏫 I will join the Department of Computer Science and Engineering (CSE), at the University of Texas at Arlington (UTA) as an Assistant Professor this fall!
Apr 14, 2024 🏅 It’s my honor to receive a Summer Doctoral Dissertation Fellowship from UConn.
Apr 8, 2024 🏅 It’s my honor to be selected as a CPS Rising Star.
Mar 26, 2024 👩‍🏫 I pass my thesis defense and am officially a Doctor of Philosophy in CSE now. Thanks to all the people who have supported me to finish my Ph.D. degree!
Dec 18, 2023 🏅 It’s my honor to be selected as a Rising Star in AI.
Nov 10, 2023 🏅 It’s my honor to be selected as a 2024 cohort of NC State University Building Future Faculty Program.

selected publications

  1. A Robust and Constrained Multi-Agent Reinforcement Learning Electric Vehicle Rebalancing Method in AMoD Systems
    Sihong He, Yue Wang, Shuo Han, and 2 more authors
    In 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023
  2. Robust electric vehicle balancing of autonomous mobility-on-demand system: A multi-agent reinforcement learning approach
    Sihong He, Shuo Han, and Fei Miao
    In 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023
  3. Robust Multi-Agent Reinforcement Learning with State Uncertainty
    Sihong He, Songyang Han, Sanbao Su, and 3 more authors
    Transactions on Machine Learning Research (TMLR), 2023
  4. Data-Driven Distributionally Robust Electric Vehicle Balancing for Autonomous Mobility-on-Demand Systems Under Demand and Supply Uncertainties
    Sihong He, Zhili Zhang, Shuo Han, and 5 more authors
    IEEE Transactions on Intelligent Transportation Systems, 2023
  5. Data-driven distributionally robust electric vehicle balancing for mobility-on-demand systems under demand and supply uncertainties
    Sihong He, Lynn Pepin, Guang Wang, and 2 more authors
    In 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020