Publications

2024

[J1] Daojing Guo, Khaled Nakhleh, I-Hong Hou, Sastry Kompella, and Clement Kam. “AoI, Timely-Throughput, and Beyond: A Theory of Second-Order Wireless Network Optimization”. The IEEE\ACM Transactions on Networking (ToN) journal. (2024). [paper] [code]

2023

[C4] Khaled Nakhleh, Minhail Raza, Mack Tang, Matthew Andrews, Rinu Boney, Ilija Hadzic, Jeongran Lee, Atefeh Mohajeri, and Karina Palyutina. “SACPlanner: Real-World Collision Avoidance with a Soft Actor Critic Local Planner and Polar State Representations”. In: 2023 IEEE International Conference on Robotics and Automation (ICRA). IEEE. 2023. [paper]

2022

[C3] Khaled Nakhleh, I-Hong Hou. DeepTOP: Deep Threshold-Optimal Policy for MDPs and RMABs. In Advances in Neural Information Processing Systems (NeurIPS 2022), volume 36, December 2022. [paper] [code] [poster] [slides (short)] [slides (long)] (Acceptance rate: 25.6%)

[C2] Daojing Guo, Khaled Nakhleh, I-Hong Hou, Sastry Kompella, and Clement Kam. A theory of Second-Order wireless network optimization and its application on AoI. In IEEE INFOCOM 2022 - IEEE Conference on Computer Communications (INFOCOM 2022), May 2022. [paper] [code] [slides] (Acceptance rate: 19.9%)

2021

[C1] Khaled Nakhleh, Santosh Ganji, Ping-Chun Hsieh, I-Hong Hou, and Srinivas Shakkottai. NeurWIN: Neural Whittle Index Network for Restless Bandits Via Deep RL. In Advances in Neural Information Processing Systems (NeurIPS 2021), volume 35, December 2021. [paper] [code] [poster] [slides] (Acceptance rate: 25.6%)

Preprints

[C5] Khaled Nakhleh, Ceyhun Eksin, and Sabit Ekin. “Simulation-Based Optimistic Policy Iteration For Multi-Agent MDPs with Kullback-Leibler Control Cost”. Submitted to the 24th International Conference on Autonomous Agents and Multiagent Systems (AAMAS) (2025). [preprint]

[J2] Daojing Guo, Khaled Nakhleh, Ping-Chun Hsieh, and I-Hong Hou. “Optimal Wireless Scheduling for Remote Sensing through Brownian Approximation”. journal version. (2021).