IMPROVING ADAPTIVE TRAFFIC SIGNAL CONTROL AT URBAN INTERSECTIONS BASED ON ARTIFICIAL INTELLIGENCE
- Authors
-
-
Boltaboyev Javohir Yusufjon ugli
KIUT student
-
- Keywords:
- drone cybersecurity cyberattack information security DoS attack Man-In-The-Middle GPS spoofing jamming wormhole drone communication data protection innovative security solutions
- Abstract
- This article addresses the problem of improving an adaptive traffic signal control algorithm at urban intersections by taking into account the dynamic characteristics of traffic flow. Fixed-time control under conditions of rapidly changing traffic demand may lead to excessive waiting times and increased queue lengths. To address this problem, an adaptive control approach based on reinforcement learning principles is proposed. The approach considers the current state of traffic flow, queue lengths, waiting times, and service balance among different traffic directions. The article describes the algorithm's state vector, control actions, reward function, and safety constraints. To evaluate the proposed approach, an experimental methodology is developed using the SUMO microscopic traffic simulator and the TraCI interface.
- References
-
[1] F. V. Webster, "Traffic signal settings," Road Res. Lab., H.M. Stationery Office, London, U.K., Road Res. Tech. Paper 39, 1958.
[2] Federal Highway Administration, "Adaptive signal control technology," U.S. Dept. Transp., Washington, DC, USA. [Online]. Available: https://www.fhwa.dot.gov/innovation/everydaycounts/edc-1/asct.cfm
[3] P. Koonce et al., "Traffic signal timing manual," Federal Highway Administration, U.S. Dept. Transp., Washington, DC, USA, Rep. FHWA-HOP-08-024, 2008, ch. 9, "Adaptive traffic signal control." [Online]. Available: https://ops.fhwa.dot.gov/publications/fhwahop08024/chapter9.htm
[4] C. Cai and M. Wei, "Adaptive urban traffic signal control based on enhanced deep reinforcement learning," Sci. Rep., vol. 14, Art. no. 14116, 2024, doi: 10.1038/s41598-024-64885-w.
[5] P. Michailidis, I. Michailidis, C. R. Lazaridis, and E. Kosmatopoulos, "Traffic signal control via reinforcement learning: A review on applications and innovations," Infrastructures, vol. 10, no. 5, Art. no. 114, 2025, doi: 10.3390/infrastructures10050114.
[6] H. Wei, G. Zheng, H. Yao, and Z. Li, "IntelliLight: A reinforcement learning approach for intelligent traffic light control," in Proc. 24th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining (KDD), London, U.K., Aug. 2018, pp. 2496–2505, doi: 10.1145/3219819.3220096.
[7] P. Alvarez Lopez et al., "Microscopic traffic simulation using SUMO," in Proc. 21st Int. Conf. Intell. Transp. Syst. (ITSC), Maui, HI, USA, Nov. 2018, pp. 2575–2582, doi: 10.1109/ITSC.2018.8569938.
[8] Eclipse SUMO, "Traffic lights," SUMO Documentation. [Online]. Available: https://sumo.dlr.de/docs/Simulation/Traffic_Lights.html
[9] A. Wegener, M. Piórkowski, M. Raya, H. Hellbrück, S. Fischer, and J.-P. Hubaux, "TraCI: An interface for coupling road traffic and network simulators," in Proc. 11th Commun. Netw. Simul. Symp. (CNS), Ottawa, ON, Canada, Apr. 2008, pp. 155–163, doi: 10.1145/1400713.1400740.
[10] Eclipse SUMO, "TraCI — Traffic control interface," SUMO Documentation. [Online]. Available: https://sumo.dlr.de/docs/TraCI/
[11] R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, 2nd ed. Cambridge, MA, USA: MIT Press, 2018.
[12] V. Mnih et al., "Human-level control through deep reinforcement learning," Nature, vol. 518, no. 7540, pp. 529–533, Feb. 2015, doi: 10.1038/nature14236.
[13] J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, "Proximal policy optimization algorithms," 2017, arXiv:1707.06347.
[14] J. García and F. Fernández, "A comprehensive survey on safe reinforcement learning," J. Mach. Learn. Res., vol. 16, no. 42, pp. 1437–1480, 2015.
[15] P. Varaiya, "Max pressure control of a network of signalized intersections," Transp. Res. C, Emerg. Technol., vol. 36, pp. 177–195, Nov. 2013, doi: 10.1016/j.trc.2013.08.014.