Fadelis Sukya, Ary Mazharuddin Shiddiqi, Saad Ali Alahmari, Ervin Nurhayati, Anton Satria Prabuwono, Arif Bramantoro, Fawaz Delaim Alharbi
Optimal placement of sensors in water distribution networks is crucial for rapidly and efficiently detecting contamination, thus minimizing public health risks. However, identifying sensor locations that ensure broad detection coverage and minimal detection time presents a significant challenge. This paper presents the SPARC framework, which uses a Deep Q-Network (DQN) combined with systematic hyperparameter tuning via Grid Search to study sensor placement strategies for contaminant detection in water distribution networks. Rather than introducing a new RL algorithm, SPARC provides a domain-specific and reproducible evaluation of how tuned and untuned DQN agents compare to a Greedy baseline across multiple benchmark networks in terms of detection coverage, detection time, and cumulative reward. As a form of Deep Reinforcement Learning, DQN enables an agent to learn from the environment and develop optimal placement strategies based on reward feedback. To enhance DQN performance, hyperparameter optimization is performed using the Grid Search method, exploring combinations of learning rate, discount factor, batch size, and epsilon decay to identify the best configuration. Experiments were conducted using a simulated water distribution network, evaluated across three key metrics: detection coverage, detection time, and cumulative reward. The results demonstrate that SPARC achieves the highest detection coverage (81.08 %) and the fastest average detection time of 1.07 s on the FOS dataset, outperforming the Greedy baseline (70.27%, 5.23 s) and untuned DQN (78.38%, 2.07 s). Coverage improvement is statistically significant (p = 0.031), while differences in average detection time are not significant (p = 0.576). These findings confirm that SPARC significantly enhances both detection effectiveness and operational efficiency compared to conventional heuristic methods. © 2013 IEEE.
Institut Teknologi Sepuluh Nopember, Faculty of Intelligent Electrical and Informatics Technology, Department of Informatics, Surabaya, 60111, Indonesia; State Polytechnic of Malang, Department of Information Technology, Malang, 65144, Indonesia; Department of Computer Science, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh, 11564, Saudi Arabia; Institut Teknologi Sepuluh Nopember, Department of Environmental Engineering, Faculty of Civil, Planning and Geo Engineering, Surabaya, 60111, Indonesia; Universiti Teknologi PETRONAS, Department of Computing, Perak, Seri Iskandar, 32610, Malaysia; Universiti Teknologi Brunei, School of Computing and Informatics, Bandar Seri Begawan, BE1410, Brunei Darussalam