HOLISMOKES

XI. Evaluation of supervised neural networks for strong-lens searches in ground-based imaging surveys

¹ Max-Planck-Institut für Astrophysik, Karl-Schwarzschild-Str. 1, 85748 Garching, Germany
² Technical University of Munich, TUM School of Natural Sciences, Department of Physics, James-Franck-Straße 1, 85748 Garching, Germany
³ Aix Marseille Univ, CNRS, CNES, LAM, Marseille, France
⁴ Dipartimento di Fisica, Università degli Studi di Milano, via Celoria 16, 20133 Milano, Italy
⁵ INAF - IASF Milano, via A. Corti 12, 20133 Milano, Italy
⁶ Purple Mountain Observatory, No. 10 Yuanhua Road, Nanjing, Jiangsu, 210033, PR China
⁷ Institute of Astronomy and Astrophysics, Academia Sinica, 11F of ASMAB, No. 1, Section 4, Roosevelt Road, Taipei 10617, Taiwan
⁸ Kindai University, Faculty of Science and Engineering, Osaka 577-8502, Japan
⁹ Astronomy Research Group and Bosscha Observatory, FMIPA, Institut Teknologi Bandung, Jl. Ganesha 10, Bandung 40132, Indonesia
¹⁰ U-CoE AI-VLB, Institut Teknologi Bandung, Jl. Ganesha 10, Bandung 40132, Indonesia
¹¹ Technical University of Munich, Department of Informatics, Boltzmann-Str. 3, 85748 Garching, Germany
¹² Kavli Institute for the Physics and Mathematics of the Universe (WPI), UTIAS, The University of Tokyo, Kashiwa, Chiba 277-8583, Japan
¹³ The Inter-University Centre for Astronomy and Astrophysics (IUCAA), Post Bag 4, Ganeshkhind, Pune 411007, India

^★ Corresponding author; rcanameras@mpa-garching.mpg.de

Received: 2 June 2023
Accepted: 21 October 2024

Abstract

While supervised neural networks have become state of the art for identifying the rare strong gravitational lenses from large imaging data sets, their selection remains significantly affected by the large number and diversity of non-lens contaminants. This work evaluates and compares systematically the performance of neural networks in order to move towards a rapid selection of galaxy-scale strong lenses with minimal human input in the era of deep, wide-scale surveys. We used multiband images from PDR2 of the Hyper-Suprime Cam (HSC) Wide survey to build test sets mimicking an actual classification experiment, with 189 securely-identified strong lenses from the literature over the HSC footprint and 70 910 non-lens galaxies in COSMOS covering representative lens-like morphologies. Multiple networks were trained on different sets of realistic strong-lens simulations and non-lens galaxies, with various architectures and data preprocessing, mainly using the deepest gri-bands. Most networks reached excellent area under the Receiver Operating Characteristic (ROC) curves on the test set of 71 099 objects, and we determined the ingredients to optimize the true positive rate for a total number of false positives equal to zero or 10 (TPR₀ and TPR₁₀). The overall performances strongly depend on the construction of the ground-truth training data and they typically, but not systematically, improve using our baseline residual network architecture presented in Paper VI (Cañameras et al., A&A, 653, L6). TPR₀ tends to be higher for ResNets (≃ 10–40%) compared to AlexNet-like networks or G-CNNs. Improvements are found when (1) applying random shifts to the image centroids, (2) using square-root scaled images to enhance faint arcs, (3) adding z-band to the otherwise used gri-bands, or (4) using random viewpoints of the original images. In contrast, we find no improvement when adding g – αi difference images (where α is a tuned constant) to subtract emission from the central galaxy. The most significant gain is obtained with committees of networks trained on different data sets, with a moderate overlap between populations of false positives. Nearly-perfect invariance to image quality can be achieved by using realistic PSF models in our lens simulation pipeline, and by training networks either with large number of bands, or jointly with the PSF and science frames. Overall, we show the possibility to reach a TPR₀ as high as 60% for the test sets under consideration, which opens promising perspectives for pure selection of strong lenses without human input using the Rubin Observatory and other forthcoming ground-based surveys.