Open Access
Issue
A&A
Volume 670, February 2023
Article Number A149
Number of page(s) 14
Section Cosmology (including clusters of galaxies)
DOI https://doi.org/10.1051/0004-6361/202244795
Published online 17 February 2023

© The Authors 2023

Licence Creative CommonsOpen Access article, published by EDP Sciences, under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

This article is published in open access under the Subscribe-to-Open model. Subscribe to A&A to support open access publication.

1. Introduction

The European Space Agency’s Euclid space mission1 (Laureijs et al. 2011) will map out the positions of billions of galaxies in the Universe. The imaging survey is designed to measure the flux of galaxies in broadband photometric filters over visual and infrared wavelengths, and spectroscopic redshifts will be determined for a subsample of these galaxies using slitless spectroscopy of emission line galaxies (ELGs). Cosmological parameters and models will be constrained via clustering and weak-lensing measurements, made on galaxy samples split into photometric redshift (photo-z) bins. Critical to the accuracy and precision of cosmological parameter constraints is the determination of the true redshift distributions of these tomographic bins (see e.g., Huterer et al. 2006; van den Busch et al. 2020).

A variety of techniques have been developed for this purpose, including the aggregation, or ‘stacking’, of individual galaxy photometric redshift probability distribution functions (PDFs; Tanaka et al. 2018; Hadzhiyska et al. 2020; Euclid Collaboration 2021a); ‘direct calibration’ of the photometric sample n(z) through the re-weighting of spectroscopic colour-redshift spaces (Lima et al. 2008; Hildebrandt et al. 2017; Wright et al. 2020); and, the focus of this paper, cross-correlations with spectroscopic samples, or ‘clustering redshifts’ (Newman 2008).

Since the seminal work of Newman (2008), cross-correlation redshift calibration has seen a fair amount of development (Schmidt et al. 2013; Ménard et al. 2013; McQuinn & White 2013; Sánchez et al. 2014; Scottez et al. 2016; Morrison et al. 2017; Scottez et al. 2018; Alarcon et al. 2020) but has only recently made its way into state-of-the-art large-scale structure analyses (Hoyle et al. 2018; Gatti et al. 2018, 2022; Hildebrandt et al. 2020; Myles et al. 2021; Cawthon et al. 2022). Clustering redshifts use small angular scales where the signal-to-noise of galaxy clustering is highest, and thus the achievable precision scales directly with the area of photometric–spectroscopic overlap (see Cawthon et al. 2018). Next-generation photometric surveys such as Euclid and the Rubin Observatory’s Legacy Survey of Space and Time (LSST; LSST Science Collaboration 2009) will be able to employ thousands of square degrees of such overlap, in collaboration with the new generation of spectroscopic surveys, such as the Dark Energy Spectroscopic Instrument (DESI; DESI Collaboration 2016), allowing for the most powerful application of clustering redshifts to date.

Clustering redshifts are estimated through the angular cross-correlations of galaxy samples. A tracer sample with secure redshift estimates (from spectroscopy or narrow-band photometry) is cross-correlated with a target sample (which typically has only broadband photometry), for which we wish to accurately and precisely determine the redshift distribution, n(z). Underlying the method is the assertion that the on-sky positions of galaxies in the two samples will only be correlated where they inhabit similar ranges in redshift, that is, where their n(z) overlap. Thus, the amplitude of the cross-correlation at a given redshift contains information about the amplitude of the (known) tracer, n(z), and the unknown target, n(z), but is degenerate with the galaxy biases of both the photometric and spectroscopic galaxy samples. For the spectroscopic sample, the bias can be estimated by measuring the auto-correlation function. However, the photometric sample bias is more difficult to constrain and is the primary source of systematic errors for this mode of study (van den Busch et al. 2020).

Clustering redshift calibration is complementary to the more standard methods of photo-z calibration frequently employed in the literature. Such approaches rely upon real or simulated source photometry, either for characterising colour-redshift relations or for the use of photo-z estimation algorithms. Photometric uncertainties and biases then propagate directly into the n(z) determination. The potential for biased n(z) determination from these techniques can be significant due to degeneracies in the colour-redshift distribution and to the incompleteness of spectroscopic samples in colour-redshift space (Hartley et al. 2020; Wright et al. 2020). Clustering redshifts suffer none of these limitations, as they rely instead upon the accuracy and sufficient coverage of point-estimated redshifts. Being susceptible to independent sources of bias, each method is well suited to cross-check the others; Alarcon et al. (2020) combined the photometry- and clustering-based approaches in a hierarchical Bayesian framework, leveraging all available information to recover mean redshifts with uncertainties of ∼3 × 10−3, even in scenarios of poor or biased spectroscopic completeness.

For Euclid to achieve one of its primary science goals, specifically a figure of merit (FoM) on dark energy of > 400 (Laureijs et al. 2011), uncertainties on the mean redshift, σ(⟨z⟩), for each tomographic redshift bin must be less than 0.002(1 + z) (68% confidence limits; Laureijs et al. 2011). In this paper we assess the potential for photometric-spectroscopic cross-correlations to form a major component of the redshift calibration in Euclid. We aim to use approximately 402 deg2 of the Euclid Flagship simulation (Potter et al. 2017), with realistic photo-z point estimates based upon LSST-like photometry, to forecast the expected uncertainties of clustering redshift calibration as the Euclid data volume grows. We define realistic spectroscopic samples in the simulation, based upon DESI and Baryon Oscillation Spectroscopic Survey (BOSS) selection criteria (DESI Collaboration 2016; Dawson et al. 2013), and make use of the clustering redshift method (Schmidt et al. 2013; Ménard et al. 2013) as implemented in the yet_another_wizz (YAW) software package (van den Busch et al. 2020). We explore the dependence of σ(⟨z⟩) upon the area of spectroscopic overlap and extrapolate from 402 deg2 to the full projected overlap region for Euclid, BOSS, and DESI. We also explore various methods of mitigation for systematic biases associated with the unknown redshift evolution of the photometric galaxy bias, including the use of spectroscopic auto-correlations and internal consistency checks available only to simulations.

This paper is organised as follows. In Sect. 2 we describe the Flagship simulated data, the realistic photo-z employed in our analysis, and our definitions of spectroscopic sub-samples. Section 3 details our cross-correlation methodology, galaxy bias correction, and the extrapolation of uncertainties to the full Euclid, BOSS, and DESI overlap. In Sect. 4 we present the results of clustering redshift calibration for these simulations and in Sect. 5 discuss the implications for Euclid clustering redshifts and avenues to pursue for future research.

2. Data: Simulated photometric and spectroscopic samples

Below we explain our process for constructing simulated Euclid photometric ‘target’ samples and spectroscopic ‘tracer’ samples used to study clustering redshifts for Euclid.

2.1. Summary of photometric and spectroscopic samples

In this study, we cross-correlate simulated photometric target galaxies with Euclid-like mock photo-z and mock spectroscopic tracer samples from the BOSS-like LOWZ and CMASS; the DESI-like Bright Galaxy Survey (BGS); luminous red galaxies (LRGs) and ELGs; and the Euclid-like NISP-S galaxies. We defined our BOSS- and DESI-like galaxy samples on simulated, noiseless photometry, wherein randomly distributed redshift ‘failures’ are modelled by sparse sampling to appropriate number densities. However, systematic failures arising from noisy photometry, and potentially correlating spatially, or with variable survey depth, were not implemented – the impact of these should be explored in future work.

In Fig. 1 we display the true redshift distributions for the ten photometric bins, defined using one of the photo-z samples defined in Sect. 2.2, and compare them with our mock spectroscopic sample redshift distributions. The lack of spectroscopic samples above redshift 1.8 sets a hard upper-limit for our inferred target n(z)’s. Future studies will benefit greatly from understanding the role that quasar galaxy samples from BOSS, eBOSS (Dawson et al. 2016), or DESI (Yèche et al. 2020) can play in better constraining the Euclid photometric sample at higher redshifts. We also note the relatively small tracer–target redshift overlap for galaxies in the range 0.4–0.6, where only mock BOSS galaxies are available for cross-correlation; this has the potential to adversely affect the n(z) constraints for this redshift range.

thumbnail Fig. 1.

Photometric redshift distribution in comparison to reference spectroscopic samples. Top: redshift ranges for each of the ten tomographic bins. Middle: true redshift distribution of each tomographic bin. Bottom: redshift distribution of the reference spectroscopic samples: BOSS-like LOWZ and CMASS; DESI-like BGS, LRG, and ELG; and Euclid NISP-S. The reference samples only support redshifts up to 1.8, and dictate the maximum redshift of bin 10.

The footprints for the BOSS2, DESI3, and Euclid surveys (Amiaux et al. 2012; Euclid Collaboration 2022a) are shown on the sky in Fig. 2. Light grey areas indicate regions of the Euclid survey with no overlap, darker grey indicates regions overlapping with at least one of BOSS or DESI, and the darkest grey indicates regions overlapping with both BOSS and DESI. For comparison we also indicate the footprint of the Flagship galaxy simulation used in this study, which is a subset of the full Flagship octant. Euclid is projected to overlap with DESI over 9015 deg2, and with both BOSS and DESI over 6005 deg2. Unfortunately most of this overlap takes place across the Northern Hemisphere, where photometry from LSST will be limited to the southern-most regions, and therefore the accuracy of the photo-z is likely be worse than that for the ones used in this study. Since these photo-z catalogues were not produced without LSST-like photometry, we could not isolate this study to purely Euclid photometry. We have instead chosen to assume that either the ugrizy bands of LSST will be supplemented in the Northern Hemisphere by other photometric surveys of equivalent depth (as assumed by Euclid Collaboration 2021b) or that the spectroscopic overlaps of BOSS and DESI are supplied by an equivalent Southern Hemisphere survey such as those that will be observed with the 4-metre Multi-Object Spectroscopic Telescope4 (4MOST). This means the quality of the Euclid photo-z will depends on the angular footprint of the supplementary photometry used from other surveys such as LSST and needs to be factored into future studies as this may also result in n(z) that are angular dependent – which, if this is the case, will drastically complicate cosmological inference and analysis.

thumbnail Fig. 2.

Survey footprints for BOSS, DESI, and Euclid shown on the sky, with darker greys indicating regions of tracer–target sample overlap. The footprint perimeter for BOSS is indicated in red, for DESI in blue, and for Euclid in black. Light grey indicates regions of the Euclid survey alone, mid-grey indicates regions with Euclid overlapping with either BOSS or DESI, and dark grey indicates regions with Euclid overlapping both BOSS and DESI. For comparison, the on-sky subregion of the Flagship octant for which we have simulated photo-z is shown in orange. The Euclid survey region is defined to avoid both the Ecliptic (dashed pink line) and Galactic (dash-dotted blue line) planes.

2.2. Euclid photometric sample

The Flagship simulation (Potter et al. 2017) is a large N-body simulation computed with over two trillion dark matter particles in a box of length 3.78 h−1Gpc using the PKDGRAV3N-body code. The simulation is constructed assuming a flat Λ cold dark matter model with cosmological parameters Ωm = 0.319, Ωb = 0.049, ΩΛ = 0.681, σ8 = 0.83, ns = 0.96 and h = 0.67. Dark matter haloes were identified using ROCKSTAR (Behroozi et al. 2013), and galaxies assigned using halo abundance matching and halo occupation distribution techniques. Simulated Euclid photo-z were constructed for galaxies in the Flagship simulation over the RA range 15°–75°, and Dec range 62°–90° (Euclid Collaboration 2021b). We briefly describe the construction of this catalogue below but refer the reader to Euclid Collaboration (2021b) for a complete description.

To generate realistic photo-z catalogues, realistic fluxes were created by adding Gaussian noise to Flagship galaxy fluxes. The Gaussian noise is defined with a standard deviation of f5σ/5 (the flux error associated with each galaxy) where f5σ is the limiting flux depth at a signal-to-noise ratio (S/N) of 5. The limiting magnitudes at 5σ depth considered to compute flux observations were 26.3, 27.5, 27.7, 27, 26.2, and 24.9 for the ugrizy bands of Rubin LSST, and 24.6, 23, 23, and 23 for the IE and YE, JE, HE bands of Euclid at 10σ depth assuming both surveys are at end-of-survey depth.

The noisy IE magnitudes were cut to less than 24.5 (Laureijs et al. 2011) to simulate the EuclidIE galaxy sample. Realistic estimates of the photometric redshift of simulated galaxies were made using the directional neighbourhood fitting (DNF; De Vicente et al. 2016) training-based algorithm. The DNF photo-z are estimated according to the proximity in colour-magnitude space of target and training galaxies, where redshifts are known for the training set. The DNF algorithm produces two photo-z estimates; ‘zmean’ takes the mean of neighbouring galaxies in colour and magnitude space, and ‘zmc’ draws a random redshift from the neighbouring galaxies. A 3.35 deg2 patch of Flagship was used to create training samples for the DNF. The first training sample was defined to be fully representative in redshift and magnitude space, and produced the photo-z catalogues zmean and zmc. A second training sample featured a completeness drop in IE magnitude (emulating the expected spectroscopic completeness fraction versus photometric depth function for surveys such as Rubin; see Newman et al. 2015), and produced the photo-z catalogues zmean Rubin and zmc Rubin. We repeated our analysis on each of these four photo-z catalogues.

We produced ten tomographic redshift bins for each photo-z catalogue. These were constructed by selecting galaxies with photo-z between 0.2 and 1.6, and then dividing them into ten bins with approximately equal numbers of galaxies. The definition for the tomographic bins used in this study differ in two important ways to the definitions currently planned for Euclid; in the real survey the maximum photo-z will extend up to z = 2.6 rather than z = 1.6 and secondly 13 rather than 10 tomographic bins will be used (Euclid Collaboration 2020b). The justification for these difference is motivated by two factors, (1) a limit to the galaxies in the Flagship mocks of z < 2.2 and (2) a sharp cut off in simulated spectroscopic tracers to z < 1.8. Including galaxies with photo-z of greater than z > 1.6 will introduce a substantial set of galaxies with true redshifts beyond z > 1.8 where clustering redshift measurement cannot be made. Since this limitation is purely based on our setup we wish to limit any effect it may pose on the results and implications for Euclid. Quasars (e.g., as observed by DESI; DESI Collaboration 2016) will eventually provide reference samples for calibration at these high redshifts. We note that the clustering redshifts method will need to be carefully optimised for quasar samples, where bias modelling and angular scale utilisation are likely to pose challenges for the much sparser quasar population.

We note that Euclid’s ground-based photometry complement in the Northern Hemisphere will be somewhat shallower and less homogeneous than the LSST. Nevertheless, the photometry will meet the stringent Euclid requirements and hence yield high-quality photometric redshifts, so that our conclusions remain valid.

2.3. Reference spectroscopic samples

We detail below the various spectroscopic tracer samples that we define in the Flagship simulation, each designed to mimic a current or future galaxy sample observed by Euclid, BOSS, or DESI.

2.3.1. Euclid NISP-S samples

The Euclid near-infrared spectrometer (Schirmer 2022b) is designed to measure spectroscopic redshifts for over 50 million galaxies (referred to as the NISP-S sample). The redshift determination is to be made with slitless spectroscopy dependent on the detection of emission lines, in particular the Hα line, in the near-infrared. We defined mock NISP-S samples in Flagship by selecting galaxies with Hα fluxes greater than 3 × 10−16 erg cm−2 s−1 (Laureijs et al. 2011), and cutting to a redshift range between 0.9 and 1.8. Comparisons of the mock NISP-S redshift distribution to the optimistic and pessimistic predictions made by Euclid Collaboration (2020a), we found consistency above redshifts of 1.35, but an overproduction of galaxies at lower redshifts. To correct for this we carry out sparse sampling for mock NISP-S galaxies with z < 1.35 to approximately match the optimistic expectation from Euclid Collaboration (2020a).

2.3.2. Baryon Oscillation Spectroscopic Survey LOWZ and CMASS samples

We defined BOSS-like samples according to the colour-magnitude selections specified by Dawson et al. (2013). BOSS produced two spectroscopic LRG samples, LOWZ and CMASS, targeting adjacent redshift intervals z ∈ [0.15, 0.43] and z ∈ (0.43, 0.7], respectively, and with true densities of about 30 deg−2 and 120 deg−2, respectively. We replicated the BOSS colour-magnitude selections as follows, first defining

c = 0.7 ( g r ) + 1.2 ( r i 0.18 ) , $$ \begin{aligned}&c_{\parallel } = 0.7\,(g-r) + 1.2\,(r-i-0.18),\end{aligned} $$(1)

c = ( r i ) ( g r ) / 4 0.18 , $$ \begin{aligned}&c_{\perp } = (r-i) - (g-r)/4 - 0.18,\end{aligned} $$(2)

d = ( r i ) ( g r ) / 8 , $$ \begin{aligned}&d_{\perp } = (r-i) - (g-r)/8, \end{aligned} $$(3)

where gri denote apparent magnitudes (at our simulated LSST depth). We then defined mock LOWZ samples with the following criteria:

| c | < 0.2 , $$ \begin{aligned}&|c_{\perp }| < 0.2,\end{aligned} $$(4)

r < 13.6 + c / 0.3 , $$ \begin{aligned}&r < 13.6 + c_{\parallel }/0.3,\end{aligned} $$(5)

16 < r < 19.5 , $$ \begin{aligned}&16 < r < 19.5, \end{aligned} $$(6)

and mock CMASS samples with

17.5 < i < 19.9 , $$ \begin{aligned}&17.5 < i < 19.9,\end{aligned} $$(7)

d > 0.55 , $$ \begin{aligned}&d_{\perp } > 0.55,\end{aligned} $$(8)

i < 19.86 + 1.6 ( d 0.8 ) . $$ \begin{aligned}&i < 19.86 + 1.6\,(d_{\perp } - 0.8). \end{aligned} $$(9)

These cuts provided LOWZ- and CMASS-like objects in the Flagship simulation at rates of 67 deg−2 and 139 deg−2, respectively. We sparse sample our selections to the desired densities, with sparse sampling fractions of 0.44 and 0.86.

2.3.3. Dark Energy Spectroscopic Instrument BGS, LRG, and ELG samples

We based our DESI-like sample selections on those detailed in Sect. 3 of DESI Collaboration (2016). DESI will measure the spectra of galaxies at relatively low redshifts with the BGS (designed to use spectra obtained during brighter sky conditions), and will also target two deeper surveys of LRGs and ELGs.

We define our mock BGS sample with the following criteria,

r < 19.5 , $$ \begin{aligned}&r < 19.5,\end{aligned} $$(10)

z < 0.4 , $$ \begin{aligned}&z < 0.4, \end{aligned} $$(11)

where z is the true object redshift. We define the mock LRG sample with

z < 20.46 , $$ \begin{aligned}&z < 20.46,\end{aligned} $$(12)

r < 23 , $$ \begin{aligned}&r < 23,\end{aligned} $$(13)

0.6 < z < 1.0 , $$ \begin{aligned}&0.6 < z < 1.0,\end{aligned} $$(14)

color_kind = red sequence ( 0 ) , $$ \begin{aligned}&\mathtt {color\_kind} = \mathrm {red\,sequence} \, (0), \end{aligned} $$(15)

where color_kind is a flag labelling red sequence (0), green valley (1) and blue cloud (2) galaxies. Lastly, we defined the mock ELG sample of galaxies with [O II] emission line strengths greater than 8 × 10−17 erg s−1 cm−2, and with the following cuts,

r < 23.4 , $$ \begin{aligned}&r < 23.4,\end{aligned} $$(16)

g r < 0.7 , $$ \begin{aligned}&g - r < 0.7,\end{aligned} $$(17)

r z > 0.3 , $$ \begin{aligned}&r - z > 0.3,\end{aligned} $$(18)

0.6 < z < 1.6 , $$ \begin{aligned}&0.6 < z < 1.6,\end{aligned} $$(19)

color_kind red sequence ( 0 ) , $$ \begin{aligned}&\mathtt {color\_kind} \ne \mathrm {red\,sequence} \, (0), \end{aligned} $$(20)

which act to isolate ELGs in colour-colour space, minimising contamination of the sample by lower-redshift objects or by stars. We also applied a hard cut to the expected redshift range, and required that the color_kind not specify a red sequence object, though these have comparatively small impacts upon the selection.

These cuts provided BGS-, LRG-, and ELG-like objects in the Flagship simulation at rates of 1174 deg−2, 392 deg−2, and 2021 deg−2, respectively. We achieved the expected number densities (of 700 deg−2 for BGS, 285 deg−2 for LRG, and 1220 deg−2 for ELG) by sparse sampling with sparse sampling fractions of 0.6, 0.73, and 0.6, respectively.

We omitted DESI LRGs with z < 0.6, which have selection criteria similar to BOSS. Therefore, the dearth of reference galaxies in the range 0.4 < z < 0.6 will be much less pronounced for real data, which makes our analysis conservative.

3. Method

In this section we briefly outline the clustering redshift method used in this study, the subsequent method for modelling the redshift distributions, and lastly the area rescaling approach used to predict the uncertainty on the mean redshift for the full Euclid survey.

3.1. Clustering redshifts

The angular correlation function ω12(θ, z) for two samples on the sky (denoted by 1 and 2), where sample 1 is at a fixed redshift z, is given by the Limber (1953) relation,

ω 12 ( θ , z ) = b 1 ( z ) 0 d z n 2 ( z ) b 2 ( z ) ξ [ R ( θ , z , z ) , z ] , $$ \begin{aligned} \omega _{12}(\theta , z)=b_{1}(z)\,\int _{0}^{\infty }\mathrm{d}z^{\prime }\,n_{2}(z^{\prime })\,b_{2}(z^{\prime })\,\xi \,\Big [R(\theta ,z, z^{\prime }), z\Big ], \end{aligned} $$(21)

where b1(z) and b2(z) are the redshift-dependent biases for samples 1 and 2, respectively, n2(z) is the normalised redshift selection function for sample 2, ξ(R, z) is the matter auto-correlation function at redshift z and comoving three-dimensional separation

R ( θ , z , z ) = [ χ ( z ) χ ( z ) ] 2 + [ f K ( z ) θ ] 2 , $$ \begin{aligned} R(\theta , z, z^{\prime }) = \sqrt{\Big [\chi (z)-\chi (z^{\prime })\Big ]^{2}+\Big [f_{\rm K}(z^{\prime })\,\theta \Big ]^{2}}, \end{aligned} $$(22)

where χ(z) is the radial comoving distance at redshift z and fK(z) is the angular diameter distance at redshift z.

For the computation of clustering redshifts, the following assumptions are made. We first consider the angular correlation function for a spectroscopic tracer sample (denoted with an index s) and photometric target sample (denoted with an index p)

ω sp ( θ , z ) = b s ( z ) 0 d z n p ( z ) b p ( z ) ξ [ R ( θ , z , z ) , z ] . $$ \begin{aligned} \omega _{\rm sp}(\theta , z)=b_{\rm s}(z)\,\int _{0}^{\infty }\mathrm{d}z^{\prime }\,n_{\rm p}(z^{\prime })\,b_{\rm p}(z^{\prime })\,\xi \,\Big [R(\theta ,z, z^{\prime }), z\Big ]. \end{aligned} $$(23)

Angular correlation functions are computed for narrow redshift slices of the spectroscopic tracer with a mean redshift zi (where i denotes the redshift bin) and bin width of Δz. Furthermore, assuming measurements are only made for small values of θ we can can make the approximation that ξ ≠ 0 only if the integral is calculated within the bin’s redshift range zi ± Δz/2. The narrow sizes of the bins means np and bp can be approximated as constants and therefore Eq. (23) simplifies to

ω sp ( θ , z i ) = b s ( z i ) n p ( z i ) b p ( z i ) ω ii ( θ , z i ) , $$ \begin{aligned} \omega _{\rm sp}(\theta , z_{i})=b_{\rm s}(z_{i})\,n_{\rm p}(z_{i})\,b_{\rm p}(z_{i})\,\omega _{ii}(\theta , z_{i}), \end{aligned} $$(24)

where

ω ii ( θ , z i ) = z i Δ z / 2 z i + Δ z / 2 d z ξ [ R ( θ , z i , z ) , z i ] . $$ \begin{aligned} \omega _{ii}(\theta , z_{i})=\int _{z_{i}-\Delta z/2}^{z_{i}+\Delta z/2}\mathrm{d}z^{\prime }\,\xi \,\Big [R(\theta ,z_{i}, z^{\prime }), z_{i}\Big ]. \end{aligned} $$(25)

In our study these expressions were evaluated for the transverse physical scale r = θχ/(1 + z), which led to the final definition of the angular correlation function for clustering redshifts,

ω sp ( r , z i ) = b s ( z i ) n p ( z i ) b p ( z i ) ω ii ( r , z i ) . $$ \begin{aligned} \omega _{\rm sp}(r, z_{i})=b_{\rm s}(z_{i})\,n_{\rm p}(z_{i})\,b_{\rm p}(z_{i})\,\omega _{ii}(r, z_{i}). \end{aligned} $$(26)

Thus we can evaluate the target sample’s redshift selection function np by rearranging Eq. (26) for

n p ( z i ) = ω sp ( r , z i ) b s ( z i ) b p ( z i ) ω ii ( r , z i ) . $$ \begin{aligned} n_{\rm p}(z_{i}) = \frac{\omega _{\rm sp}(r, z_{i})}{b_{\rm s}(z_{i})\,b_{\rm p}(z_{i})\,\omega _{ii}(r, z_{i})}. \end{aligned} $$(27)

The above equation requires knowledge of the bias-redshift relation for both the spectroscopic tracer and photometric target sample. By evaluating Eq. (26) for the angular auto-correlation functions for the spectroscopic and photometric samples we can define the bias functions as

b x = Δ z ω xx ( r , z i ) ω ii ( r , z i ) , $$ \begin{aligned} b_{\rm x}= \sqrt{\frac{\Delta z\,\omega _{\rm xx}(r, z_{i})}{\omega _{ii}(r, z_{i})}}, \end{aligned} $$(28)

where x can denote either the spectroscopic tracer or photometric target sample. Since the auto-correlation function is evaluated in a single, narrow redshift bin, the normalised redshift selection function nx → 1/Δz. Using these relations, Eq. (27) can be expressed as

n p ( z i ) = ω sp ( r , z i ) Δ z ω ss ( r , z i ) ω pp ( r , z i ) . $$ \begin{aligned} n_{\rm p}(z_{i}) = \frac{\omega _{\rm sp}(r, z_{i})}{\Delta z \,\sqrt{\omega _{\rm ss}(r, z_{i})\,\omega _{\rm pp}(r, z_{i})}}. \end{aligned} $$(29)

However, in practice ωpp(r, z) is difficult to obtain, since we do not know the photometric sample redshifts a priori, and thus cannot bin target galaxies to measure the correct auto-correlations and anchor the photometric sample galaxy bias. The result is that the np(z) is biased and requires a correction scheme to account for any redshift evolution of the photometric sample galaxy bias. Several bias mitigation strategies can be employed.

Method 1: No corrections are applied. This is useful to test the success of the following bias correction methods. This means we assume np(z)∝ωsp(r, z).

Method 2: The spectroscopic biases are computed from the auto-correlation functions and are incorporated in the np(z) computation. This means we use Eq. (29) but ωpp(r, z) is evaluated for the entire tomographic bin instead of within thin redshift slices.

Method 3: ‘Self-consistent bias mitigation’ uses a one-parameter redshift power law, ℬα(z), fitted to the observed auto- and cross-correlations to account for redshift evolution in bp (Davis et al. 2018; van den Busch et al. 2020)

B α ( z ) = ( 1 + z ) α Δ z i ω ¯ pp ( z ) , $$ \begin{aligned} \mathcal{B} _{\alpha }(z) = (1 + z)^{\alpha } \propto \sqrt{\Delta z_{i}\,\bar{\omega }_{\rm {pp}}(z)}, \end{aligned} $$(30)

where α is a free model parameter, and barred correlations ω ¯ ( z ) $ \bar{\omega}(z) $ correspond to integrals over ω(r, z) between chosen limits rmin and rmax. This means ωpp in Eq. (29) is replaced with ℬα(z)2z.

Method 4: The bias for the photometric sample is computed from the auto-correlation function for only the photometric galaxies with true redshifts within a given redshift slice. Equation (29) is therefore applied exactly. We note that this method can only be applied to simulated data, and is useful for assessing the accuracy of other bias correction schemes.

3.2. Cross-correlating redshifts

We compute clustering correlations in the Flagship data using the single-bin (defined by rmin, rmax) method of Schmidt et al. (2013) and Ménard et al. (2013), implemented with the Davis-Peebles clustering estimator (Davis & Peebles 1983) as follows:

ω ¯ = N R r min r max d r W ( r ) DD ( r ) N D r min r max d r W ( r ) DR ( r ) 1 , $$ \begin{aligned} \bar{\omega } = \frac{N_{\rm R}\int ^{r_{\rm {max}}}_{r_{\rm {min}}}\mathrm{{d}}r \, W(r) \, \mathrm{DD}(r)}{N_{\rm D}\int ^{r_{\rm {max}}}_{r_{\rm {min}}}\mathrm{{d}}r \, W(r) \, \mathrm{DR}(r)} - 1, \end{aligned} $$(31)

where W(r)∝rβ (e.g., β = −1; Schmidt et al. 2013; Ménard et al. 2013), DD(r) and DR(r) are galaxy-galaxy and galaxy-random pair counts (in the comoving bin centred on r), respectively, and NR/ND re-normalises pair counts to account for over-sampling of random points relative to the data. The method follows van den Busch et al. (2020) and uses the software package YAW5 described in van den Busch et al. (2020) with errors and covariance matrices estimated using bootstrap resampling.

3.3. Redshift distribution fitting

Since the clustering redshift measurements have Gaussian error distributions, they allow for negative n(z) values. Of course, no true PDF can exhibit this property and as a result the raw clustering redshift measurements will artificially inflate the uncertainties on the mean redshift ⟨z⟩. Therefore, we did not determine ⟨z⟩ directly from the clustering redshift measurements but rather by fitting model n(z) distributions. Two model n(z) distributions were considered. The first model, the shifted-true model, is simply the true n(z) measured from simulations with the addition of two free parameters: A and δz, which are the amplitude and shift parameters, respectively (explained in greater detail in Sect. 3.3.1). The second model is the suppressed Gaussian process (suppressed-GP) model discussed in Sect. 3.3.2, which, unlike the first model, makes no assumptions about the shape of the n(z) distribution. In both cases, the models are not normalised, since normalisation cannot be enforced on the clustering redshift measurements. Normalisation of the model is therefore only conducted when we are calculating the mean of the PDF.

3.3.1. Shifted-true

In the shifted-true model the clustering redshift measurements are fitted to the true n(z). If these were real data, this true n(z) would not be known and would have to be estimated through forward modelling on simulations such as Flagship, or from direct calibration (van den Busch et al. 2020). The measured n(z) is fitted with two parameters, a shift along the redshift direction δz and an amplitude A,

n model ( z ; δ z , A ) = A n true ( z + δ z ) . $$ \begin{aligned} n_{\rm model}(z; \delta z, A) = A\,n_{\rm true}(z+\delta z). \end{aligned} $$(32)

Fitting with the true distribution allows us to test the robustness of the output clustering redshift measurements, since the resultant best-fit values should be consistent with δz = 0 in the absence of systematic errors. The parameters are determined using a Gaussian likelihood,

ln L [ δ z , A | n ̂ ( z ) , σ n ̂ ( z ) ] = 1 2 [ n ̂ ( z ) n model ( z ; δ z , A ) σ n ̂ ( z ) ] 2 , $$ \begin{aligned} \ln \mathcal{L} \,\big [\delta z, A\, |\, \hat{n}(z), \sigma _{\hat{n}}(z)\big ] = -\frac{1}{2}\left[\frac{\hat{n}(z)-n_{\rm model}(z; \delta z, A)}{\sigma _{\hat{n}}(z)}\right]^{2}, \end{aligned} $$(33)

where n ̂ ( z ) $ \hat{n}(z) $ and σ n ̂ ( z ) $ \sigma_{\hat{n}}(z) $ are the clustering redshift measurements and 68.3% confidence intervals, respectively.

3.3.2. Suppressed Gaussian process

Whilst the shifted-true model is a valuable test for systematic errors, it is important to note that we will not have access to such a model for real data. In previous studies, clustering redshifts were fitted to models based on simulated photometric redshift samples while Gatti et al. (2022) used direct calibration of the data. Although the simulated photometric redshift n(z) may work as a good proxy for the real model, it may be better to have a model that is more flexible and could be relied upon in a more general setting. With this in mind, we present a new, non-parametric approach to fitting clustering redshift distributions based upon Gaussian processes (GPs, and featuring a suppression function that damps signals in regions where the clustering redshift measurements are consistent with zero.

A GP is first fitted to the clustering redshift measurements. This is carried out by the Python package George6 using a Matern-3/2 kernel. One benefit of such a model is that we can now draw random samples from the distribution to measure the mean redshift and its uncertainty. However, as with the clustering redshift measurements there is nothing limiting the GP model from drawing samples that are negative. This issue is further compounded by the fact that uncertainties crossing zero will create spurious fluctuations in the GP samples. To ensure that the GP is positive, and to remove spurious signals where the clustering redshift measurement is consistent with zero, we apply a suppression function to the GP realisations. The suppression function is defined by the following expression,

S ( x , k ) = { 0 , x 0 , 1 ( 1 x ) k , 0 < x < 1 , 1 , x 1 , $$ \begin{aligned} S(x,k) =\left\{ \begin{array}{lc} 0,&x\le 0,\\ 1 - (1-x)^{k},&0 < x < 1,\\ 1,&x\ge 1, \end{array}\right. \end{aligned} $$(34)

where k is a damping factor taken to be 0.3 in this study and

x = n GP i ( z ) Σ T ( G Σ ) , $$ \begin{aligned} x = \frac{ n_{\rm GP}^\mathrm{i}(z) }{ \Sigma _{\rm T}\,\Big ( \mathcal{G} *\Sigma \Big ) }, \end{aligned} $$(35)

n GP i ( z ) $ n_{\mathrm{GP}}^{\mathrm{i}}(z) $ is a random GP realisation, ΣT = 3 is the S/N threshold, Σ = nGP(z)/σGP(z) is the S/N function (where nGP and σGP are the GP mean and 68.3% confidence interval), 𝒢 is a Gaussian with standard deviation of 0.05 and is the convolution operator. The Gaussian convolution with the S/N prevents spurious random fluctuations in the S/N from impacting the activation of the suppression function and ensures the tails of the clustering redshift n(z) are not too harshly damped. A standard deviation drastically smaller than 0.05 will be smaller than the bin size of the clustering redshift measurements and therefore will be equivalent to no smoothing. On the other hand, larger values will more strongly correlate bins that may be problematic since, in some cases, the n(z) profile spans across only ∼5 bins and may be completely washed out.

An example of this procedure is shown in Fig. 3. The suppressed-GP has the desired effect, that is to say, noisy PDFs are not drawn in regions of the clustering redshifts that are consistent with zero. A potential shortcoming is that tails in the distribution will be suppressed if they have low S/N. Steps to mitigate this effect could be studied in future work by exploring alternative suppression functions and techniques.

thumbnail Fig. 3.

Method for fitting suppressed-GP models to clustering redshift, n(z), measurements. The true n(z) for one tomographic bin is shown with dashed black lines. The measured clustering redshift, n(z), is shown with black markers and error bars. (a) We fit a GP model to the clustering redshift, n(z), measurements. (b) We draw random realisations from the GP. (c) We construct a suppression function, taking as input the GP draw and the smoothed S/N of the clustering redshift measurement. (d) We multiply the random realisations from the GP by the suppression function. This ensures that the suppressed-GP model is always positive and suppresses low-S/N fluctuations in the GP. (e) We construct 68.3% and 95.5% confidence envelopes from samples of the suppressed-GP model.

3.4. Area rescaling

We seek to provide estimates for the uncertainties of the np(z) determination as a function of the projected Euclid data volume; thus we must extrapolate from the 402 deg2 of the Flagship area to the larger spectroscopic overlap areas, and also attempt to characterise the impact of sample variance. Euclid is projected to overlap with DESI over 9015 deg2, and with both DESI and BOSS over 6005 deg2. To rescale the determined uncertainties on mean redshifts, we divided the Flagship lightcone into multiple subdivisions (see Fig. 4) and re-ran our analysis on each of these subdivisions independently. This allowed us to approximate the relationship between the tracer–target overlap area and the uncertainties on ⟨z⟩. We then fitted these relationships with power laws, and extrapolated to estimate the uncertainties from the full Euclid, BOSS, and DESI overlap area. We note we do not redefine the bootstrap regions when we run the analysis on each subdivision, this means estimates of the error are less accurate for smaller regions since they are based on fewer defined bootstrap regions. An alternative approach would be to use purely shot-noise covariance, but we leave this for future work. Furthermore, since these regions overlap, measurements on the subregions will be strongly correlated.

thumbnail Fig. 4.

Flagship footprint and area rescaling subregions. Left: bootstrap subregions, indicated with different colours, that are used to calculate errors in YAW. Right: different subregions of the Flagship footprint, shown with different colours, used to establish the relation between the tracer–target overlap area and the uncertainty on the mean redshifts of tomographic bins. The four subpanels show the Flagship footprint divided into 2 (top left), 4 (top right), 8 (bottom left), and 16 (bottom right) subregions. These are plotted on an orthographic projection of a subset of the sky focused on the Flagship footprint. The RA and Dec grid is shown with dashed grey lines. The values of the grid lines are indicated where they intercept the x-axis for the RA grid and the y-axis for the Dec grid.

4. Results

This section details the results of our clustering redshift calibration, focusing on the uncertainties of mean redshift determination across our ten mock tomographic bins.

4.1. Clustering redshift measurements

We measured clustering redshifts using the YAW software package between scales rmin = 100 kpc and rmax = 1000 kpc (following the scales used by KiDS; van den Busch et al. 2020), considering separately each of the four simulated Euclid photometric redshift catalogues presented by Euclid Collaboration (2021b). We performed the analysis independently for the full Flagship region (with photo-z), and for each subregion (shown in Fig. 4).

In Fig. 5 we compare the clustering redshift measurements obtained by YAW (shown with purple error bars) to the true redshift distribution of the ‘mean Rubin’ photometric catalogue on Flagship. The measurements clearly trace the true distribution, and showcase the capability of clustering redshifts to retrieve redshift distributions for photometric catalogues. There are, however, some significant fluctuations, for example at the peak of bin 2. The measurements in Fig. 5 are corrected for the spectroscopic sample galaxy bias (method 2, discussed in Sect. 3.1).

thumbnail Fig. 5.

Clustering redshift measurements in comparison to the true n(z) for ten simulated Euclid Flagship tomographic photo-z bins. Measurements from YAW are shown in purple, with error bars indicating 95.5% confidence intervals. The measurements clearly trace the true n(z), albeit with some spurious local fluctuations. These fluctuations probably arise due to an incomplete galaxy bias correction methodology. The bias correction method used in this figure is method 2 (Sect. 3.1).

4.2. Mean redshifts

Having measured the clustering redshifts, we wished to constrain and compare each bin’s n(z) distribution by measuring the mean redshift ⟨z⟩ and comparing to the truth. The mean redshift is determined by calculating

z = i = 1 N CC z i n ( z i ) Δ z , $$ \begin{aligned} \langle z\rangle = \sum _{i=1}^{N_{\rm CC}}\,z_{i}\,n(z_{i})\,\Delta z, \end{aligned} $$(36)

where n(z) is the normalised model redshift distribution within the redshift ranges zmin and zmax, zi is the redshift centre of a clustering redshift bin and n(zi) a clustering redshift measurement. The i is used to denote a specific measurement and NCC the total number of measurements. We computed ⟨z⟩ for the n(z) model only within the redshift range where clustering redshift measurements were made (therefore zmin = 0.05 and zmax = 1.8) while true values ⟨ztruth were computed from the true n(z) measured across the entire Flagship range z < 2.2. For both the shifted-true and suppressed-GP models, we drew 1000 realisations of the redshift distribution (for the shifted-true model, this means drawing random shift parameters from the posterior likelihood). We determine the mean redshift ⟨z⟩ from the sample n(z), and the standard deviation on the mean σ(⟨z⟩) from the variance of the sample ⟨z⟩. In Fig. 6 we display the mean redshift error ⟨z⟩−⟨ztruth for both models, in each bin and for the different photometric catalogues, constrained by the full Flagship footprint. The constraints show significant biases, in particular for bins 7–10, which are biased to lower redshifts for both models. For the shifted-true model we see some significant biases in bins 2 and 4, independent of photo-z method. The suppressed-GP is biased for bins 1 and 4, but only for the photometric catalogue ‘mc’. The broadly similar performance of the suppressed-GP and shifted-true models shows that the suppressed-GP model is performing well, and that it is a robust alternative for n(z) fitting. We also note that the directions and amplitudes of biases appear to be consistent between models, suggesting that systematic errors are independent of the fitting method for this analysis. Rather surprisingly, bin 3, which is placed in the region (z = 0.4–0.6) with fewer spectroscopic tracers, is relatively unbiased. One interesting property of this bin is that the tails on both sides are well constrained, due to the high number of spectroscopic tracers on either of the tails of the distribution. This suggests the clustering redshift performance on the tails may be driving biases in the other results. We note that we also find the errors on zmean and zmean Rubin to be smaller than the zmc and zmc Rubin for the suppressed-GP owing to the larger tails in the ‘mc’ methods.

thumbnail Fig. 6.

Error on the mean redshift determination ⟨z⟩−⟨ztruth for ten Euclid Flagship tomographic bins, for each of our four photometric redshift catalogues (‘mean Rubin’ in dark purple, ‘mc Rubin’ in purple, ‘mean’ in dark green, and ‘mc’ in light green, with dark and light shades indicating 68.3% and 95.5% uncertainties). The grey bands show the target uncertainties for Euclid. Two n(z) fitting methods are shown: the shifted-true model (left, Sect. 3.3.1) and the suppressed-GP model (right, Sect. 3.3.2), each fit to clustering redshift measurements made with spectroscopic sample bias corrections (i.e. method 2, Sect. 3.1).

In Fig. 7 we compare the bias correction methods outlined in Sect. 3.1 by calculating the reduced χ r 2 $ \chi_{\mathrm{r}}^{2} $ for each method,

χ r 2 = 1 N Bins i = 1 N Bins [ z z truth 0.002 ( 1 + z truth ) ] 2 , $$ \begin{aligned} \chi _{\rm r}^{2} = \frac{1}{N_{\rm Bins}}\sum _{i=1}^{N_{\rm Bins}} \left[\frac{\langle z \rangle - \langle z \rangle _{\rm truth}}{0.002\,(1+\langle z \rangle _{\rm truth})}\right]^{2}, \end{aligned} $$(37)

thumbnail Fig. 7.

Error on the mean redshift determination, ⟨z⟩−⟨ztruth, in ten Euclid tomographic redshift bins, for each of the four galaxy bias correction strategies (Sect. 3.1), compared via the shifted-true model (Sect. 3.3.1). In dark blue is method 1, where no corrections are applied; in purple is method 2, where the spectroscopic galaxy bias is calibrated by spectroscopic auto-correlations; in magenta is method 3, where the photometric galaxy bias is calibrated by a power-law fit to noisy, photo-z-binned photometric auto-correlations; and in light pink is method 4, where the photometric galaxy bias is calibrated using auto-correlations binned by true redshifts (not applicable to real data). Dark and light shades indicate 68.3% and 95.5% confidence intervals. The grey band shows the target uncertainties for Euclid. Method 4 shows that systematic biases in bins 1–6 are caused by incomplete bias corrections, whilst the biases persist for higher-redshift bins, suggesting some other source of systematic error.

on the photometric catalogue ‘mean Rubin’, where NBins is the number of tomographic bins. We see that method 1 (no galaxy bias correction) performs worst with a χ r 2 = 7.8 $ \chi^{2}_{\mathrm{r}}=7.8 $, while method 2 (spectroscopic sample bias correction; the baseline method for all other figures) performs slightly better with a χ r 2 = 4.2 $ \chi^{2}_{\mathrm{r}}=4.2 $. Method 3, which fits a power law for photometric sample bias correction, performs very similarly to method 2 – with a χ r 2 = 4.2 $ \chi^{2}_{\mathrm{r}}=4.2 $. Method 4, which performs the best with a χ r 2 = 3.7 $ \chi^{2}_{\mathrm{r}}=3.7 $, measures the true bias for photometric galaxies in each of the spectroscopic slices, and cannot be measured on real data. However, in simulations like Flagship, it allows us to test the significance and implications of residual biases. Method 4 shows that correcting for photometric galaxy biases in bins 1–6 removes any systematic biases on the determination of the mean redshift, and indicates that the mean redshift uncertainties may be underestimated by other methods. It should be possible to calibrate for such underestimations of σ(⟨z⟩) with realistic simulations like Flagship. We assess whether or not the extra noise component revealed by method 4 is likely to affect our conclusions, as we forecast uncertainties on ⟨z⟩ versus tracer–target overlap area in Sect. 4.3. Bins 7–10 remain significantly biased in ⟨z⟩, even for method 4, which is why the χ r 2 $ \chi^{2}_{\mathrm{r}} $ is still significantly larger than 1. The causes of these persistent biases are currently unknown, and require further investigation. They may be affected by the cross-correlation estimator; a move to the superior Landy & Szalay (1993) estimator should be explored in future work. Alternatively, the definition of target sample tomographic bins may be sub-optimal; wider equi-populated bins at higher redshifts will offer lower signal-to-noise of clustering redshift measurements, since those galaxies span a larger volume in a flux-limited survey where the number density falls with increasing redshift. Optimisation of the target tomography is another promising avenue for future work.

4.3. Area rescaling

A determination of whether or not clustering redshifts can constrain the σ(⟨z⟩) of Euclid tomographic redshift bins to less than 0.002 (1 + z) requires extrapolation. We estimated the relation between σ(⟨z⟩) and tracer–target overlap area by measuring ⟨z⟩ within subregions of the Flagship region (see Fig. 4). We fitted the σ(⟨z⟩) data with power laws and then extrapolated to the total projected overlap. The relations can be seen in Fig. 8 for the shifted-true model, calibrated by method 2 (Sect. 3.1) clustering redshifts measured on the ‘mean Rubin’ photometric catalogue. The extrapolation projects the uncertainties to be significantly smaller than the required uncertainties for Euclid. We can be confident of this statement, as even the 402 deg2 Flagship area yields uncertainties approaching or surpassing the Euclid requirement. Similar results are seen for the other three photometric catalogues. A possible cause for concern is the underestimation of the errors in the four highest-redshift bins, shown in Fig. 7. This underestimation can be calibrated with comparisons to simulations (such as Flagship), and accommodated by widening the error bars. We find that these uncertainties are underestimated by a factor of about two. Since Fig. 8 shows the projected errors for the full overlap region to be around an order of magnitude smaller than the Euclid’s required uncertainties, we are confident that these underestimated errors can be accommodated, and that the Euclid target remains achievable.

thumbnail Fig. 8.

Uncertainty on the mean redshift for each Euclid tomographic redshift bin shown as a function of tracer–target overlap area. The red points show the uncertainty on the mean redshift for each subregion, determined by fitting the shifted-true model (Sect. 3.3.1) to measured clustering redshifts (bias correction method 2, Sect. 3.1), with the largest area points representing constraints from the full 402 deg2 Flagship footprint. These points are used to fit a power-law relationship between overlap area and mean redshift uncertainty, shown in blue (the line represents the mean fit and the envelope the uncertainty). Extrapolated to the full area overlap of BOSS, DESI, and Euclid (the dotted purple line), the projected uncertainties on the mean are shown to be much smaller than the required uncertainties for Euclid, itself indicated by the dashed black line.

5. Conclusion

We measured clustering redshifts in the Flagship simulation to test their uncertainties in determining the mean redshifts, ⟨z⟩, for Euclid tomographic bins. The method uses cross-correlations with mock spectroscopic samples, modelled after BOSS, DESI, and Euclid NISP-S. Clustering redshifts were determined using the YAW software, for transverse pair separations between 100 kpc and 1000 kpc, using simple galaxy bias correction schemes. Simulated photometric samples were constructed using the DNF photometric redshift code (Euclid Collaboration 2021b). The redshift determinations were constructed from two sets of training samples, one that is fully representative in redshift and magnitude and a second that has a completeness drop off in IE magnitudes similar to surveys such as Rubin LSST (denoted with ‘Rubin’).

The clustering redshift distributions were fitted with two models: The first modifies the true n(z) with an amplitude and a shift parameter (the ‘shifted-true’ model). The second fits a ‘suppressed-GP’ model, taking advantage of the non-parametric fitting ability of GPs and suppressing low signal-to-noise and negative fluctuations with a S/N-dependent suppression function.

These two models were fitted to Flagship measurements over an area of 402 deg2. By making measurements of the clustering redshifts on subregions of the Flagship footprint, we established power-law relations between the uncertainty on the mean redshift and the spectroscopic–photometric overlapping area. We used these relations to extrapolate the uncertainty to the full expected overlap area for BOSS, DESI, and Euclid (approximately 6000 deg2) and showed that both models achieve uncertainties on the mean redshifts of less than 0.002 (1 + z) – well within the required uncertainties for the Euclid FoM on dark energy of > 400.

However, systematic biases currently dominate the mean redshift determination and are independent of the redshift distribution model. Determining and mitigating these sources of systematic biases will be critical for the usage of cross-correlation redshifts by Euclid. The most difficult step for clustering redshift calibration is determining the galaxy bias of photometric samples. This is the primary source of systematic error and was shown to be the cause of systematic biases in the low-redshift bins. However, these biases persist in the high-redshift bins even when taking advantage of simulation information to correct exactly for photometric galaxy bias, meaning some other source of error is responsible.

Further studies should seek to characterise and mitigate these additional sources of systematic error, by exploring different scales, biasing models, or cross-correlation estimators. Photo-z are limited to z < 1.6 to ensure that the true redshifts of galaxies rarely exceed z > 1.8 in the tenth tomographic bin, since the analysis was limited to the redshift regime where spectroscopic tracers were defined (i.e. z < 1.8). In a future analysis, quasar large-scale structure tracers from BOSS, eBOSS, and DESI should allow for a measurement of the n(z) for high-redshift tomographic bins, though the sparsity of quasars is likely to pose challenges. As simulations of quasar samples are more difficult to implement, since they are highly biased tracers with more complex selection functions, we have not included them in this analysis. Future studies should consider creating such samples so that the biases and uncertainties on these higher-redshift bins can be better determined.

This study is based on idealised assumptions where target and tracer samples suffer no observational complications, such as the spatial incompleteness of spectroscopic samples, tracer–target density correlations with Galactic foregrounds, or systematic depth variations. As such, future studies, and Euclid photo-z mocks in particular, should attempt to model these sources of systematic error. Furthermore, the photometric catalogues used in this study assume supplementary photometry from a Rubin-like survey; in reality, only the southern sky will be supplemented with Rubin, and the northern sky will use photometry from an array of imaging surveys such as CFHT, Pan-STARRS, and J-PAS. This is likely to result in systematic differences in the quality of photo-z based on positions on the sky. To study these effects, realistic Euclid mock catalogues that attempt to simulate these systematic errors across the full sky are required.


Acknowledgments

K. Naidoo acknowledges support from the Science and Technology Facilities Council grant ST/N50449X and from the (Polish) National Science Centre grant #2018/31/G/ST9/03388. H. Johnston acknowledges support from the Delta ITP consortium, a program of the Netherlands Organisation for Scientific Research (NWO) that is funded by the Dutch Ministry of Education, Culture and Science (OCW). O. Lahav acknowledges support from an STFC Consolidated Grant ST/R000476/1. K. Naidoo, H. Johnston, B. Joachimi, and O. Lahav were supported by the UK Space Agency. H. Hildebrandt is supported by a Heisenberg grant of the Deutsche Forschungsgemeinschaft (Hi 1495/5-1) as well as an ERC Consolidator Grant (No. 770935). J. L. van den Busch acknowledges support from the European Research Council under grant numbers 770935. The Euclid Consortium acknowledges the European Space Agency and a number of agencies and institutes that have supported the development of Euclid, in particular the Academy of Finland, the Agenzia Spaziale Italiana, the Belgian Science Policy, the Canadian Euclid Consortium, the French Centre National d’Etudes Spatiales, the Deutsches Zentrum für Luft- und Raumfahrt, the Danish Space Research Institute, the Fundação para a Ciência e a Tecnologia, the Ministerio de Ciencia e Innovación, the National Aeronautics and Space Administration, the National Astronomical Observatory of Japan, the Netherlandse Onderzoekschool Voor Astronomie, the Norwegian Space Agency, the Romanian Space Agency, the State Secretariat for Education, Research and Innovation (SERI) at the Swiss Space Office (SSO), and the United Kingdom Space Agency. A complete and detailed list is available on the Euclid web site (http://www.euclid-ec.org).

References

  1. Alarcon, A., Sánchez, C., Bernstein, G. M., & Gaztañaga, E. 2020, MNRAS, 498, 2614 [NASA ADS] [CrossRef] [Google Scholar]
  2. Amiaux, J., Scaramella, R., Mellier, Y., et al. 2012, in Space Telescopes and Instrumentation 2012: Optical, Infrared, and Millimeter Wave, eds. M. C. Clampin, G. G. Fazio, H. A. MacEwen, J. Oschmann, & M. Jacobus, SPIE Conf. Ser., 8442, 84420Z [NASA ADS] [CrossRef] [Google Scholar]
  3. Behroozi, P. S., Wechsler, R. H., & Wu, H.-Y. 2013, ApJ, 762, 109 [NASA ADS] [CrossRef] [Google Scholar]
  4. Cawthon, R., Davis, C., Gatti, M., et al. 2018, MNRAS, 481, 2427 [NASA ADS] [CrossRef] [Google Scholar]
  5. Cawthon, R., Elvin-Poole, J., Porredon, A., et al. 2022, MNRAS, 513, 5517 [NASA ADS] [CrossRef] [Google Scholar]
  6. Davis, M., & Peebles, P. J. E. 1983, ApJ, 267, 465 [Google Scholar]
  7. Davis, C., Rozo, E., Roodman, A., et al. 2018, MNRAS, 477, 2196 [Google Scholar]
  8. Dawson, K. S., Schlegel, D. J., Ahn, C. P., et al. 2013, AJ, 145, 10 [Google Scholar]
  9. Dawson, K. S., Kneib, J.-P., Percival, W. J., et al. 2016, AJ, 151, 44 [Google Scholar]
  10. DESI Collaboration (Aghamousa, A., et al.) 2016, ArXiv e-prints [arXiv:1611.00037] [Google Scholar]
  11. De Vicente, J., Sánchez, E., & Sevilla-Noarbe, I. 2016, MNRAS, 459, 3078 [NASA ADS] [CrossRef] [Google Scholar]
  12. Euclid Collaboration (Blanchard, A., et al.) 2020a, A&A, 642, A191 [NASA ADS] [CrossRef] [EDP Sciences] [Google Scholar]
  13. Euclid Collaboration (Desprez, G., et al.) 2020b, A&A, 644, A31 [EDP Sciences] [Google Scholar]
  14. Euclid Collaboration (Ilbert, O., et al.) 2021a, A&A, 647, A117 [NASA ADS] [CrossRef] [EDP Sciences] [Google Scholar]
  15. Euclid Collaboration (Pocino, A., et al.) 2021b, A&A, 655, A44 [NASA ADS] [CrossRef] [EDP Sciences] [Google Scholar]
  16. Euclid Collaboration (Scaramella, R., et al.) 2022a, A&A, 662, A112 [NASA ADS] [CrossRef] [EDP Sciences] [Google Scholar]
  17. Euclid Collaboration (Schirmer, M., et al.) 2022b, A&A, 662, A92 [NASA ADS] [CrossRef] [EDP Sciences] [Google Scholar]
  18. Gatti, M., Vielzeuf, P., Davis, C., et al. 2018, MNRAS, 477, 1664 [Google Scholar]
  19. Gatti, M., Giannini, G., Bernstein, G. M., et al. 2022, MNRAS, 510, 1223 [Google Scholar]
  20. Hadzhiyska, B., Alonso, D., Nicola, A., & Slosar, A. 2020, JCAP, 2020, 056 [Google Scholar]
  21. Hartley, W. G., Chang, C., Samani, S., et al. 2020, MNRAS, 496, 4769 [Google Scholar]
  22. Hildebrandt, H., Viola, M., Heymans, C., et al. 2017, MNRAS, 465, 1454 [Google Scholar]
  23. Hildebrandt, H., Köhlinger, F., van den Busch, J. L., et al. 2020, A&A, 633, A69 [NASA ADS] [CrossRef] [EDP Sciences] [Google Scholar]
  24. Hoyle, B., Gruen, D., Bernstein, G. M., et al. 2018, MNRAS, 478, 592 [Google Scholar]
  25. Huterer, D., Takada, M., Bernstein, G., & Jain, B. 2006, MNRAS, 366, 101 [Google Scholar]
  26. Landy, S. D., & Szalay, A. S. 1993, ApJ, 412, 64 [Google Scholar]
  27. Laureijs, R., Amiaux, J., Arduini, S., et al. 2011, ArXiv e-prints [arXiv:1110.3193] [Google Scholar]
  28. Lima, M., Cunha, C. E., Oyaizu, H., et al. 2008, MNRAS, 390, 118 [Google Scholar]
  29. Limber, D. N. 1953, ApJ, 117, 134 [NASA ADS] [CrossRef] [Google Scholar]
  30. LSST Science Collaboration (Abell, P. A., et al.) 2009, ArXiv e-prints [arXiv:0912.0201] [Google Scholar]
  31. McQuinn, M., & White, M. 2013, MNRAS, 433, 2857 [Google Scholar]
  32. Ménard, B., Scranton, R., Schmidt, S., et al. 2013, ArXiv e-prints [arXiv:1303.4722] [Google Scholar]
  33. Morrison, C. B., Hildebrandt, H., Schmidt, S. J., et al. 2017, MNRAS, 467, 3576 [Google Scholar]
  34. Myles, J., Alarcon, A., Amon, A., et al. 2021, MNRAS, 505, 4249 [NASA ADS] [CrossRef] [Google Scholar]
  35. Newman, J. A. 2008, ApJ, 684, 88 [Google Scholar]
  36. Newman, J. A., Abate, A., Abdalla, F. B., et al. 2015, Astropart. Phys., 63, 81 [Google Scholar]
  37. Potter, D., Stadel, J., & Teyssier, R. 2017, Comput. Astrophys. Cosmol., 4, 2 [NASA ADS] [CrossRef] [Google Scholar]
  38. Sánchez, C., Carrasco Kind, M., Lin, H., et al. 2014, MNRAS, 445, 1482 [Google Scholar]
  39. Schmidt, S. J., Ménard, B., Scranton, R., Morrison, C., & McBride, C. K. 2013, MNRAS, 431, 3307 [Google Scholar]
  40. Scottez, V., Mellier, Y., Granett, B. R., et al. 2016, MNRAS, 462, 1683 [NASA ADS] [CrossRef] [Google Scholar]
  41. Scottez, V., Benoit-Lévy, A., Coupon, J., Ilbert, O., & Mellier, Y. 2018, MNRAS, 474, 3921 [Google Scholar]
  42. Tanaka, M., Coupon, J., Hsieh, B.-C., et al. 2018, PASJ, 70, S9 [Google Scholar]
  43. van den Busch, J. L., Hildebrandt, H., Wright, A. H., et al. 2020, A&A, 642, A200 [NASA ADS] [CrossRef] [EDP Sciences] [Google Scholar]
  44. Wright, A. H., Hildebrandt, H., van den Busch, J. L., & Heymans, C. 2020, A&A, 637, A100 [NASA ADS] [CrossRef] [EDP Sciences] [Google Scholar]
  45. Yèche, C., Palanque-Delabrouille, N., Claveau, C.-A., et al. 2020, Res. Notes Am. Astron. Soc., 4, 179 [Google Scholar]

All Figures

thumbnail Fig. 1.

Photometric redshift distribution in comparison to reference spectroscopic samples. Top: redshift ranges for each of the ten tomographic bins. Middle: true redshift distribution of each tomographic bin. Bottom: redshift distribution of the reference spectroscopic samples: BOSS-like LOWZ and CMASS; DESI-like BGS, LRG, and ELG; and Euclid NISP-S. The reference samples only support redshifts up to 1.8, and dictate the maximum redshift of bin 10.

In the text
thumbnail Fig. 2.

Survey footprints for BOSS, DESI, and Euclid shown on the sky, with darker greys indicating regions of tracer–target sample overlap. The footprint perimeter for BOSS is indicated in red, for DESI in blue, and for Euclid in black. Light grey indicates regions of the Euclid survey alone, mid-grey indicates regions with Euclid overlapping with either BOSS or DESI, and dark grey indicates regions with Euclid overlapping both BOSS and DESI. For comparison, the on-sky subregion of the Flagship octant for which we have simulated photo-z is shown in orange. The Euclid survey region is defined to avoid both the Ecliptic (dashed pink line) and Galactic (dash-dotted blue line) planes.

In the text
thumbnail Fig. 3.

Method for fitting suppressed-GP models to clustering redshift, n(z), measurements. The true n(z) for one tomographic bin is shown with dashed black lines. The measured clustering redshift, n(z), is shown with black markers and error bars. (a) We fit a GP model to the clustering redshift, n(z), measurements. (b) We draw random realisations from the GP. (c) We construct a suppression function, taking as input the GP draw and the smoothed S/N of the clustering redshift measurement. (d) We multiply the random realisations from the GP by the suppression function. This ensures that the suppressed-GP model is always positive and suppresses low-S/N fluctuations in the GP. (e) We construct 68.3% and 95.5% confidence envelopes from samples of the suppressed-GP model.

In the text
thumbnail Fig. 4.

Flagship footprint and area rescaling subregions. Left: bootstrap subregions, indicated with different colours, that are used to calculate errors in YAW. Right: different subregions of the Flagship footprint, shown with different colours, used to establish the relation between the tracer–target overlap area and the uncertainty on the mean redshifts of tomographic bins. The four subpanels show the Flagship footprint divided into 2 (top left), 4 (top right), 8 (bottom left), and 16 (bottom right) subregions. These are plotted on an orthographic projection of a subset of the sky focused on the Flagship footprint. The RA and Dec grid is shown with dashed grey lines. The values of the grid lines are indicated where they intercept the x-axis for the RA grid and the y-axis for the Dec grid.

In the text
thumbnail Fig. 5.

Clustering redshift measurements in comparison to the true n(z) for ten simulated Euclid Flagship tomographic photo-z bins. Measurements from YAW are shown in purple, with error bars indicating 95.5% confidence intervals. The measurements clearly trace the true n(z), albeit with some spurious local fluctuations. These fluctuations probably arise due to an incomplete galaxy bias correction methodology. The bias correction method used in this figure is method 2 (Sect. 3.1).

In the text
thumbnail Fig. 6.

Error on the mean redshift determination ⟨z⟩−⟨ztruth for ten Euclid Flagship tomographic bins, for each of our four photometric redshift catalogues (‘mean Rubin’ in dark purple, ‘mc Rubin’ in purple, ‘mean’ in dark green, and ‘mc’ in light green, with dark and light shades indicating 68.3% and 95.5% uncertainties). The grey bands show the target uncertainties for Euclid. Two n(z) fitting methods are shown: the shifted-true model (left, Sect. 3.3.1) and the suppressed-GP model (right, Sect. 3.3.2), each fit to clustering redshift measurements made with spectroscopic sample bias corrections (i.e. method 2, Sect. 3.1).

In the text
thumbnail Fig. 7.

Error on the mean redshift determination, ⟨z⟩−⟨ztruth, in ten Euclid tomographic redshift bins, for each of the four galaxy bias correction strategies (Sect. 3.1), compared via the shifted-true model (Sect. 3.3.1). In dark blue is method 1, where no corrections are applied; in purple is method 2, where the spectroscopic galaxy bias is calibrated by spectroscopic auto-correlations; in magenta is method 3, where the photometric galaxy bias is calibrated by a power-law fit to noisy, photo-z-binned photometric auto-correlations; and in light pink is method 4, where the photometric galaxy bias is calibrated using auto-correlations binned by true redshifts (not applicable to real data). Dark and light shades indicate 68.3% and 95.5% confidence intervals. The grey band shows the target uncertainties for Euclid. Method 4 shows that systematic biases in bins 1–6 are caused by incomplete bias corrections, whilst the biases persist for higher-redshift bins, suggesting some other source of systematic error.

In the text
thumbnail Fig. 8.

Uncertainty on the mean redshift for each Euclid tomographic redshift bin shown as a function of tracer–target overlap area. The red points show the uncertainty on the mean redshift for each subregion, determined by fitting the shifted-true model (Sect. 3.3.1) to measured clustering redshifts (bias correction method 2, Sect. 3.1), with the largest area points representing constraints from the full 402 deg2 Flagship footprint. These points are used to fit a power-law relationship between overlap area and mean redshift uncertainty, shown in blue (the line represents the mean fit and the envelope the uncertainty). Extrapolated to the full area overlap of BOSS, DESI, and Euclid (the dotted purple line), the projected uncertainties on the mean are shown to be much smaller than the required uncertainties for Euclid, itself indicated by the dashed black line.

In the text

Current usage metrics show cumulative count of Article Views (full-text article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.

Data correspond to usage on the plateform after 2015. The current usage metrics is available 48-96 hours after online publication and is updated daily on week days.

Initial download of the metrics may take a while.