Issue 
A&A
Volume 629, September 2019



Article Number  A36  
Number of page(s)  15  
Section  Astronomical instrumentation  
DOI  https://doi.org/10.1051/00046361/201935508  
Published online  02 September 2019 
The shape of the photon transfer curve of CCD sensors
^{1}
LPNHE, (CNRS/IN2P3, Sorbonne Université, Paris Diderot), Laboratoire de Physique Nucléaire et de Hautes Énergies, 75005 Paris, France
email: pierre.astier@in2p3.fr
^{2}
Sorbonne Université, Paris Diderot, CNRS, IN2P3, Laboratoire de Physique Nucléaire et de Hautes Énergies, LPNHE, 75005 Paris, France
Received:
21
March
2019
Accepted:
10
July
2019
The photon transfer curve (PTC) of a CCD depicts the variance of uniform images as a function of their average. It is now well established that the variance is not proportional to the average, as Poisson statistics would indicate, but rather flattens out at high flux. This “variance deficit”, related to the brighterfatter effect, feeds correlations between nearby pixels that increase with flux, and decay with distance. We propose an analytical expression for the PTC shape, and for the dependence of correlations with intensity, and relate both to some more basic quantities related to the electrostatics of the sensor, which are commonly used to correct science images for the brighterfatter effect. We derive electrostatic constraints from a large set of flat field images acquired with a CCD e2v 250, and eventually question the generallyadmitted assumption that boundaries of CCD pixels shift by amounts proportional to the source charges. Our results show that the departure of flat field statistics from the Poisson law is entirely compatible with charge redistribution during the drift in the sensor.
Key words: instrumentation: detectors / methods: data analysis
© P. Astier et al. 2019
Open Access article, published by EDP Sciences, under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
1. Introduction
The response of CCD sensors to uniform illumination is used primarily to probe the sensor cosmetics (and possibly correct science images for some defects), to compensate for possible response nonuniformity, and to measure the gain of the sensor and its electronic chain up to the digitization. For astronomy, the gain of each video channel allows one to evaluate the expected Poisson variance of a pixel from its value, which is required to propagate the shot noise to flux and position measurements performed on astronomical images.
Since Poisson fluctuations drive the variance of uniform illuminations (commonly called flat fields), the gain could easily be obtained as the ratio of the average to the variance of a flat field. (We note that the gain used by astronomers varies in the opposite way to the electronic gain; it is usually expressed in el/ADU, where ADU stands for analogtodigital units, also called “data numbers”). In order to allow for a constant readout noise (very subdominant in practice), one usually performs a series of flat field images at increasing illuminations in order to separate the two contributions. This variance versus average of uniform illuminations is called the photon transfer curve (PTC) of a sensor (or more appropriately of a video channel), and was first introduced, as a means to measure gain and readout noise, in Janesick et al. (1985). When the readout noise becomes negligible, the variance should just be proportional to the average, if it follows Poisson statistics. Downing et al. (2006) showed that the PTC of CCD sensors is not linear but rather flattens out at high fluxes: close to saturation of the sensor, one can miss up to 25% of the variance expected from extrapolating the slope at low flux. The same authors remark that rebinning the image (i.e., summing nearby pixels into bigger ones) improves very efficiently the linearity of the PTC curve. One can readily infer from these observations that nearby pixels of the original images are positively correlated (at least on average), which is indeed reported in Downing et al. (2006). One can also deduce that the covariances between nearby pixels in uniform illuminations grow faster than their average and hence that correlations grow with the average: indeed the correlations shown in Downing et al. (2006) are compatible with a linear increase with the average, and hence the variance should be a quadratic function of the average. One should note that even if the electronic chain is perfectly linear, this is a genuine departure from linearity, because adding two uniform exposures of, for example, 10 ke on average does not give the variance expected in a 20 ke exposure. So, in a 20 ke exposure, the second half is sensitive to the fluctuations in the first half. It is then in principle possible to distinguish a 20 ke flat field exposure from the sum of two 10 ke exposures.
In flat fields, this nonlinearity is only noticeable on variance and covariances, but in structured images, as we will discuss shortly, the average values do not add up. Around 2012, at least three teams noticed that stars on astronomical images, or spots on CCD test benches, tend to become slightly bigger when they become brighter (see Antilogus et al. 2014; Lupton 2014, Appendix B of Astier et al. 2013). This broadening is nowadays referred to as the “brighterfatter effect”. It was probably noticed at these times due to the advent of large observational programs relying on thick fullydepleted sensors (for their high nearinfrared efficiency), which make the effect bigger than in thinned CCDs (Stubbs 2014).
In Antilogus et al. (2014) and Guyonnet et al. (2015), it is proposed that this departure from linearity is due to the electric fields sourced by the charges stored by each pixel potential well. These charges increase with time during image integration. Pixels containing more charges than their neighbors will tend to repel forthcoming charges, hence reducing their own effective physical area. One can derive the size of the expected effects from electrostatics, and the expected effect size is shown to be broadly compatible with the observations in Antilogus et al. (2014), and much more precisely in Lage et al. (2017).
The brighterfatter effect could bias the point spread function (PSF) size by ∼1% or more for faint sources, which would bias PSF fluxes of faint point sources by the same amount; this is no longer tolerable, for example, for supernova Ia cosmology (see, e.g., Betoule et al. 2014). It would also bias the shear of faint galaxies by even more, which is even less acceptable (for example, Jarvis 2014; Mandelbaum 2015). In both cases, biases on this scale are just not acceptable for current large imaging surveys, and in this context, one has to devise a precise correction. So far, all attempts to correct for the brighterfatter effect have relied on the pixel correlation function in flat fields to infer the modifications to pixel boundaries sourced by a given astronomical scene (Gruen et al. 2015; Coulton et al. 2018), an approach proposed in Antilogus et al. (2014) and Guyonnet et al. (2015). The Large Synoptic Survey Telescope (LSST^{1}) strategy to handle the effect follows the same lines, and still anticipates the use of flat field statistics to infer the alteration of pixel areas caused by stored charges. This paper, as compared to previous studies, refines the relation between flat field statistics and pixel area alterations. We also discuss several technicalities of covariance measurements on a practical example, and show that currentlyused simplifications can cause very significant biases of the pixel area alterations and hence of the brighterfatter effect correction. We do not discuss here the practical correction of astronomical scenes described in the above references, noting, however, that they all assume that images are sufficiently well sampled to infer the incoming charge flow over pixel boundaries.
In this paper we first evaluate how variances and covariances in flat fields grow with their average (Sects. 2 and 3), in order to infer as precisely as possible the strength of electrostatic interactions required to constrain any empirical electrostatic model, eventually used to “undo” the brighterfatter effect. These measurements are necessary whether one uses a mostly agnostic approach as in Guyonnet et al. (2015), Gruen et al. (2015) and Coulton et al. (2018) or a numerical solution of Poisson equation as in Lage et al. (2017). Section 4 generalizes the approach to pixel boundary shifts not exactly proportional to the source charges. We describe the laboratory setup used to generate data (Sect. 5), and describe our analysis of a large flat field image set and our findings in Sect. 6. We summarize and conclude in Sect. 7.
2. Importance of PTC and covariance curves shape
The flattening of the PTC can be described in a simple way by adding one order to the polynomial used to fit the curve, that is, replacing a linear fit (expected if Poisson statistics hold, with some readout noise contribution) with a quadratic one. This is somehow justified by the fact that if one models the pixel covariances induced by electrostatics, they scale, to the first order, as the product Vμ (variance times average) of flat fields (Antilogus et al. 2014). Since V scales as μ to zeroth order, and the total noise power (variance plus covariances) is conserved by the electrostatic redistribution, this indicates that the sum of covariances takes away a quadratic contribution (∝μ^{2}) from the variance as flux increases. This paradigm roughly describes the data, so why should we worry about “higher orders” or “next to leading order” (NLO) effects? To set the scale, the “variance deficit” (i.e., by how much the variance of flat fields is lower than the Poisson expectation) can reach 20% at 100 ke intensity. This indicates that higher order corrections could be on the order of 4% at the same intensity. As ignoring the flattening of the PTC biases gain estimations, ignoring the same effect on correlations biases the measurement, possibly by a similar amount. For example, ignoring the quadratic behavior of the PTC would typically bias the gain by 10% if the variance deficit is 20% at the high end.
While it is easy to measure the second order on a PTC, it becomes more involved for covariances, because their uncertainties are on the same order as for PTC, but the values are at least two orders of magnitude lower. This is why we work with data sets of typically 1000 flat field pairs or more, while the shape of the PTC can be characterized with less than 100 pairs.
A model for the PTC shape is proposed in Rasmussen et al. (2016). It relies on a simplified electrostatic model of the sensor to derive a PTC shape model, which describes the data better than a parabola, but still relies on approximations that we will avoid. The electrostatic calculations exposed there indicate that assuming that pixel area distortions scale as source charges is probably not entirely true, as the vast majority of previous works assume. This work also tackles the contributions of diffusion to the brighterfatter effect and confirms that they are largely subdominant.
We now establish the relation between some electrostaticsrelated quantities and the shape of PTC and covariance curves, beyond perturbative arguments.
3. Dynamical development of variance and covariances
We aim here to model the timedependent buildup of correlations in flat fields. We will first express the basic (differential) equations governing the phenomenon, and then solve them.
As common in electrostatics, we distinguish source charges from test charges. When describing a flat field filling up, the source charges are the ones stored in the potential wells of the sensor, and the test charges are the ones drifting in the sensor. We label “00” a particular pixel (far from the edges of the sensor), and index its neighbors by their coordinates with respect to this “central” pixel: Q_{ij} refers to a pixel located i columns and j rows away from the pixel (0, 0). The charge Q_{ij} alters the current impinging on pixel (0, 0), by modifying the drift lines and consequently shifting the pixel boundaries. The current flowing into pixel (0, 0) reads
where a_{kl} describes the strength (and sense) of the interaction, and I is the current that would flow in the absence of interactions (all a_{kl} = 0). Since we are considering uniform exposures, I does not vary with position, or time. The coefficients a_{kl} describe the change of pixel area per unit stored charge caused at a pixel located at a separation (k, l) from the source, where k is the separation along rows (the serial direction), and l the separation along columns (the parallel direction). In Antilogus et al. (2014), coefficients labeled as describe the pixel boundary shifts induced by stored charges. The relation between boundary shifts and change of area can be expressed (to the first order) as , where the sum runs over the four sides of a pixel.
Equation (1) relies on the fact that electrostatic forces are proportional to source charges Q_{kl}, and assumes that the alteration of pixel area is proportional to the charge that is causing it. The latter is not a prescription of electrostatics. Thanks to parity symmetry, these a_{kl} coefficients only depend on the absolute value of k and l. If we consider a single source charge Q_{kl}, the sum of currents flowing into all affected pixels should not depend on this source charge. This imposes the sum rule
where the sum runs over positive, null, and negative k and l. Since a_{00} describes the change of a pixel area due to its own charge content, and since samecharge carriers repel each other, this pixel area has to shrink as charge accumulates inside the pixel, which implies a_{00} < 0. Since the a_{ij} are almost always positive, the sum rule imposes that a_{00} is much larger in absolute value than any other a_{ij}. Since the sum in Eq. (2) necessarily converges, a_{ij} should decay faster than r^{−2} with .
In order to describe the shape of the variance versus average curve, and the associated covariances, we evaluate . We will handle (i, j)=(0, 0) later and first concentrate on (i, j)≠(0, 0). In this latter case, only the second term of Eq. (1) matters,
where C_{ij} denotes the covariance of pixels located at separation (i, j), hence C_{00} is the variance. We then have (still for (i, j) ≠ (0, 0))
where the two covariances are equal because of parity symmetry.
When (i, j) = (0, 0) there is an extra contribution coming from Cov(I_{00}, Q_{00}), where I_{00} refers to the current flowing into the undistorted pixel (0, 0), with its statistical fluctuations. For a Poisson process, this reads V_{I}/2 where V_{I} is the average number of quanta per unit time in the current I_{00}. If all a_{kl} are zero, we get , and C_{00}(t)=V_{I}t, which is just the Poisson variance.
So, we rewrite the above equation for all (i, j) values as
The sum on the righthand side contains a “direct” term a_{ij}C_{00} where the fluctuations of the charge at (i, j) source the covariance. But all covariances involving the source (on the righthand side) and any other pixel also feed covariances (on the lefthand side). These “threepixel terms” are expected to be small, but they are numerous, and we should track them down in the analysis.
If we sum Eq. (5) over all separations, we have
where the last step follows from the sum rule ∑_{ij}a_{ij} = 0, and one goes from Eqs. (6) and (7) by noting that ∑_{ij}C_{i − k, j − l} does not depend on k or l. We then have ∑_{ij}C_{ij} = V_{I}t, that is, the sum of variance and covariances is the Poisson variance V_{I}t. This indicates that if one rebins the uniform image into big enough pixels, the Poisson behavior of the variance versus average curve is restored (as originally reported in Downing et al. 2006). Alternatively, imposing that ∑_{ij}C_{ij} = V_{I}t yields ∑_{ij}a_{ij} = 0. We note that the derivation above does not assume that a_{ij} is independent of time (i.e., accumulated charge).
One can rewrite the differential Eq. (5) as
where C refers to the 2D array of covariances, δ to the 2D discrete delta function, and the symbol ⊗ refers to discrete convolution. One can solve for C as a series of powers of t, but it is tempting to apply a discrete Fourier transform in pixel space (i.e., over the spatial indices involved in the convolution) to this differential equation, so that the convolution product becomes a regular product. The equation system then becomes diagonal,
where refers to the (spatial) Fourier transform of C, and similarly for a. These equations are now independent for each “separation” in reciprocal space. We assume that the a coefficients are constants, that is, that they are independent of time or accumulated charge; we impose , and the solution reads
The Taylor expansion^{2} reads
where V ≡ V_{I}t is the Poisson variance of the image (i.e., the variance for a = 0), and μ ≡ It is its average (unaffected by a, because charge is conserved). Transforming back to direct pixel space, we obtain
where δ refers again to the 2D discrete delta function in pixel space, and TF^{−1} to the inverse Fourier transform. Since V is the Poisson variance, it is proportional to μ and we use the common definition of “gain” used in astronomy, V = μ/g, and further add a constant term to describe the contribution of electronic noise (and its correlations). Making the components explicit, we get
By expressing the constant term as n_{ij}/g^{2}, n is defined in el^{2} units.
The analyses presented in Antilogus et al. (2014) and Guyonnet et al. (2015) roughly correspond to the two first terms in the bracket: the variance C_{00} is approximated by a parabola, and the correlations (C_{ij}/V) are linear in μ (and a_{ij} is their slope, commonly positive). At this level of approximation, there is a trivial relation between the values of a and the measured covariances. Higher order terms mix the relation between the measured C_{ij} and the interaction strengths a_{ij}. Since a_{00} < 0 for all types of CCDs, the variance of flat fields grows less rapidly than their average.
Since the a quantities carry an inverse charge unit, their values are sensitive to the charge unit. If expressing charges in ADU is straightforward, it makes a dependent on the electronic gain, which seems inadequate for quantities attached to the sensor itself. So, we decide to express a in inverse el, and Eq. (14) becomes
where both C_{ij} and μ are expressed in ADU, that is, as measured. The generic numerical factor of the term (μg)^{n} reads 2^{n}/(n + 1)!. Regarding the expansion truncation, we reproduced the analysis that follows with one extra order, and the results are almost indistinguishable. However, for some separations, adding this extra term changes the predictions by as much as 2% for μ close to saturation.
One may note that the conservation of variance (i.e., ∑_{ij}C_{ij} = μ/g, as discussed earlier, see Eq. (8)) is ensured because when summed over all separations, all terms but the first in the righthand side bracket of the above equation vanish. This is a consequence of the sum rule ∑_{ij}a_{ij} = 0, because ∑_{ij}[a ⊗ a]_{ij} = [∑_{ij}a_{ij}]^{2}, for the same reason as the one used earlier between Eqs. (6) and (7). By recurrence, higher convolution powers of a also integrate to 0.
For the shape of the PTC, one can think to approximate the values of convolutions as since a_{00} dominates in size. This is a simple way of approximating the PTC shape as a function of only one parameter, but testing the validity of the approximation still requires the measurement of the other a_{ij} values. Within this approximation, the PTC shape reads
where a_{00} is negative.
One should remark that in Eq. (15), all terms of the expansion are determined by the first order (aμ). Neglecting the term scaling as a^{2} biases a by a relative amount of order aμ, which reaches about 20% at μ = 10^{5} el for the sensor we characterize later in the paper. So, accounting for the term in a^{2} is mandatory when measuring a, and in what follows we have coded all the terms displayed in Eq. (15).
In order to verify the above algebra, we have implemented a MonteCarlo simulation of Eq. (1), rewritten as
where Q is the pixelized image. The integration step reads
where “Poisson” refers to a MonteCarlo realization of a Poisson law that has its argument as average (we used numpy.random.poisson). We reduced the time step until results became stable to a few 10^{−4} level and settled for (T_{i + 1} − T_{i})I = 50 el. We chose a from an electrostatic simulation closely describing our real data, integrated up to μ = 10^{5} el, and generated numerous image sequences. One integration step takes about 2 s (on a core i7 CPU) for a 2k × 2k image. We then checked that fitting Eq. (15) on covariances measured on the simulated images delivers the input a to an acceptable accuracy for statistics similar to our real data set. This test on simulated data was mostly meant to confirm the algebra developed above and test the data reduction and fitting codes, because Eq. (18) can be transformed into Eq. (9) for a time step going to zero. One should then not expect subtle physical effects to show up in this simplified simulation.
4. Questioning the linearity of the interaction model
Our “interaction equation” (Eq. (1)) assumes that the strength of the current alteration is strictly proportional to the source charge. This is questionable because both the shape and the position of the charge cloud within the potential well may evolve as charge accumulates. For example, a quantitative analysis of such an effect can be found in Sect. 4.3 of Rasmussen et al. (2016). In the context of flat fields, one should expect the drift field to go down as charge accumulates in the potential wells. One can also consider the possibility that if the charge cloud stored in a pixel well moves away from the parallel clock stripes as charge flows in, electrostatic forces will increase faster than the stored charges. One could think that covariances will then grow faster than in the linear hypothesis (i.e., forces are just proportional to signal level), but covariances and variance obey a sum rule, so anticipating the direction of the effect is not straightforward. In any case, if such phenomena happen, we expect that both the PTC and the covariances shapes are altered.
In order to quantitatively question this linear assumption, we propose to generalize Eq. (1) by
where we simply assume that the electrostatic force has an extra component (presumably small) proportional to the square of the source charge, as an extra term in a Taylor expansion. Charge conservation imposes a second sum rule: ∑_{ij}a_{ij}b_{ij} = 0. We neglect the contributions of random fluctuations but concentrate on the average, and hence replace charges by their average when multiplied by b. We note that b has the dimension of an inverse charge, like a. We could not find an analytical expression for the solution, and hence resorted to solving for a series in powers of t. Equation (15) becomes
One can note that b only appears in the expression through the ab combination, as in the source Eq. (19). Nonlinearity of the interaction is mostly detected by the term in μ^{2} in the bracket being inconsistent with the linear term for b = 0. The arrays a and b are expressed in the same unit, inverse el, for C_{ij} and μ expressed in ADU.
5. Measurements
We report here measurements performed on a CCD 250 from e2v that has been developed for the LSST project (Juramy et al. 2014; O’Connor et al. 2016). This sensor is made of highresistivity silicon, 100 μm thick, has a 10 μm pixel side, and 4096 × 4004 pixels in total. It is divided into 16 segments, each of which is 512 × 2002 pixels in size and has its own readout channel. Each segment has its own serial register made of 522 pixels: it has ten extra prescan pixels that are not fed by the science array. Following the vendor recommendations, we operate the sensor in full depletion mode.
5.1. Laboratory setup
Our test CCD is temperature controlled at −100 ± 0.01 ° C, is kept inside a Neyco Dewar at pressure below 7 × 10^{−7} mbar, and is read out using the LSST electronic chain (see Juramy et al. 2014 and O’Connor et al. 2016), which runs at room temperature on our test stand, in a dedicated class 10 000/ISO7 clean room. The clean room temperature is regulated (±0.2°C) to minimize temperature effects on the readout electronics. The video channels consist in a dual slope integration (performed by two eightchannel integrated circuits named ASPIC, see Juramy et al. 2014) followed by a 18bit analogtodigital converter (ADC). In our setup, the CCD is connected to the readout electronics by two flex cables (one per half CCD, and per ASPIC), which also transport the CCD clocking lines. The sequencing of read out is delivered by a field programmable gate array (FPGA) driving the CCD clocks (through appropriate power drivers) and the analog integration chain. We typically read at 550 kpixel s^{−1} (so that the image is read out in 2 s) and measure a readout noise of ∼5 el per pixel. The gains are about 0.7 el ADU^{−1}. This setup achieved a gain stability of the full video chain of a few 10^{−4} over three days and always better than 10^{−4} within the 1 h time frame needed to measure the overall response nonlinearity once, as described below.
For flat field studies, our light source is a Newport 69931 QTH (Quartz Tungsten Halogen) lamp, operated at a regulated power of 240 W, which feeds a monochromator via a lens and an order blocking filter, when needed. For the data presented below, the monochromator is set to 650 nm with a slit width of about 15 nm. The light is conveyed into the dark box via an optical fiber (Newport 77639 Liquid Light Guide, 2 m long, 8 mm diameter). A mechanical shutter is placed between the end of the fiber and the entrance port of the integrating sphere. A cooled photodiode (Cooled Large Area Photodiode, “CLAP”, see Regnault et al. 2015, Appendix F) is attached to the dark box wall and placed above the dewar window; it is read out using a lownoise ASIC preamplifier, with ∼300 Hz bandwidth, feeding a 31.25 kHz flashing ADC. The Dewar is attached to one side of the dark box, and sees the integrating sphere at a distance of ∼1 m (see Fig. 1). The illumination system delivers about 10 000 photoelectrons per second and per CCD pixel for a ∼15 nm bandwidth. Our test bench is similar to the one described in O’Connor et al. (2016) for the LSST CCD acceptance test.
Fig. 1. Laboratory setup. The QTH lamp and the monochromator sit outside of the dark enclosure and are not drawn. The light from the monochromator exit slit is conveyed through a liquid light guide (Newport 77639 Liquid Light Guide, 2 m long, 8 mm diameter) that feeds the integrating sphere. Exposure time is controlled through a mechanical shutter placed between the end of the light guide and the sphere entrance port. Our cooled photodiode (“CLAP”) is attached on the dark box wall just above the dewar window, and allows us to measure the effective exposure time (see Fig. 2 below). 

Open with DEXTER 
The CCD is operated within the vendor recommendations (see Table 1): the drift field is created by applying −70 V to the back substrate (namely the light entrance window of the sensor). The CCD250 is a fourphase device^{3}, and during integration, we set two phases low and two phases high. Even for short integrations, we do not run faster than approximately three images per min, which is the expected acquisition rate of LSST.
Voltages used to operate the e2v250 CCD.
In order to measure the nonlinearity of the electronic chains, we use the photodiode to measure the delivered light, integrating numerically the digitized waveform, an example of which is shown in Fig. 2. Our video channels are affected by a small nonlinearity, which we measure and correct (Fig. 3). In order to vary the integrated charge in the CCD image, we vary the openshutter time at a somehow constant illumination intensity, ensured by our light source regulation. The photodiode hence delivers a current essentially independent of the exposure time, and our nonlinearity measurement does not rely on its electronics being linear. We determine a nonlinearity correction for each channel and apply it to the input data^{4}. We note that correcting the variances for differential nonlinearity is more important than correcting the signal levels for integral nonlinearity. In the image series we consider here, the pedestals do not vary by more than 10 ADU’s, and so, wondering if the nonlinearity should be corrected before or after pedestal subtraction is pointless. Figure 4 displays the correction for the 16 channels, and one can notice that the distortions are mostly similar. The prominent dip at roughly half the full range resembles in size and shape the nonlinearity measured when testing the preamplifier, namely the ASPIC circuits. One may note that although our photodiode system allow us to measure the actual openshutter time, we do not rely on this capability when establishing the nonlinearity correction. The plots in Fig. 3 display the data of ten successive acquisitions and allow one to visually judge the overall stability of the gain.
Fig. 2. Waveform acquired from our photodiode for an exposure of ∼3 s. The insets display the signal edges, which result from the shutter motion rather than the bandwidth of the electronics. 

Open with DEXTER 
Fig. 3. Nonlinearity of a video chain and its effect on measured variances. Top: integral nonlinearity of channel 8, and the spline model (with 14 knots) we use to correct for it. Bottom: C_{00}/μ before and after nonlinearity correction. We see that the main distortion has disappeared. 

Open with DEXTER 
Fig. 4. Spline fits to integral nonlinearity of the 16 channels. The main differences between various channels are the overall gains (the two groups correspond to the two different chips hosting the preamplifiers), and the low signal level behavior (presumably due to the onCCD amplifier). 

Open with DEXTER 
5.2. Data set and processing
We use here 1000 pairs of flat field images (at 650 nm, as described above). We refer here to pairs, because all variance or covariance measurements are carried out on pixel to pixel subtractions of pairs of flat fields at the same intensity, in order to eliminate the contribution of illumination or response nonuniformity to the measurements. The data is acquired as ten successive sequences of flat pairs of increasing intensity, so that a slowly varying gain (because, e.g., of temperature variations) does not distort differently low and highintensity images.
We first subtract the pedestal from the image, measured on the serial overscan (ignoring the first five columns). We tried several approaches: subtracting a global value per amplifier, and subtracting from each line the median of its overscan. The latter leaves residual covariance on the order of 2 el^{2} along the serial direction, and we eventually settled for a spline smoothing of the overscan along the parallel direction. We then get residual covariances along the serial direction of about 0.2 el^{2}.
We clip ten pixels on the four sides of the 512 × 2002 pixel area of each channel, because at low and high x (i.e., serial direction) and at low y (parallel direction), the response of the sensor varies rapidly because of distortions of the drift field near its edges. This clipping is not required for all channels, but it allows us to safely compare measurements from different channels.
The variances and covariances are computed from spatial averaging, and using subtractions of image pairs of the same intensity eliminates the contributions from nonuniformity of illumination or sensor sensitivity. However, we have to clip bad pixels, typically cosmetic defects and ionizing particle depositions. To this end, we first clip 5σ outliers in each image of the pair, and then clip 4σ outliers on the subtraction. Toy MonteCarlo simulations show that the bias on variance is 10^{−3} and twice as much for covariances. We compensate for this small bias in the analysis that follows. With a cut at 3σ on the subtraction, the bias of the variance would be about 2.7%, and again twice as large for covariances.
One might wonder if the outlier clipping varies with signal level. We find on average that there are eight more pixels (per channel of 10^{6} pixels) clipped at high flux (10^{5} el) as compared with low flux. If we attribute these eight pixels to the tails of a Gaussian distribution, the relative loss in variance is 1.4 × 10^{−4}. This corresponds to a loss of variance of about 10 el^{2}, while the effects we discuss later are at least on the order of a few hundred. Furthermore, since the number of clipped pixels varies smoothly with signal level, most of the (small) induced bias is firstly absorbed by the gain.
We perform the computation of covariances in the Fourier domain (the code is provided in Appendix A), because it is faster than in direct space as soon as one computes covariances for more than about 5 × 5 separations, and even less if fast Fourier transforms are computed for image sizes that are powers of 2. In terms of symmetry, C_{i, j} = C_{−i, −j}, because these two expressions are algebraically identical, as they involve exactly the same pixel pairs. On the other hand, C_{i, j} and C_{i, −j} do not involve the same pixel pairs (if both i and j are nonzero), but are expected, from parity symmetry, to be equal on average. So, we compute both covariances (for i ≠ 0 and j ≠ 0) for the sake of statistical efficiency, and report their average. For small correlations, the statistical uncertainty of a covariance estimate is
for i or j nonzero, where V is the variance of the pixel distribution, and N is the number of pixel pairs used to evaluate the covariance. The uncertainty of the variance estimation is twice as large. With ∼10^{6} pixels per channel and image, and 1000 image pairs, we measure each correlation (C_{ij}/V) with an (absolute) uncertainty of ∼3 × 10^{−5}, for each channel. The figure improves by a factor of four when averaging over the 16 channels, and by when both i and j are nonzero.
5.3. Deferred charge
Variance and covariances can be affected by contributions unrelated the brighterfatter effect, in particular imperfect charge transport: if a small fraction of a charge belonging to a pixel is eventually read out into its neighbor, a statistical correlation between neighbors will build up. The quality of charge transport in CCDs is commonly studied using “overscans”, which correspond to clock and readout cycles beyond the physical number of rows and/or columns. Charges measured in these first overscan pixels are deferred signals, and are commonly used to measure charge transfer inefficiencies (CTI), in both the serial and parallel directions.
In Fig. 5, we display the data of channel 10 only. The top plot displays the measured content of the first serial overscan pixel (after pedestal subtraction) as a function of the content of the last physical pixel, while the two bottom plots display the serial covariance and the variance, respectively. It is clear that the rapid rise in deferred charge is associated to a peak in the covariance, and a small trough in the variance. To illustrate the relation between deferred charge and covariances, let us consider two successive pixels, p_{0} and p_{1}, each leaving some deferred charge ϵ behind. Thus p_{1} becomes
Fig. 5. Deferred charge measurements, and effects on serial covariance and variance. The three plots refer to channel 10 only, after linearity correction. Top: content of the first serial overscan pixel as a function of flat level (data points and a spline fit). Middle: first serial correlation as a function of flat level, before and after placing the charge back, that is, before and after deferred charge correction. Bottom: same as middle, but for the variance. In Fig. 3, there is no obvious distortion of the variance curve after linearity correction because channel 8 is essentially free of deferred charge. 

Open with DEXTER 
We have
So, the correlation between successive pixels follows the derivative of the deferred charge. Following a similar route, we get Var()≃Var(p_{1})[1 − 2dE[ϵ_{1}]/dp_{1}], which means that we expect a variance deficit at the same charge levels as the peaks in the serial correlation, which can be observed on the bottom plot of Fig. 5. A toy simulation confirms that transferring a signaldependent charge to the next (timewise) pixel produces peaks on the C_{10} versus μ curve at μ values where the deferred charge varies rapidly. In the case where a constant fraction is transferred to the next pixel (possibly negative, at some point of the video chain), this causes a constant correlation offset, so mostly a linear contribution to the covariance, which does not exist in the covariance models discussed above.
We do not have a clear physical model of what causes the deferred serial charge to increase rapidly at specific signal values. This nonlinearity seems to exclude trailing signals in the electronic chain. Not all channels have clear C_{10} peaks (for example channel 8 displayed in Fig. 3 is essentially free of such effects) and different channels have peaks at different μ values. These peaks remain located at the same positions expressed in number of electrons when using another readout board or when altering the gain at the CCD level. This indicates that their cause lies in the sensor itself. The sizes of these peaks are similar in all subregions of the image section corresponding to a given channel. We hence attribute those to some effect happening in the prescan pixels of the serial register, which all collected charges have to traverse. We finally observe that the height of these peaks varies with the parallel gate voltages, which may influence the electric field in the vicinity of the serial registers. We are currently studying a possible mitigation of these peaks by altering the parallel clock levels.
We have modeled the average deferred serial charge by fitting a spline curve to the measurements (Fig. 5, top), for each channel separately, based on the content of the last physical pixels and the first overscan pixels. Using this simple modeling, we preprocess the images by placing the (average) deferred charge back into the previous pixel. Once the correction is done, the peaks in the C_{10} curve vanish as well as their counterparts on the variance curve (Fig. 5, middle and bottom). We do not know why this simple correction procedure slightly overcorrects the C_{10} peak (Fig. 5 middle). In this figure, one can notice that the correction of deferred charge reduces the slope of C_{10}/μ by roughly 10%, and inspecting the model of Eq. (15) shows that this slope drives the a_{10} coefficient value.
We note that the correction procedure we used assumes that all columns are affected in the same way, that is, that all charges go through the defect that causes deferred signal. This is justified by covariances measured separately for different set of columns being similar, and by the “pocketpumping” technique (see, e.g., Sect. 5.3.4 in Janesick 2001) not unveiling traps in the serial register.
The parallel transport of this sensor is far better than the serial one: we typically measure a few ADUs of deferred signal close to saturation, as compared to more than 100 ADUs in the serial direction. We hence decided not to correct for this small effect. We convert the measured values of deferred charge into the commonly used CTI figure: the channel displayed in Fig. 5 has a high signal serial CTI of 200/1.4 × 10^{5}/522 ≃ 3 × 10^{−6}, where 522 is the number of pixels in the serial register. The highest accepted serial CTI for LSST is set to 5 × 10^{−6}. The parallel CTI of this sensor is better than 2 × 10^{−8} at high flux.
We finish this section with one more puzzling observation: the channel displayed in Fig. 5 has a gain of approximately 0.7 el ADU^{−1}, meaning that the overscan pixel reaches about 130 electron at the maximum μ ≃ 10^{5} el. At this highest value, we measure a variance of ∼60 el^{2}, of which typically 25 are expected from readout noise (as measured at the other end of the curve). So, at 10^{5} el, the variance of the deferred charge (∼35 el^{2}) is less that one third of its average (∼130), much less than expected from Poisson statistics. At all values, the measured deferred charge fluctuates much less than expected from Poisson fluctuations and readout noise. A physical model for this deferred charge would have to accommodate this observation, but this goes beyond the scope of this paper.
6. Analysis of the photon transfer curve and covariance curves
We now compare the models presented above to our data set. We fit the C_{ij} versus μ relation with two models, Eqs. (15) and (20), up to terms in (μg)^{3} in the bracket. The fitted parameters are the gain, the a_{ij} and n_{ij} quantities, and when applicable b_{ij}. For μ, we simply use the average between the two members of the image pair.
We fit 64 C_{ij} curves with i < 8 and j < 8, because beyond this separation, the signal is much smaller than shot noise for our data sample. We fit separately each readout channel, using scipy.optimize.leastsq, without binning the data. The uncertainties are derived from shot noise. We iteratively reject outlier measurements at the 5σ level, where the cut is derived from the scatter of the residuals. We initialize the parameters from separate polynomial fits to each separation. The fit takes a few seconds (on a core i7 CPU) for about 50 000 measurements. In the figures we display here, we generally choose to display C_{ij}/μ rather than correlations (C_{ij}/C_{00}), because the latter involve the measured variance, itself affected by the brighterfatter effect.
We first have to decide up to which charge value we should fit. Variance and nearest neighbor covariances change behavior at similar filling levels, as shown on Fig. 6, and it is then fairly easy to define a saturation. We arbitrarily choose a margin of about 10% below this saturation, which makes 10^{5} el. All fits that are described here are carried out to up to this level. Applying this cut involves an iterative procedure since it requires knowledge of the gain, which requires some crude fit of the PTC (we use a third degree polynomial).
Fig. 6. Variance and two nearest covariances as a function of flat field average, in order to illustrate the saturation level (in channel 0). The three curves change behavior around 1.5 × 10^{5} ADUs. The drawn fitting limit is about 10% below this value, and corresponds to 10^{5} el, at a gain of 0.733. 

Open with DEXTER 
Figure 7 displays the PTC fit result of channel 0, and residuals to the two models above, and to a parabolic fit. The inadequacy of the parabolic fit is clear, but allowing for a nonzero b term does not dramatically improve the fit quality at least visually, although the χ^{2} goes down by 65 on average (over channels) for a single extra parameter. The PTCs of the 16 channels are shown in Fig. 8, and Table 2 details the outcome of the data fits regarding the PTC itself (i.e., C_{00}). We find that the model from Eq. (20) describes the data fairly well, although χ^{2} are higher than expected from shot noise, which we attribute to imperfections of the nonlinearity and deferred charge corrections, which are both localized in μ because we use highly flexible functions to model both. The excess in χ^{2} corresponds to offsets at the 2 × 10^{−4} level rms.
Fig. 7. Photon transfer curve of channel 0 fitted with three different models: the full model, a quadratic fit, and the “simple model” with b = 0. The bottom plots display the fit residuals. The full model and the b = 0 model describe well the data, although the χ^{2} is 10% higher for the latter. We believe that part of the fit residuals are artifacts caused by the nonlinearity and deferred charge corrections. 

Open with DEXTER 
Fig. 8. Photon transfer curve of all channels (namely C_{00}/μ), offset by 0.01 times the channel number. The curves going through the data points correspond to the full fit. The statistics associated to these fits are provided in Table 2. 

Open with DEXTER 
Statistics of PTC fits.
The next step is to study the covariance fits. We first illustrate the data by displaying the variance and three nearest neighbor covariances in Fig. 9 for channel 10, which is affected by a varying deferred charge. All covariance measurements have similar statistical uncertainties, so the best relative uncertainties are obtained for the highest covariances, that is, for the nearest neighbors. We first display the fit of the largest covariance, C_{01} (which is not affected by deferred charge). We display the fits results in Fig. 10 to each channel separately and report the statistics of these fits in Table 3. Visually, it is very clear that b ≠ 0 is required. Allowing for b ≠ 0, the χ^{2} goes down by 106 on average over channels, for a single extra degree of freedom. Taken at face value, the value of b_{01} means that the effect of a given charge on its nearest parallel neighbor pixel is 17% larger at μ = 10^{5} el than linearly extrapolated from lowaverage data. The spread of this 17% figure, as measured over the 16 channels, is only 3%.
Fig. 9. Nearest neighbor covariances for channel 10, and variance (divided by μ). We display both the individual measurements and binned values. All quantities are expressed in electron units. The spread is similar for all plots but appears differently because scales are different. The wiggle on C_{10} around μ = 0.6 × 10^{5} is a remainder of the deferred charge correction (Sect. 5.3). It is clear that the data does not follow straight lines. 

Open with DEXTER 
Fig. 10. Fits of C_{01}/μ as a function of μ for the 16 channels. In the top plot, the data and model (the full model of Eq. (20)) have been offset by 0.004 × c, where c is the channel number. We plot both individual measurements and averages at the same intensity, where the error bars reflect the scatter (compatible with the expected shot noise). The bottom plot reports the binned average residuals to both fits. 

Open with DEXTER 
Statistics of C_{01} curve fits (mean and r.m.s. scatter over readout channels).
The nearest serial neighbor covariance C_{10} is much noisier than C_{01}, because the covariance is about 2.5 times smaller, and wiggles have survived the deferred charge correction. However, we display the fit results in Fig. 11 and the fit statistics table in Table 4. The scatter of the measured coefficients is again larger than expected from shot noise, by about a factor of three for a_{10}, although the χ^{2} of the fits are close to the statistical expectation. The χ^{2} improvement due to b ≠ 0 is 17 on average over channels. We note that b_{10} is negative, meaning the anisotropy of the nearest neighbor covariances seems to increase with charge levels.
Fig. 11. Fits of C_{10}/μ as a function of μ for the 16 channels. In the top plot, the data and model (the full model of Eq. (20)) have been offset by 0.004 × c, where c is the channel number. We plot both individual measurements and averages at the same intensity, where the error bars reflect the scatter (compatible with the expected shot noise). The down turn at low flux of channels 8 and 12 is accommodated in the fit by the n_{10} term in the model Eq. (20). The bottom plot reports the binned average residuals to both fits. 

Open with DEXTER 
Statistics of C_{10} curve fits (mean and r.m.s. scatter over readout channels).
Figure 12 displays the fitted a and b values, averaged over channels. At increasing distances, a decays rapidly and becomes isotropic, as visible in Fig. 13 (top). In Fig. 13, we display the a and b values averaged over channels, as a function of distance, with error bars representing the uncertainty on the average, derived from the observed scatter. One can deduce that, with our data, individual a values are measured down to distances of about eight pixels, and b values down to about three to four pixels. For a fit to an electrostatic model, one could use even farther measurements with proper weights. As already noted, b_{01} and b_{10} are found to have opposite signs, and examining the bottom plot of Fig. 13, one observes that b values are mostly negative, with the notable exception of b_{01}. A positive b_{01} can be due to the cloud getting broader in the parallel direction as charge accumulates. We can then imagine two distanceindependent contributions to b: first the decay of the drift field due to stored charges (sometimes referred to as space charge effect), or the electron cloud’s center of gravity gradually changing distance to the parallel clock stripes as charge accumulates. The first effect would cause positive b values, and hence, if present, has to be subdominant. If one attributes the negative b to the second effect, the wells have to move closer to the clock stripes as charge accumulates. Regarding the stored charge diminishing the drift field (or space charge effect), one should note that even if this effect contributes to flat field electrostatics, it is in practice mostly absent from science images, which usually have low to moderate sky background levels.
Fig. 12. Color display of a and b arrays fits, averaged over channels. The parallel direction is vertical. 

Open with DEXTER 
Fig. 13. Values of a and b arrays fits, averaged over channels, as a function of distance. Error bars represent the uncertainty of the average, derived from the observed scatter. One can notice that b values are mostly negative. 

Open with DEXTER 
One final analysis point is the empirical verification of the sum rule in Eq. (2), which we have not enforced in the fit. On average over channels, we find
where the uncertainty reflects the scatter (to be divided by 4 for the uncertainty of the average). To set the scale, a_{00} ≃ −2.4 10^{−6}, that is, the sum rule is satisfied down to the percent level, thus indicating that the effects we measure are mostly due to charge redistribution. Figure 14 displays the sum as a function of maximum separation, and shows that, for our sensor, about 1% of the area lost (or gained) by a pixel due to its charge content is transferred to pixels located seven or more pixels away.
Fig. 14. Cumulative sum of a_{ij} as a function of maximum separation. This plot displays the average over channels. 

Open with DEXTER 
We finish this paragraph with a short technical note about the fitting approach: we have considered fitting in Fourier space rather than in direct space because the expression of the model does not involve convolutions. This is, however, the only benefit over direct space: first, starting from covariances in direct space, one has to Fourier transform those, and the mandatory zero padding correlates the transformed data (which would otherwise be statistically independent because measured covariances have uncertainties independent of the separation). Second, one can think that different “reciprocal separations” in Fourier space could be fitted independently, but the common gain parameter still imposes a fit on all the data at once. Finally, it is trivial to concentrate on small distances in direct space, but selecting largek modes in the power spectrum of image pairs requires the manipulation of a lot of data. So, we have not been able to devise a simpler framework in Fourier space.
6.1. Inaccuracies of simpler analyses of covariance curves
Many works in the literature using pixel covariances to constrain (and correct) the brighterfatter effect (Antilogus et al. 2014; Guyonnet et al. 2015; Gruen et al. 2015; Coulton et al. 2018) assume that pixel correlations are linear with respect to illumination level, that is,
where V generally represents the measured variance C_{00}(μ), and sometimes only one intensity (preferably high, in order to optimize the signaltonoise ratio) is being measured. Using the expression above is a simplification, as compared to Eqs. (15) and (20). We evaluate the biases caused by this simplification alone, using the model fits reported in the previous section. To this end, we compare a_{ij} as extracted from the simplified equation above with that of the model used to evaluate C_{ij} and C_{00}. As in the previous section, we study both the full fit result and the b = 0 case. In Fig. 15, we display the relative difference between a_{ij} evaluated using the above equation and the model value, for a measurement that would be performed at 75 ke (a value representative of the data studied in Guyonnet et al. 2015), averaging over the 16 video channels. We see that for the full fit (b ≠ 0), the nearest neighbor coefficients are offset by −8% and +4%, respectively. Using these biased inputs to correct science images not only compromises the measurement of the size of the PSF, but more importantly causes spurious PSF anisotropy. For the case where b = 0, we see that essentially all a_{ij} are overestimated (except a_{01}, biased by −4%), with a relative bias increasing with separation, up to more than 10 % at distances of ∼3 pixels. For both models, the bias arises from neglecting (or approximating) terms beyond μ^{2} in Eqs. (15) and (20). Depending on the considered sensor, it is plausible that the limitations of the brighterfatter effect corrections observed empirically (e.g., Guyonnet et al. 2015, Mandelbaum et al. 2018) are partly due to the oversimplification implied by Eq. (26).
Fig. 15. Relative systematic bias of the commonly used method that estimates a_{ij} from the slopes of correlations, using a single illumination value at 75 ke. The top figure is for the full model, and the bottom one is for b = 0. In the top case the nearest neighbors a_{ij} are biased by +8% and −4%, respectively. For the bottom case, there is a global overestimation of the effect, increasing with distance. 

Open with DEXTER 
6.2. Nonelectrostatic contributions to covariances
In order to identify nonelectrostatic contributions to covariances, we consider covariances at large distances, where electrostatic contributions are expected to be negligible. From a simple electrostatic model tuned on the wellmeasured nearest neighbors correlations, one can readily infer that electrostaticallyinduced covariances beyond a separation of ∼12 are expected to be much lower than 1 el^{2} at a flat field average of 50 ke, and not detectable with our statistics. Reproducing the shape of the long distance decay of electrostatic covariances is not involved because the source of the disturbing field (i.e., the charge cloud within a pixel potential well) can then be considered as a point source without a significant loss of accuracy.
Figure 16 shows that longdistance covariances are larger than expected from electrostatics only and they increase with the flat field average. We do not know the cause of this small distant signal, which seems almost isotropic. It is, however, smaller than covariances up to separations of about eight pixels, and so does not deserve a correction for the analysis we did in the previous section. The bottom plot of Fig. 16 shows the serial correlation decaying as expected, but at some point, it displayed an oscillating pattern associated to a gain oscillation at 40 kHz induced by a pickup affecting the clocking of the FPGA and in turn the duration of the analog integration windows for signal and pedestal. This was solved by damping the injection by the switching power supply sourcing the noise, and using a phaselocked loop on the FPGA clocks.
Fig. 16. Distant covariances, averaged over the 16 channels. Top: average value of distant covariances as a function of flat field average. Middle: average of covariances as a function of angle, that shows no excess in the serial direction (angle = 0). Bottom: covariances along the serial direction, that do not exhibit any obvious structure on top of the decay expected from electrostatics. 

Open with DEXTER 
7. Discussion
We have developed a framework to analyse photon transfer curves and covariance curves, starting from a model of the effect of stored charges on incoming currents. This framework allows one to constrain the electrostatic distortions as a function of separation and charge level, using largestatistics flat field data covering a large dynamical range. In order to exploit our highstatistics data set, we had to correct for the readout chain nonlinearity and deferred charge effects. In a separate study, we are investigating if altering the operational voltages of the sensor reduces deferred charge effects.
Our model shows that if one evaluates the chargeinduced pixel area changes (the a coefficients) just from the slope of correlation curves, sizable errors should be expected, depending on the sensor, and typically scaling as a_{00}μ. This approximation can in turn bias the a_{ij} measurements by several percent. Our analysis of flat field data shows that, for the e2v sensor we are studying (and under the chosen operational conditions), assuming that pixel boundaries shift linearly with source charges should be questioned. We have not yet explored the practical consequences of this finding when it comes to modeling the brighterfatter effect on science images. One should remark that the image contrasts in uniform images are small as compared to the ones in science images, by typically two orders of magnitude or more. One should question if the lowconstrast measurements carried out in flat fields apply directly to higher constrast images (Rasmussen et al. 2016). We are then attempting to devise practical tests of this apparent nonlinearity using high contrast images.
Finally, we note that all attempts to correct the brighterfatter effect following the framework proposed in Guyonnet et al. (2015) typically leave 10 % of the initial effect in the images (Guyonnet et al. 2015; Gruen et al. 2015; Mandelbaum et al. 2018). We have identified in this work a set of effects that could contribute to these residual PSF variation with flux, by biasing the measurements of the electrostatic forces at play: nonlinearity of the electronic chain, covariances induced by nonelectrostatic sources, oversimplification of the flux dependence of variance and covariances, and small biases in variance and covariance estimates. These small contributions can conspire to leave a fluxdependent PSF after correction of the images for the brighterfatter effect.
For a general presentation of the LSST project, see e.g. Ivezic et al. (2008) or visit http://lsst.org
Acknowledgments
We are grateful to the anonymous referee for a careful reading of the article and for providing very useful suggestions. This paper has undergone internal review in the LSST Dark Energy Science Collaboration. The internal reviewers were C. Lage, A. Nomerotski, and A. Rasmussen, and their remarks significantly improved the manuscript. All authors contributed extensively to the work presented in this paper. This research was mostly funded by CNRS (France). The DESC acknowledges ongoing support from the Institut National de Physique Nucléaire et de Physique des Particules in France; the Science & Technology Facilities Council in the United Kingdom; and the Department of Energy, the National Science Foundation, and the LSST Corporation in the United States. DESC uses resources of the IN2P3 Computing Center (CCIN2P3–Lyon/Villeurbanne – France) funded by the Centre National de la Recherche Scientifique; the National Energy Research Scientific Computing Center, a DOE Office of Science User Facility supported by the Office of Science of the U.S. Department of Energy under Contract No. DEAC0205CH11231; STFC DiRAC HPC Facilities, funded by UK BIS National Einfrastructure capital grants; and the UK particle physics grid, supported by the GridPP Collaboration. This work was performed in part under DOE Contract DEAC0276SF00515.
References
 Antilogus, P., Astier, P., Doherty, P., Guyonnet, A., & Regnault, N. 2014, J. Instrum., 9, C3048 [CrossRef] [Google Scholar]
 Astier, P., El Hage, P., Guy, J., et al. 2013, A&A, 557, A55 [NASA ADS] [CrossRef] [EDP Sciences] [Google Scholar]
 Betoule, M., Kessler, R., Guy, J., et al. 2014, A&A, 568, A22 [NASA ADS] [CrossRef] [EDP Sciences] [Google Scholar]
 Coulton, W. R., Armstrong, R., Smith, K. M., Lupton, R. H., & Spergel, D. N. 2018, AJ, 155, 258 [NASA ADS] [CrossRef] [Google Scholar]
 Downing, M., Baade, B., Sinclaire, P., Deiries, S., & Christen, F. 2006, Proc. SPIE, 6276, 9 [Google Scholar]
 Gruen, D., Bernstein, G., Jarvis, M., et al. 2015, J. Instrum., 10, C05032 [CrossRef] [Google Scholar]
 Guyonnet, A., Astier, P., Antilogus, P., Regnault, N., & Doherty, P. 2015, A&A, 575, A41 [NASA ADS] [CrossRef] [EDP Sciences] [Google Scholar]
 Ivezic, Z., Axelrod, T., Brandt, W. N., et al. 2008, Astron. J., 176, 1 [Google Scholar]
 Janesick, J. R. 2001, Scientific Chargecoupled Devices (S. O. E: Press) [CrossRef] [Google Scholar]
 Janesick, J., Klaasen, K., & Elliott, T. 1985, in Solid State Imaging Arrays, eds. E. L. Dereniak, & K. N. Prettyjohns, Proc. SPIE, 570, 7 [NASA ADS] [CrossRef] [Google Scholar]
 Jarvis, M. 2014, J. Instrum., 9, C03017 [CrossRef] [Google Scholar]
 Juramy, C., Antilogus, P., Bailly, P., et al. 2014, in High Energy, Optical, and Infrared Detectors for Astronomy VI, Proc. SPIE, 9154 [Google Scholar]
 Lage, C., Bradshaw, A., & Tyson, J. A. 2017, J. Instrum., 12, C03091 [CrossRef] [Google Scholar]
 Lupton, R. H. 2014, J. Instrum., 9, C04023 [CrossRef] [Google Scholar]
 Mandelbaum, R. 2015, J. Instrum., 10, C05017 [CrossRef] [Google Scholar]
 Mandelbaum, R., Miyatake, H., Hamana, T., et al. 2018, PASJ, 70, S25 [NASA ADS] [CrossRef] [Google Scholar]
 O’Connor, P., Antilogus, P., Doherty, P., et al. 2016, in High Energy, Optical, and Infrared Detectors for Astronomy VII, Proc. SPIE, 9915 [Google Scholar]
 Rasmussen, A., Guyonnet, A., Lage, C., et al. 2016, in High Energy, Optical, and Infrared Detectors for Astronomy VII, Proc. SPIE, 9915, 99151A [CrossRef] [Google Scholar]
 Regnault, N., Guyonnet, A., Schahmanèche, K., et al. 2015, A&A, 581, A45 [NASA ADS] [CrossRef] [EDP Sciences] [Google Scholar]
 Stubbs, C. W. 2014, J. Instrum., 9, C03032 [CrossRef] [Google Scholar]
Appendix A: Computation of covariances in the Fourier domain
We provide here a sample of the Python code we use to compute covariances in the Fourier domain, together with the calculation in direct space used to check that results are identical, and to compare the computing speeds. In order to avoid that pixels at the end of a line (or column) are correlated with the ones at the beginning, one has to zeropad the data provided as input to the discrete Fourier transform (DFT), in both directions, with at least as many zeros as the maximum considered separation. With numpy.fft, zeropadding is done internally by providing the wanted size (called shape in Python parlance) of the DFT. One technical note is required here: when using DFT for real images (numpy.fft.rfft2), one should provide an even second dimension for the direct transform in order for the inverse transform (irfft2) to return the original data (up to rounding errors).
Here are the Fourier and direct routines:
import numpy as np def compute_cov(diff, w, fft_shape, maxrange) : """ diff : image to compute the covariance of w : weights (0 or 1) of the pixels of diff fft_shape : the actual shape of the DFTs maxrange: last index of the covariance to be computed returns cov[maxrange, maxrange], npix[maxrange,maxrange] """ assert(fft_shape[0]>diff.shape[0]+maxrange) assert(fft_shape[1]>diff.shape[1]+maxrange) # for some reason related to numpy.fft.rfftn, # the second dimension should be even, so my_fft_shape = fft_shape if fft_shape[1] %2 == 1 : my_fft_shape = (fft_shape[0], fft_shape[1]+1) # FFT of the image tim = np.fft.rfft2(diff*w, my_fft_shape) # FFT of the mask tmask = np.fft.rfft2(w, my_fft_shape) # three inverse transforms: pcov = np.fft.irfft2(tim*tim.conjugate()) pmean= np.fft.irfft2(tim*tmask.conjugate()) pcount= np.fft.irfft2(tmask*tmask.conjugate()) # now evaluate covariances and numbers of "active" pixels cov = np.ndarray((maxrange,maxrange)) npix = np.zeros_like(cov) for dx in range(maxrange) : for dy in range(maxrange) : # compensate rounding errors npix1 = int(round(pcount[dy,dx])) cov1 = pcov[dy,dx]/npix1pmean[dy,dx]*pmean[dy,dx]/(npix1*npix1) if (dx == 0 or dy == 0): cov[dy,dx] = cov1 npix[dy,dx] = npix1 continue npix2 = int(round(pcount[dy,dx])) cov2 = pcov[dy,dx]/npix2pmean[dy,dx]*pmean[dy,dx]/(npix2*npix2) cov[dy,dx] = 0.5*(cov1+cov2) npix[dy,dx] = npix1+npix2 return cov,npix def cov_direct_value(diff ,w, dx,dy): (ncols,nrows) = diff.shape if dy>=0 : im1 = diff[dy:, dx:] w1 = w[dy:, dx:] im2 = diff[:ncolsdy, :nrowsdx] w2=w[:ncolsdy, :nrowsdx] else: im1 = diff[:ncols+dy, dx:] w1 = w[:ncols+dy, dx:] im2 = diff[dy:, :nrowsdx] w2 = w[dy:, :nrowsdx] w_all = w1*w2 npix = w_all.sum() im1_times_w = im1*w_all s1 = im1_times_w.sum()/npix s2 = (im2*w_all).sum()/npix p = (im1_times_w*im2).sum()/npix cov = ps1*s2 return cov,npix
All Tables
Statistics of C_{01} curve fits (mean and r.m.s. scatter over readout channels).
Statistics of C_{10} curve fits (mean and r.m.s. scatter over readout channels).
All Figures
Fig. 1. Laboratory setup. The QTH lamp and the monochromator sit outside of the dark enclosure and are not drawn. The light from the monochromator exit slit is conveyed through a liquid light guide (Newport 77639 Liquid Light Guide, 2 m long, 8 mm diameter) that feeds the integrating sphere. Exposure time is controlled through a mechanical shutter placed between the end of the light guide and the sphere entrance port. Our cooled photodiode (“CLAP”) is attached on the dark box wall just above the dewar window, and allows us to measure the effective exposure time (see Fig. 2 below). 

Open with DEXTER  
In the text 
Fig. 2. Waveform acquired from our photodiode for an exposure of ∼3 s. The insets display the signal edges, which result from the shutter motion rather than the bandwidth of the electronics. 

Open with DEXTER  
In the text 
Fig. 3. Nonlinearity of a video chain and its effect on measured variances. Top: integral nonlinearity of channel 8, and the spline model (with 14 knots) we use to correct for it. Bottom: C_{00}/μ before and after nonlinearity correction. We see that the main distortion has disappeared. 

Open with DEXTER  
In the text 
Fig. 4. Spline fits to integral nonlinearity of the 16 channels. The main differences between various channels are the overall gains (the two groups correspond to the two different chips hosting the preamplifiers), and the low signal level behavior (presumably due to the onCCD amplifier). 

Open with DEXTER  
In the text 
Fig. 5. Deferred charge measurements, and effects on serial covariance and variance. The three plots refer to channel 10 only, after linearity correction. Top: content of the first serial overscan pixel as a function of flat level (data points and a spline fit). Middle: first serial correlation as a function of flat level, before and after placing the charge back, that is, before and after deferred charge correction. Bottom: same as middle, but for the variance. In Fig. 3, there is no obvious distortion of the variance curve after linearity correction because channel 8 is essentially free of deferred charge. 

Open with DEXTER  
In the text 
Fig. 6. Variance and two nearest covariances as a function of flat field average, in order to illustrate the saturation level (in channel 0). The three curves change behavior around 1.5 × 10^{5} ADUs. The drawn fitting limit is about 10% below this value, and corresponds to 10^{5} el, at a gain of 0.733. 

Open with DEXTER  
In the text 
Fig. 7. Photon transfer curve of channel 0 fitted with three different models: the full model, a quadratic fit, and the “simple model” with b = 0. The bottom plots display the fit residuals. The full model and the b = 0 model describe well the data, although the χ^{2} is 10% higher for the latter. We believe that part of the fit residuals are artifacts caused by the nonlinearity and deferred charge corrections. 

Open with DEXTER  
In the text 
Fig. 8. Photon transfer curve of all channels (namely C_{00}/μ), offset by 0.01 times the channel number. The curves going through the data points correspond to the full fit. The statistics associated to these fits are provided in Table 2. 

Open with DEXTER  
In the text 
Fig. 9. Nearest neighbor covariances for channel 10, and variance (divided by μ). We display both the individual measurements and binned values. All quantities are expressed in electron units. The spread is similar for all plots but appears differently because scales are different. The wiggle on C_{10} around μ = 0.6 × 10^{5} is a remainder of the deferred charge correction (Sect. 5.3). It is clear that the data does not follow straight lines. 

Open with DEXTER  
In the text 
Fig. 10. Fits of C_{01}/μ as a function of μ for the 16 channels. In the top plot, the data and model (the full model of Eq. (20)) have been offset by 0.004 × c, where c is the channel number. We plot both individual measurements and averages at the same intensity, where the error bars reflect the scatter (compatible with the expected shot noise). The bottom plot reports the binned average residuals to both fits. 

Open with DEXTER  
In the text 
Fig. 11. Fits of C_{10}/μ as a function of μ for the 16 channels. In the top plot, the data and model (the full model of Eq. (20)) have been offset by 0.004 × c, where c is the channel number. We plot both individual measurements and averages at the same intensity, where the error bars reflect the scatter (compatible with the expected shot noise). The down turn at low flux of channels 8 and 12 is accommodated in the fit by the n_{10} term in the model Eq. (20). The bottom plot reports the binned average residuals to both fits. 

Open with DEXTER  
In the text 
Fig. 12. Color display of a and b arrays fits, averaged over channels. The parallel direction is vertical. 

Open with DEXTER  
In the text 
Fig. 13. Values of a and b arrays fits, averaged over channels, as a function of distance. Error bars represent the uncertainty of the average, derived from the observed scatter. One can notice that b values are mostly negative. 

Open with DEXTER  
In the text 
Fig. 14. Cumulative sum of a_{ij} as a function of maximum separation. This plot displays the average over channels. 

Open with DEXTER  
In the text 
Fig. 15. Relative systematic bias of the commonly used method that estimates a_{ij} from the slopes of correlations, using a single illumination value at 75 ke. The top figure is for the full model, and the bottom one is for b = 0. In the top case the nearest neighbors a_{ij} are biased by +8% and −4%, respectively. For the bottom case, there is a global overestimation of the effect, increasing with distance. 

Open with DEXTER  
In the text 
Fig. 16. Distant covariances, averaged over the 16 channels. Top: average value of distant covariances as a function of flat field average. Middle: average of covariances as a function of angle, that shows no excess in the serial direction (angle = 0). Bottom: covariances along the serial direction, that do not exhibit any obvious structure on top of the decay expected from electrostatics. 

Open with DEXTER  
In the text 
Current usage metrics show cumulative count of Article Views (fulltext article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.
Data correspond to usage on the plateform after 2015. The current usage metrics is available 4896 hours after online publication and is updated daily on week days.
Initial download of the metrics may take a while.