Revisiting the radio interferometer measurement equation
IV. A generalized tensor formalism
Netherlands Institute for Radio Astronomy (ASTRON) PO Box 2, 7990AA Dwingeloo, The Netherlands
email: smirnov@astron.nl
Received: 22 February 2011
Accepted: 1 June 2011
Context. The radio interferometer measurement equation (RIME), especially in its 2 × 2 form, has provided a comprehensive matrixbased formalism for describing classical radio interferometry and polarimetry, as shown in the previous three papers of this series. However, recent practical and theoretical developments, such as phased array feeds (PAFs), aperture arrays (AAs) and widefield polarimetry, are exposing limitations of the formalism.
Aims. This paper aims to develop a more general formalism that can be used to both clearly define the limitations of the matrix RIME, and to describe observational scenarios that lie outside these limitations.
Methods. Some assumptions underlying the matrix RIME are explicated and analysed in detail. To this purpose, an array correlation matrix (ACM) formalism is explored. This proves of limited use; it is shown that matrix algebra is simply not a sufficiently flexible tool for the job. To overcome these limitations, a more general formalism based on tensors and the Einstein notation is proposed and explored both theoretically, and with a view to practical implementations.
Results. The tensor formalism elegantly yields generalized RIMEs describing beamforming, mutual coupling, and widefield polarimetry in one equation. It is shown that under the explicated assumptions, tensor equations reduce to the 2 × 2 RIME. From a practical point of view, some methods for implementing tensor equations in an optimal way are proposed and analysed.
Conclusions. The tensor RIME is a powerful means of describing observational scenarios not amenable to the matrix RIME. Even in cases where the latter remains applicable, the tensor formalism can be a valuable tool for understanding the limits of such applicability.
Key words: methods: analytical / methods: data analysis / methods: numerical / techniques: interferometric / techniques: polarimetric
© ESO, 2011
Introduction
Since its formulation by Hamaker et al. (1996), the radio interferometer measurement equation (RIME) has been adopted by the calibration and imaging algorithm development as the mathematical formalism of choice when describing new methods and techniques for processing radio interferometric data. In its 2 × 2 matrix version (also known as the Jones formalism, or JF) developed by Hamaker (2000), it has achieved remarkable simplicity and economy of form.
Recent developments, however, have begun to expose some limitations of the matrix RIME. In particular, phased array feeds (PAFs) and aperture arrays (AAs), while perfectly amenable to a JF on the systems level (in the sense that the response of a pair of PAF or AA compound beams can be described by a 2 × 2 Jones matrix), do not seem to fit the same formalism on the element level. In general, since a Jones matrix essentially maps two complex electromagnetic field (EMF) amplitudes onto two feed voltages, it cannot directly describe a system incorporating more than two receptors per station (as in, e.g., the “tripole” design of Bergman et al. 2003). And on the flip side of the coin, Carozzi & Woan (2009) have shown that two complex EMF amplitudes are insufficient – even when dealing with only two receptors – to properly describe widefield polarimetry, and that a threedimensional Wolf formalism (WF) is required. Other “awkward” effects that don’t seem to fit into the JF include mutual coupling of receptors.
These circumstances seem to suggest that the JF is a special case of some more general formalism, one that is valid only under certain conditions. The second part of this paper presents one such generalized formalism. However, given the JF’s inherent elegance and simplicity, the degree to which is is understood in the community, and (pragmatically but very importantly) the availability of software implementations, it will in any case continue to be a very useful tool. It is therefore important to establish the precise limits of applicability of the JF, which in turn can only be done in the context of a broader theory.
The first part of this paper therefore reexamines the basic tenets of the RIME, and highlights some underlying assumptions that have not been made explicit previously. It then proposes a generalized formalism based on tensors and Einstein notation. As an illustration, some tensor RIMEs are then formulated, for observational scenarios that are not amenable to the JF. The tensor formalism is shown to reduce to the JF under the previously established assumptions. Finally, the paper discusses some practical aspects of implementing such a formalism in software.
1. Why is the RIME 2 × 2?
As a starting point, I will consider the RIME formulations derived in Paper I of this series (Smirnov 2011a). A few crucial equations are reproduced here for reference. Firstly, the RIME of a point source gives the visibility matrix measured by interferometer pq as the product of 2 × 2 matrices: the intrinsic source brightness matrix , and the perantenna Jones matrices J_{p} and J_{q}: (1)The Jones matrix J_{p} describes the total signal propagation path from source to antenna p. For any specific observation and instrument, it is commonly represented by a Jones chain of individual propagation effects: (2)which leads to the onion form of the RIME: (3)The individual terms in the matrix product above correspond to different propagation effects along the signal path. Any practical application of the RIME requires a set of matrices describing specific effects, which are then inserted into Eq. (3). These specific matrices tend to have standard singleletter designations (see e.g. Noordam & Smirnov 2010, Sect. 7.3). In particular, the K_{p} term^{1} describes the geometric (and fringe stopped) phase delay to antenna p, K_{p} = e^{ − 2πi(upl + vpm + wp(n − 1))}. The rest of the Jones chain can be partitioned into directionindependent effects (DIEs, or uvplane effects) on the right, and directiondependent effects (DDEs, or imageplane effects) on the left, designated as^{2}G_{p} and E_{p}. We can then write a RIME for multiple discrete sources as (4)Substituting the exponent for the term then gives us the Fourier transform (FT) kernel in the fullsky RIME: (5)where all matrix terms^{3} under the integration sign are functions of direction l,m.
The first fundamental assumption of the RIME is linearity^{4} The second assumption is that the signal is measured in a narrow enough frequency band to be essentially monochromatic, and at short enough timescales that J_{p} is essentially constant; departures from these assumptions cause smearing or decoherence, which has already been reviewed in Paper I (Smirnov 2011a, Sect. 5.2). These assumptions are obvious and wellunderstood. It is more interesting to consider why the RIME can describe instrumental response by a 2 × 2 Jones matrix. Any such matrix corresponds to a linear transform of two complex number into two complex numbers, so why two and not some other number? This actually rests on some further assumptions.
1.1. Dual receptors
In general, an EMF is described by a complex 3vector ε. However, an EMF propagating as a transverse plane wave can be fully described by only two complex numbers, e = (e_{x},e_{y})^{T}, corresponding to the first two components of ε in a coordinate system where the third axis is along the direction of propagation. At the antenna feed, the EMF is converted into two complex voltages v = (v_{a},v_{b})^{T}. Given a transverse plane wave, two linearly independent complex measurements are necessary and sufficient to fully sample the polarization state of the signal.
In other words, a 2 × 2 RIME works because we build dualreceptor telescopes; we do the latter because two receptors are what’s needed to fully measure the polarization state of a transverse plane wave. PAFs and AAs have more than two receptors, but once these have been electronically combined by a beamformer into a pair of compound beams, any such pair of beams can be considered as a virtual receptor pair for the purposes of the RIME.
Carozzi & Woan (2009) have pointed out that in the widefield case, the EMF arriving from offaxis sources is no longer parallel to the plane of the receptors, so we can no longer measure the polarization state with the same fidelity as for the onaxis case. In the extreme case of a source lying in the plane of the receptors, the loss of polarization information is irrecoverable. Consequently, proper widefield polarimetry requires three receptors. With only two receptors, the lossoffidelity effect can be described by a Jones matrix of its own (which the authors designate as ), but a fully threedimensional formalism is required to derive itself.
1.2. The closed system assumption
When going from the basic RIME of Eqs. (1) to (3), we decompose the total Jones matrix into a chain of propagation effects associated with the signal path from source to station p. This is the traditional way of applying the RIME pioneered in the original paper (Hamaker et al. 1996), and continued in subsequent literature describing applications of the RIME (Noordam 1996; Rau et al. 2009; Myers et al. 2010; Smirnov 2011a).
Consider an application of Eq. (3) to real life. Depending on the application, individual components of the Jones chains J_{p,i} may be derived from a priori physical considerations and models (e.g. models of the ionosphere), and/or solved for in a closedloop manner, such as during selfcalibration. Crucially, Eq. (3) postulates that the signal measured by interferometer pq is fully described by the source brightness and the set of matrices J_{p,i} and J_{q,j}, and does not depend on any effect in the signal propagation path to any third antenna r. If, however, antenna r is somehow electromagnetically coupled to p and/or q, the measured voltages v_{p} and v_{q} will contain a contribution received via the signal path to r, and thus will have a nontrivial dependence on, e.g., J_{r,1} that cannot be described by the 2 × 2 formalism alone.
To be absolutely clear, the basic RIME of Eq. (1) still holds as long as any such coupling is linear. In other words, there is always a single effective J_{p} that ties the voltage v_{p} to the source EMF vector e. In some applications, e.g. traditional selfcal, where we solve for this J_{p} in a closedloop manner, the distinction on whether J_{p} depends on propagation path p only, or whether other effects are mixed in, is entirely irrelevant. However, when constructing more complicated RIMEs (as is being done currently for simulation of new instruments, or for new calibration techniques), an implicit assumption is made that we may decompose J_{p} into perstation Jones chains, as in Eq. (3). This is tantamount to assuming that each station forms a closed system.
Consider the effect of electrical crosstalk, or mutual coupling in a denselypacked array. If crosstalk or coupling is restricted to the two receptors within a station, such a station forms a closed system. For a closed system, the Jones chain approach is perfectly valid. If, however, crosstalk occurs between receptors associated with different stations, the receptor voltages v_{p} will not only depend on J_{p,i}, but also on J_{q,j}, J_{r,k}, etc. (See Sect. 2.1 for a more thorough discussion of this point.) With the emergence of AA and PAF designs for new instruments, we can no longer safely assume that two receptors form a closed system; in fact, even traditional interferometers can suffer from troublesome crosstalk in certain situations (Subrahmanyan & Deshpande 2004).
Some formulations of the RIME can incorporate coupling within each pair of stations p and q via an additional 4 × 4 matrix (see e.g. Noordam 1996) used to describe multiplicative interferometerbased effects. By definition, this approach cannot incorporate coupling with a third station r; any such coupling requires additional formulations that are extrinsic to the 2 × 2 RIME, such as the ACM formalism of Sect. 2, or the tensor formalism that is the main subject of this paper.
The closed system assumption has not been made explicit in the literature. This is perhaps due to the fact that the RIME is nominally formulated for a single interferometer pq. Consider, however, that for an interferometer array composed of N stations, the “full” RIME is actually a set of N(N − 1) / 2 equations. By treating the equations independently, we’re implicitly assuming that each equation corresponds to a closed system. The higherorder formalisms derived below will make this issue clear.
1.3. The colocation assumption
A final seldom explicated assumption is that each pair of receptors is colocated. While not required for the general RIME formulation of Eq. (1) per se, colocation becomes important (and is quietly assumed) in specific applications for two reasons. Firstly, it allows us to consider the geometric phase delay of both receptors to be the same, which makes the K_{p} matrix scalar, and allows us to commute it around the Jones chain. K_{p} and can then be commuted together to form the FT kernel, which is essential for deriving the fullsky variants of the RIME such as Eq. (5). And secondly, although the basic RIME of Eq. (1) may be formulated for any four arbitrarilylocated receptors, when we proceed to decompose J_{p} into perstation terms, we implicitly assume a single propagation path per each pair of receptors (same atmosphere, etc.), which implies colocation. In practice the second consideration may be negligible, but not so the first.
Classical singlefeed dish designs have colocated receptors as a matter of course, but a PAF system such as APERTIF (van Cappellen & Bakker 2010) or ASKAP (Johnston et al. 2008) typically has horizontally and vertically oriented dipoles at slightly different positions. The effective phase centres of the beamformed signals may be different yet again. The K_{p} matrix then becomes diagonal but not scalar, and can no longer be commuted around the RIME. In principle, we can shoehorn the case of noncolocated receptors into the RIME formulations by picking a reference point (e.g., the midpoint between the two receptors), and decomposing K_{p} into a product of a scalar phase delay corresponding to the reference point, and a nonscalar differential delay term: The scalar term can then be commuted around the RIME to yield the FT kernel of Eq. (5), while becomes a DIE that can be absorbed into the overall phase calibration (or cause instrumental V or U polarization if it isn’t). The exact form of and can be derived from geometric considerations (or analysis of instrument optics), but such a derivation is extrinsic to the RIME per se. This situation is similar to that of the term derived by Carozzi & Woan (2009), and is another reason behind the multidimensional formalism proposed later on in this paper.
Note that conventional FTbased imaging algorithms also assume colocated receptors when converting visibilities to Stokes parameters. For example, the conventional formulae for I and U,
implicitly assume that the constituent visibilities are measured on the same baseline. Some leeway is acceptable here: since the measured visibilities are additionally convolved by the aperture illumination function (AIF), the formulae above still apply, as long as the degree of noncolocation is negligible compared to the effective station size. Note also that some of the novel approaches of expectationmaximization imaging (Leshem & van der Veen 2000; Levanda & Leshem 2010) formulate the imaging problem in such a way that the colocation requirement can probably be done away with altogether.
2. The array correlation matrix formalism
I will first explore the limitations of the closedsystem assumption a little bit further. Consider an AA, PAF, or conventional closelypacked interferometer array where mutual coupling affects more than two receptors at a time. Such an array cannot be partitioned into pairs of receptors, with each pair forming a closed system. The normal 2 × 2 RIME of Eq. (3) is then no longer valid. An alternative is to describe the response of such an array in terms of a single array correlation matrix (ACM, also called the signal voltage covariance matrix), as has been done by Wijnholds (2010) for AAs, and Warnick et al. (2011) for PAFs. Since the ACM provides a valuable conceptual link between the 2 × 2 RIME and the tensor formalism described later in this paper, I will consider it in some detail in this section.
Let’s assume an arbitrary set of n receptors (e.g. dipoles) in arbitrary orientation, and a single point source of radiation. If we represent the voltage response of the full array by the column vector v = (v_{1}...v_{n})^{T}, then we can express it (assuming linearity as usual) as the product of a n × 2 matrix with the source EMF vector e:
If all pairwise combinations of receptors are correlated, we end up with an n × n ACM^{5}V: (6)where is the 2 × 2 source brightness matrix, and J is an n × 2 Joneslike matrix for the entire array. Note that for n = 2, this equation becomes the autocorrelation matrix given by the RIME of Eq. (1) with p = q.
To derive the J matrix for a given observation, we need to decompose it into a product of “physical” terms that we can analyse individually. As an example, let’s consider only three effects: primary beam (PB) gain, geometric phase, and crosstalk. The J matrix can then be decomposed as follows: (7)and the full ME then becomes: (8)The n × 2 E matrix corresponds to the PB gain, the n × n diagonal K matrix corresponds to the individual phase terms (different for every receptor), and the n × nQ matrix corresponds to the crosstalk and/or mutual coupling between the receptors. The equation does not include an explicit term for the complex receiver gains: these can be described either by a separate diagonal matrix, or absorbed into Q.
In the case of a classical array of dishes, we have n = 2m receptors, with each adjacent pair forming a closed system. In this case, Q becomes blockdiagonal – that is, composed of 2 × 2 blocks along the diagonal, equivalent to the “leakage” matrices of the original RIME formulation (Hamaker et al. 1996). K becomes blockscalar (κ_{1} = κ_{2},κ_{3} = κ_{4},...), and Eq. (8) dissolves into the familiar set of m(m − 1) / 2 independent RIMEs of Eq. (3).
Note that the ordering of terms in this equation is not entirely physical – in the actual signal path, the phase delay represented by K occurs before the beam response E. To be even more precise, phase delay may be a combination of geometric phase that occurs “in space” before E, and fringe stopping that occurs “in the correlator” after Q. Such an ordering of effects becomes very awkward to describe with this matrix formalism, but will be fully addressed by the tensor formalism of Sect. 3.
2.1. Imageplane effects and crosstalk
If we now consider additional imageplane effects^{6}, things get even more awkward. In the simple case, if these effects do not vary over the array (i.e. for a given direction, are the same along each line of sight to each receptor), we can replace the e vector in Eq. (7) by Ze, where Z is a Jones matrix describing the imageplane effect. We can then combine the n × 2 E matrix and the 2 × 2 Z matrix into a single term R = EZ, which is a n × 2 matrix describing the voltage gain and all other imageplane effects, and define an n × n “apparent sky” matrix as . Equation (8) then becomes
If imageplane effects do vary across receptors, then a matrix formalism is no longer sufficient! The expression for each receptor p must somehow incorporate its own Z_{p} Jones matrix. We need to describe signal propagation along n lines of sight, and each propagation effect needs a 2 × 2 matrix. A full description of the imageplane term then needs n × 2 × 2 complex numbers.
Another way to look at this conundrum is as follows. As long as each receptor pair is colocated and forms a closed system (as is the case for traditional interferometers), the voltage response of each receptor depends only on the EMF vector at its location. The correlations between stations p and r can then be fully described in terms of the EMF vectors at locations p and r. This allows us to write the RIME in a matrix form, as in Eqs. (3) or (8). In the presence of significant crosstalk between more than two receptors, the voltage response of each receptor depends on the EMF vectors at multiple locations. In effect, the crosstalk term Q in Eq. (8) “scrambles up” image plane effects between different receptor locations; describing this is beyond the capability of ordinary matrix algebra.
In practice, receptors that are sufficiently separated to see any conceivable difference in imageplane effects would be too far apart for any mutual coupling, while today’s alldigital designs have also eliminated most possibilities of crosstalk. Mathematically, this corresponds to Z_{p} ≈ Z_{r} where q_{pr} ≠ 0, which means that imageplane effects can, in principle, be shoehorned into the matrix formalism of Eq. (8). This, however, does not make the formalism any less clumsy – we still need to describe different imageplane effects for farapart receptors, and mutual coupling for closetogether ones, and the two effects together are difficult to shoehorn into ordinary matrix multiplication.
2.2. The nonparaxial case
Carozzi & Woan (2009) have shown that the EMF can only be accurately described by a 2vector in the paraxial or nearlyparaxial case. For widefield polarimetry, we must describe the EMF by a rank3 column vector ε = (e_{x},e_{y},e_{z})^{T}, and the sky brightness distribution by a 3 × 3 matrix B^{(3)} = ⟨ εε^{H} ⟩ . The intrinsic sky brightness is still given by a 2 × 2 matrix ; once an xyz Cartesian system is established, this maps to via a 3 × 2 transformation matrix T (ibid., Eqs. (20) and (21)):
It is straightforward to incorporate this into the ACM formalism: the term of Eq. (8) is replaced by B^{(3)}, and the dimensions of the E matrix become n × 3.
3. A tensor formalism for the RIME
The ACM formalism of the previous section turns out to be only marginally useful for the purposes of this paper. It does aid in understanding the effect of mutual coupling and the closed system assumption a little bit better, but it is much too clumsy in describing imageplane effects, principally because the rules of matrix multiplication are too rigid to represent this particular kind of linear transform. What we need is a more flexible scheme for describing arbitrary multilinear transforms, one that can go beyond vectors and matrices. Fortunately, mathematicians have already developed just such an apparatus in the form of tensor algebra. In this section, I will apply this to derive a generalized multidimensional RIME.
3.1. Tensors and the Einstein notation: a primer
Tensors are a large and sprawling subject, and one not particularly familiar to radio astronomers at large. Appendix A provides a brief but formal description of the concepts required for the formulations of this paper. This is intended for the indepth reader (and to provide rigorous mathematical underpinnings for what follows). For an executive overview, only a few basic concepts are sufficient:

Tensors are a generalization of vectors andmatrices. An (n,m)type tensor is given by an (n + m)dimensional array of numbers, and written using n upper and m lower indices: e.g. . Superscripts are indices just like subscripts, and not exponentiation^{7}! For example, a vector is typically a (1, 0)type tensor, denoted as x^{i}. A matrix is a (1, 1)type tensor, denoted as .

Upper and lower tensor indices are quite distinct, in that they determine how the components of a tensor behave under coordinate transforms. Upper indices are called contravariant, since components with an upper index (such as the components of a vector x^{i}) transform reciprocally to the coordinate frames. As a simple example, consider a “new” coordinate frame whose basis vectors are scaled up by a factor of a with respect to those of the “old” frame. In the “new” frame, the same vector is then described by coordinate components that are scaled by a factor of a^{1} w.r.t. the “old” components. By contrast, for a linear form f_{j} (that is, a linear function mapping vectors to scalars), the “new” components are scaled by a factor of a. Lower indices are thus said to be covariant. In physical terms, upper indices tend to refer to vectors, and lower indices to linear functions on vectors. An n × n matrix can be thought of as a “vector” of n linear functions on vectors, and thus has one upper and one lower index in tensor notation, and transforms both co and contravariantly. This is manifest in the familiar T^{1}AT (or TAT^{1}, depending which way the coordinate transform matrix T is defined) formula for matrix coordinate transforms. For higherranked tensors, the general rules for coordinate transforms are covered in Sect. A.2.1.

Einstein notation (or Einstein summation) is a convention whereby repeated upper and lower indices in a product of tensors are implicitly summed over. For example, is a way to write the matrix/vector product y = Ax in Einstein notation. The j index is a summation index since it is repeated, and the i index is a free index. Another useful convention is to use Greek letters for the summation indices. For example, a matrix product may be written as .

The tensor conjugate is a generalization of the Hermitian transpose. This is indicated by a bar over the symbol and a swapping of the upper and lower indices. For example, is the conjugate of x^{i}, and is the conjugate of .
3.2. Recasting the RIME in tensor notation
As an exercise, let’s recast the basic RIME of Eq. (1) using tensor notation. This essentially repeats the derivations of Paper I (Smirnov 2011a) using tensor terminology (compare to Sect. 1 therein).
For starters, we must define the underlying vector space. The classical Jones formalism (JF) corresponds to rank2 vectors, i.e. the C^{2} space. We can also use C^{3} space instead, which results in a version of the Wolf formalism (WF) suggested by Carozzi & Woan (2009). Remarkably, both formulations look exactly the same in tensor notation, the only difference being the implicit range of the tensor indices. I’ll stick to the familiar terminology of the JF here, but the same analysis applies to the WF.
An EMF vector is then just a (1, 0)type tensor e^{i}. Linear transforms of vectors (i.e. Jones matrices) correspond to (1, 1)type tensors, (note that p is not, as yet, a tensor index here, but simply a station “label”, which is emphasized by hiding it within brackets). The voltage response of station p is then
where α is a summation index. The coherency of two voltage or EMF vectors is defined via the outer product^{8}, yielding a (1, 1)type tensor, i.e. a matrix:
Combining the two equations above gives us
And now, defining the source brightness tensor as , we arrive at (9)which is exactly the RIME of Eq. (1), rewritten using Einstein notation. Not surprisingly, it looks somewhat more bulky than the original – matrix multiplication, after all, is a more compact notation for this particular operation.
Now, since we can commute the terms in an Einstein sum (as long as they take their indices with them, see Sect. A.5.2), we can split off the two J terms into a subproduct which we’ll designate as [J_{pq} ] : (10)What is this J_{pq}? It is a (2, 2)type tensor, corresponding to 2 × 2 × 2 × 2 = 16 numbers. Mathematically, it is the exact equivalent of the outer product , giving us the 4 × 4 form of the RIME, as originally formulated by Hamaker et al. (1996). The components of the tensor given by correspond exactly to the components of a 4vector produced via multiplication of the 4 × 4 matrix by the 4vector SI (see Paper I, Smirnov 2011a, Sect. 6.1).
Finally, note that we’ve been “hiding” the p and q station labels inside square brackets, since they don’t take part in any tensor operations above. Upon further consideration, this distinction proves to be somewhat artificial. Let’s treat p and q as free tensor indices in their own right^{9}. The set of all Jones matrices for the array can then be represented by a (2, 1)type tensor All the visibilities measured by the array as a whole will then be represented by a (2, 2)type tensor , and we can then rewrite Eq. (9) as (11)...which is now a single equation for all the visibilities measured by the array, en masse (as opposed to the visibility of a single baseline given by Eqs. (1) or (9)). Such manipulation of tensor indices may seem like a purely formal trick, but will in fact prove very useful when we consider generalized RIMEs below.
Note that the brightness tensor B is selfconjugate (or Hermitian), in the sense that . The visibility tensor V, on the other hand, is only Hermitian with respect to a permutation of p and q:
4. Generalizing the RIME
In this section, I will put tensor notation to work to incorporate imageplane effects and mutual coupling and beamforming into a generalized RIME hinted at in Sect. 2. This shows how the formalism may be used to derive a few different forms of the RIME for various instrumental scenarios. Note that the resulting equations are somewhat speculative, and not necessarily applicable to any particular reallife instrument. The point of the exercise is to demonstrate the flexibility of the formalism in deriving RIMEs that go beyond the capability of the Jones formalism.
First, let’s set up some indexing conventions. I’ll use i,j,k,... for free indices that run from 1 to N = 2 (or 3, see below), i.e. for those that refer to EMF components, or voltages on paired receptors, and α,β,γ,... for summation indices in the same range. I shall refer to such indices as 2indices (or 3indices). For free indices that refer to stations or disparate receptors (and run from 1 to N), I’ll use p,q,r,s,..., and for the corresponding summation indices, σ,τ,υ,φ,... I shall refer to these as station indices.
Consider again the N arbitrary receptors of Sect. 2 observing a single source. The source EMF is given by the tensor e^{i}. All effects between the source and the receptor, up to and not including the voltage gain, can be described by a (2, 1)type tensor, This implies that they are different for each receptor p. The PB response of the receptor can be described by a (1, 1)type tensor, . Finally, the geometric phase delay of each receptor is a (1, 0)type tensor, K^{p}. Let’s take this in small steps. The EMF field arriving at each receptor p is given by (12)(remembering that we implicitly sum over α here). If we consider just one receptor in isolation, we can rewrite the equation for one specific value of p. This corresponds to the familiar matrix/vector product:
where Z is the Jones matrix describing the imageplane effect for this particular receptor, and K is the geometric phase delay. The receptor translates the EMF vector e^{′i} into a scalar voltage v′. This is done via its PB response tensor, E_{i}, which is just a row vector:
Now, if we put the receptor index p back in the equations, we arrive at the tensor expression: (13)We’re now summing over α when applying imageplane effects, and over β when applying the PB response.
Finally, crosstalk and/or mutual coupling scrambles the receptor voltages. If v^{′p} is the “ideal” voltage vector without crosstalk, then we need to multiply it by an n × n matrix (i.e. a (1, 1)type tensor) to apply crosstalk: (14)The final equation for the voltage response of the array is then: (15)We’re now summing over σ (which ranges over all receptors), α and β.
The visibility tensor , containing all the pairwise correlations between the receptors, can then be computed as . Applying Eq. (15), this becomes
This uses a different set of summation indices within each pair of brackets, since each sum is computed independently. Doing the conjugation and rearranging the terms around, we arrive at: (16)This is the tensor form of a RIME for our hypothetical array. Note that structurally it is quite similar to the ACM form of Sect. 2 (e.g. Eq. (8)), but with one principal difference: the (2, 1)type Z tensor describes receptorspecific effects, which cannot be expressed via a matrix multiplication. Note also that the other awkwardness encountered in Sect. 2, namely the difficulty of putting geometric phase delay and fringe stopping into their proper places in the equation, is also elegantly addressed by the tensor formalism. Additional phase delays tensors can be inserted at any point of the equation.
4.1. Wolf vs. Jones formalisms
Equation (16) generalizes both the classical Jones formalism (JF), and the threecomponent Wolf formalism (WF). The JF is constructed on top of a twodimensional vector space: EMF vectors have two components, the indices α,β,... range from 1 to 2, and the B tensor is the usual 2 × 2 brightness matrix. The WF corresponds to a threedimensional vector space, with the B tensor becoming a 3 × 3 matrix.
Recall (Sect. 2.2) that the 3 × 3 brightness matrix is derived from the 2 × 2 brightness matrix via a 3 × 2 transformation matrix T. This derivation can also be expressed as an Einstein sum:
where T is the tensor equivalent of the transformation matrix.
In subsequent formulations, I will make no distinction between the JF and the WF unless necessary, with the implicit understanding that the appropriate indices range from 1 to 2 or 3, depending on which version of the formalism is needed.
4.2. Decomposing the J matrix
If we isolate the lefthand subproduct in Eq. (16),
and track down the free indices in this tensor expression – p and α – we can see that the product is a (1, 1) tensor, We can then rewrite the equation in a more compact form: (17)Not surprisingly, this is just the ACM RIME of Eq. (6) rewritten in Einstein notation. In hindsight, this shows how we can break down the fullarray response matrix J into a tensor product of physically meaningful terms. Note how this parallels the situation of the 2 × 2 form RIME: even though each 2 × 2 visibility matrix, in principle, depends on only two Jones matrices (Eq. (1)), in reallife applications we almost always need to form them up from a chain of several different Jones terms, as in e.g. the onion form (Eq. (3)). What the tensor formulation offers is simply a more capable means of computing the response matrices (more capable than a matrix product, that is) from individual propagation tensors.
4.3. Characterizing propagation tensors
Since it the original formulation of the matrix RIME, a number of standard types of Jones matrices have seen widespread use. The construction of Jones matrices actually follows fairly simple rules (even if their behaviour as a function of time, frequency and direction may be quite complicated). A number of similar rules may be proposed for propagation tensors:

a tensor that translates the EMF vector into another vector (e.g.,Faraday rotation) must necessarily have an upper and a lower2index;

a tensor that translates both components of the EMF field equally (i.e. a scalar operation such as phase delay) does not need any indices at all;

a tensor transforming the EMF vector into a scalar (e.g., the voltage response of a receptor) must have a lower 2index;

a tensor for an effect that is different across receptors must have a station index;

a tensor for an effect that maps perreceptor quantities onto perreceptor quantities must have two station indices (upper and lower).
Some examples of applying these rules:

Faraday rotation translates vectors, so it must have an upper and alower 2index. If different across stations and/or receptors, itmust also have a station index. This suggests that the tensor lookslike (or ).

Phase delay operates on the EMF vector as a scalar. It is different across receptors, hence its tensor looks like K^{p}.

PB response translates the EMF vector into a scalar voltage, and must therefore have one lower 2index. It is usually different across stations and/or receptors, hence its tensor looks like

Crosstalk or mutual coupling translates receptor voltages into receptor voltages, so it needs two station indices. Its tensor looks like .

If mutual coupling needs to be expressed in terms of the EMF field at each receptor instead, then it may need two 2indices and two station indices, giving a (2, 2)type tensor, . Alternatively, this may be combined with the PB response tensor E, giving the voltage response of each receptor as a function of the EMF vector at all the other receptors. This would be a (2, 1)tensor, .
4.4. Describing mutual coupling
Equations (15) and (16) were derived under the perhaps simplistic assumption that the effect^{10} of mutual coupling can be fully described via crosstalk between the receptor voltages. That is, the collection of EMF vectors per each receptor’s location was described by a (2,0)type tensor, e^{pi} (Eq. (12)), then converted into nominal receptor voltages by the PB tensor (Eq. (13)), and then converted into actual voltages via a (1, 1)type crosstalk tensor (Eq. (14)).
The underlying assumption here is that each receptor’s actual voltage can be derived from the nominal voltages alone. To see why this may be simplistic, consider a hypothetical array of n identical dipoles in the same orientation, parallel to the x axis. Nominally, the dipoles are then only sensitive to the x component of the EMF, which, in terms of the PB tensor E, means that for all p. Consequently, the actual voltages v^{p} given by this model will only depend on the x component of the EMF. If mutual coupling causes any dipole to be sensitive to the y component of the EMF seen at another dipole, this results in a contamination of the measured signal that cannot be described by this voltageonly crosstalk model.
A more general approach is to describe the voltage response of each receptor as a function of the EMF at all the receptor locations, rather than the nominal receptor voltages. This requires a (1, 2)type tensor:
This tensor (consisting of n × n × 2 complex numbers) then describes the PB response and the mutual coupling together. The simpler crosstalkonly model corresponds to being decomposable into a product of two (1, 1)type tensors (n × n + n × 2 complex numbers), as This model will perhaps prove to be sufficient in reallife applications, but it is illustrative how simple it is to extend the formalism to the more complex case.
4.5. Describing beamforming
In modern PAF and AA designs, receptors are grouped into stations, and operated in beamformed mode – that is, groups of receptor voltages are added up with complex weights to form one or more compound beams. The output of a station is then a single complex voltage (strictly speaking, a single complex number, since beamforming is usually done after A/D conversion) per each compound beam, rather than n individual receptor voltages.
Beamforming may also be described in terms of the tensor RIME. Let’s assume N stations, each being an array of n_{1},n_{2},...,n_{N} receptors. The voltage vector v^{a} registered at station p (where a = 1...n_{p}) can be described by Eq. (15). In addition, the voltages are subject to perreceptor complex gains (which we had quietly ignored up until now), which corresponds to another term, g^{a}. The output of one beamformer, f, is computed by multiplying this by a covector of weights, w_{a}: (18)In a typical application, the beamformer outputs are correlated across stations. In this context, it is useful to derive a compound beam tensor, which would allow us to treat a whole station as a single receptor. To do this, we must assume that image plane effects are the same for all receptors in a station (). Furthermore, we need to decompose the phase term K^{σ} into a common “station phase” K, and a perreceptor differential delay (δK)^{σ}, so that K^{σ} = K(δK)^{σ}. The latter can be derived in a straightforward way from the station (or dish) geometry. We can then collapse some summation indices: (19)This expression is quite similar to Eq. (15). Now, if for station p the compound beam tensor is given by , then a complete RIME for an interferometer composed of beamformed stations is: (20)which is very similar to the RIME of Eq. (16), except that the PB tensor E has been replaced by the station beam tensor S, and there’s no crosstalk between stations. If each station produces a pair of compound beams (e.g., for the same pointing but sensitive to different polarizations), then this equation reduces to the classical matrix RIME, where the EJones term is given by a tensor product. In principle, we could also combine Eqs. (18) and (20) into one long equation describing both beamforming and stationtostation correlation.
This shows that a compound beam tensor () can always be derived from the beamformer weights, receptor gains, mutual coupling terms, element PBs, and station geometry, under the assumption that imageplane effects are the same across the aperture of the station. By itself this fact is not particularly new or surprising, but its useful to see how the tensor formalism allows it to be formulated as an integral part of the RIME.
As for the imageplane effects assumption, it is probably safe for PAFs and small AAs, but perhaps not so for large AAs. If the assumption does not hold, we’re left with an extra σ index in Eq. (19), and may no longer factor out an independent compound beam tensor . This situation cannot be described by the Jones formalism at all, but is easily accommodated by the tensor RIME.
4.6. A classical dualpol RIME
Equation (16) describes all correlations in an interferometer in a single (1, 1)type tensor (matrix). Contrast this to Eq. (11), which does the same via a (2, 2)type tensor, by grouping pairs of receptors per station. Since the latter is a more familiar form in radio interferometry, it may be helpful to recast Eq. (16) in the same manner. First, we mechanically replace each receptor index (p,q,σ,τ) by pairs of indices (pi, qj, συ, τφ), corresponding to a station and a receptor within the station:
Next, we assume colocation (since the perstation receptors are, presumably, colocated) and simplify some tensors. In particular, K and Z can lose their receptor indices:
This equation cannot as yet be expressed via the Jones formalism, since for any p,q, the sum on the righthand side contains terms for other stations (σ,τ). To get to a Jonesequivalent formalism, we need to remember the closed system assumption, i.e. no crosstalk or mutual coupling between stations (Sect. 1.2). This corresponds to for p ≠ q. Q is then equivalent to a tensor of one rank lower, with one station index eliminated: (21)For any p,q, this is now exactly equivalent to a Jonesformalism RIME of the form:
where K_{p} is a scalar, and the rest are full 2 × 2 matrices. The Q_{p} term here incorporates the traditional GJones (receiver gains) and DJones (polarization leakage). Finally, if we assume no polarization leakage (i.e. no crosstalk between receptors), then for i ≠ j, and we can lose another index: (22)In the Jones formalism, this is equivalent to Q_{p} being a diagonal matrix for any given p.
4.7. A fullsky tensor RIME
By analogy with the matrix RIME (see Paper I, Smirnov 2011a, Sect. 3), we can extend the tensor formalism to the fullsky case. This does not lead to any new insights at present, but is given here for the sake of completeness.
When observing a real sky, each receptor is exposed to the superposition of the EMFs arriving from all possible directions. Let’s begin with Eq. (16), and assume the Q term is a DIE, and the rest are DDEs. For a fullsky RIME, we need to integrate the equation over all directions as
which, projected into lm coordinates, gives us: (23)let’s isolate a few tensor subproducts and collapse indices. First, we can introduce an “apparent sky” tensor:
Note that this is an n × n matrix. Physically, corresponds to the coherency “seen” by receptors p and q as a function of direction. Next, we introduce a phase tensor:
which another n × n matrix. Note that we reuse the letter K here, but there shouldn’t be any confusion with with the “other” K^{p}, since the tensor type is different. Each component of this tensor is given by
Equation (23) then becomes simply: (24)where the integral then corresponds to n × n elementbyelement Fourier transforms, and all the DDErelated discussions of Papers I (Smirnov 2011a, Sect. 3) and II (Smirnov 2011b, Sect. 2) apply.
4.7.1. The apparent coherency tensor
If we designate the value of the integral in Eq. (23) by the apparent coherency tensor , we have arrive at the simple equation
which ties together the observed correlation matrix, , and the apparent coherency tensor . The physical meaning of each element of is, obviously, the apparent coherency observed by receptor pair σ and τ. The crosstalk term Q “scrambles up” the apparent coherencies among all receptors. Note that this similar to the coherency matrix X (or X_{pq}) used in the classical formulation of the matrix RIME (Hamaker et al. 1996; Smirnov 2011a, Sect. 1.7).
4.8. Coordinate transforms, or whither tensors?
Einstein summation by itself is a powerful notational convenience for expressing linear combinations of multidimensional arrays, one that can be gainfully employed without regard to the finer details of tensors. The formulations of this paper may in fact be read in just such a manner, especially as they do not seem to make explicit use of that many tensorspecific constructs. It is then a fair question whether we need to invoke the deeper concepts of tensor algebra at all.
There is one tensor property, however, that is crucial within the context of the RIME, and that is behaviour under coordinate transforms. In the formulations above, I did not specify a coordinate system. As in the case of the matrix RIME, the equations hold under change of coordinate frame, but their components must be transformed following certain rules. The general rules for tensors are given in Sect. A.4 (Eq. (A.1)); for the mixeddimension tensors employed in this paper, coordinate transforms only affect the core C^{2} (or C^{3}) vector space, and do not apply to station indices (the latter are said to be invariant, see Sect. A.6.2).
As long as we know that something is a tensor of a certain type, we have a clear rule for coordinate transformations given by Eq. (A.1). However, Einstein notation can be employed to form up arbitrary expressions, which are not necessarily proper tensors unless the rigorous rules of tensor algebra are followed (see Appendix A). This argues against a merely mechanical use of Einstein summation, and makes it worthwhile to maintain the mathematical rigour that enables us to clearly follow whether something is a tensor or not.
5. Implementation aspects
Superficially, evaluation of Einstein sums seems straightforward to implement in software, since it is just a series of nested loops. Upon closer examination, it turns out to raise some nontrivial performance and optimization issues, which I’ll look at in this section.
5.1. A general formula for FLOP counts
Consider an Einstein sum that is a product of k tensors (over a Ddimensional vector space), with n free and m summation indices. I’ll call this an (n,m,k)calibre product. Let’s count the number of floatingpoint operations (ops for short) required to compute the result. The resulting tensor has D^{n} components. Each component is a sum of D^{m} individual products (thus D^{m} − 1 additions); each product incurs k − 1 multiplications. The total op count is thus (25)For mixeddimensionality tensors, a similar formula may be derived by replacing D^{n} and D^{m} with and , where the two dimensions are D_{1} and D_{2}, and the index counts per each dimensionality are numbered accordingly.
Consider a few familiar examples:

multiplication of2 × 2 matrices, : ;

multiplication of 4 × 4 matrices: ;

outer product of 2 × 2 matrices, : ;

multiplication of a 4 × 4 matrix by a 4vector, : ;

the equivalent operation (see Eq. (10)) of multiplying a (2, 2)type tensor (with D = 2) by a matrix; : .
5.2. Partitioning an Einstein sum
Mathematically equivalent formulations can often incur significantly different numbers of ops. For example, in Paper I (Smirnov 2011a, Sect. 6.1), I already noted that a straightforward implementation of a 2 × 2 RIME is cheaper than the same equation in 4 × 4 form, although the specific op counts given therein are in error^{11}.
Let’s consider a 2 × 2 RIME of the form of Eq. (3), with two sets of Jones terms, which we’ll designate as D and E. We then have the following fullyequivalent formulations in 2 × 2 and 4 × 4 form: while in tensor notation the same equation can be formulated as (28)The cost of this Einstein sum is ops. In comparison, the 2 × 2 form incurs 4 matrix products, for a total of only 48 ops, while the 4 × 4 form incurs^{12} two outer products and two 4 × 4 matrix/vector products, for a total of 88. For longer expressions with more Jones terms (i.e. larger m), bruteforce Einstein summation does progressively worse.
It is easy to see the source of this inefficiency. In the innermost loop (say, over j), only the rightmost term is changing, so it is wasteful to repeatedly take the product of the other four terms at each iteration. We can trim some of this waste by computing things in a slightly more elaborate order. Let’s split up the computation as (29)and compute first (costing ops), followed by (costing ops). This is an improvement, but we don’t have to stop here: a similar split can be applied to in turn, and so on, ultimately yielding the following sequence of operations: (30)But this is just a sequence of 2 × 2 matrix products, i.e. exactly the same computations that occur in the 2 × 2 formulation! And on the other hand, as already intimated by Eq. (10), the 4 × 4 form is equivalent to a different partitioning of the same expression, namely (31)The crucial insight here is that different partitionings of the computation in Eq. (28) incur different numbers of ops.
Let’s look at what happens to the calibres during partitioning. Consider a partition of an (n,m,k)calibre product into two steps. The first step computes an (n′,m′,k′)calibre subproduct (for example, in Eq. (29), the initial calibre is (2,4,5), and the subproduct for has calibre (2,3,4)). At the second step, the result of this is multiplied with the remaining terms, resulting in an expression of calibre (n,m − m′,k − k′ + 1) (in Eq. (29), this is , with a calibre of (2,1,2)). The calibres are strictly related: each of the k terms goes to either one subproduct or the other, but we incur one extra term (A) in the partitioning, hence we have k − k′ + 1 terms at the second step. The summation indices are also partitioned between the steps, hence m − m′ are left for the second step. As for the free indices, their number n′ may actually temporarily increase (as in the case of Eq. (31), where subproducts have the calibre (4,0,2)). It is straightforward to show that if it does not increase, then
so as long as n′ ≤ n, partitioning always reduces the total number of ops. In essence, this happens because in the total op counts, a product is replaced by a sum: D^{m′} + D^{m − m′} < D^{m}.
From this it follows that the 2 × 2 form of the RIME is, in a sense, optimal. The partitioning given by Eq. (30) reduces an operation into m operations of each; the latter represents the smallest possible nontrivial subproduct. (Note that the rank of any subproduct of Eq. (28) can only be an even number, since all the terms have an even rank. The minimum nontrivial n′ is therefore 2.)
5.3. Dependence optimization
The partitioning given by Eq. (30) allows for a few alternatives, corresponding to different order of matrix multiplication. While seemingly equivalent, they may in fact represent a huge opportunity for optimization, when we consider that in real life, the equation needs to be evaluated millions to billions of times, for all antenna pairs, baselines, time and frequency bins. Not all the terms in the equation have the same time and frequency dependence: some may be constant, some may be functions of time only or frequency only, some may change a lot slower than others – in other words, some may have limited dependence. For example, in the “onion” of Eq. (26), if and E_{p} have a limited dependence, say on frequency only, then the inner part of the “onion” can be evaluated in a loop over frequency channels, but not over timeslots. The resulting savings in ops can be enormous.
This was already demonstrated in the MeqTrees system (Noordam & Smirnov 2010), which takes advantage of limited dependence onthefly. A RIME like Eq. (26) is represented by a tree, which typically corresponds to the following order of operations:
with an outermost loop being over the layers of the “onion”, and inner loops over times and frequencies. When the operands have limited dependence (as e.g. for the product), the MeqTrees computational engine automatically skips unnecessary inner loops. Thus the amount of loops is minimized on the “inside” of the equation, and grows as we move “out” through the layers and add terms with more dependence. I call this dependence optimization.
Among the alternative partitionings of Eq. (30), the one that computes the subproducts with the least dependence first can benefit from dependence optimization the most.
5.4. Commutation optimization
In a 2 × 2 matrix RIME, dependence optimization works best if the terms with the least dependence are placed on the inside of the equation – if limited dependence happens to apply to D_{p} (on the outside) and not E_{p} (on the inside), dependence optimization can’t reduce any inner loops at all. Unfortunately, one cannot simply change the order of the matrices willynilly, since they don’t generally commute. However, when dealing with specific kinds of matrices that do commute, we can do some optimization by shuffling them around. Reallife RIMEs tend to be full of matrices with limited commutation properties, such as scalar, diagonal and rotation matrices (see Paper I, Smirnov 2011a, Sect. 1.6).
In tensor notation, commute if the summation indices can be swapped around: Some of the commutation rules of 2 × 2 matrices discussed in Paper I (ibid.) do map to tensor form easily. For example, a diagonal matrix is a tensor with the property for i ≠ j. If A and B are both diagonal, then is only nonzero for i = j, and commutation is obvious. Other commutation rules are more opaque: rotation matrices are known to commute among themselves, but this does not follow from tensor notation at all. Therefore, opportunities for commutation optimization of a tensor expression may not be detectable until we recast it into matrix form.
5.5. Towards automatic optimization
For the more complicated expressions of e.g. Eqs. (16) or (20), different partitionings may prove to be optimal. The previous sections show how to do such analysis formally. In fact, one could conceive of an algorithm that, given a a tensor expression in Einstein form, searches for an optimal partitioning automatically (with dependences taken into account).
It is also possible that alternative partitionings may prove to be more or less amenable to parallelization and/or implementation on GPUs. The tensor formalism may prove to be a valuable tool in this area. Recasting a series of tensor operations (matrix products, etc.) as a single Einstein sum, such as that in Eq. (28), shows the computation in its “flattest” (if relatively inefficient) form, which can then be repartitioned to yield equivalent but more efficient formulations.
6. Conclusions
The 2 × 2 matrix RIME, having proven itself as a very capable tool for describing classical radio interferometry, is showing its limitations when confronted with PAFs, AAs, and widefield polarimetry. This is due to a number of implicit assumptions underlying the formalism (planepolarized, dual, colocated receptors, closed systems) that have been explicated in this paper. The RIME may be rewritten in an array correlation matrix form that makes these assumptions clearer, but this struggles to combine imageplane effects and mutual coupling in the same equation.
A more general formalism based on tensors and Einstein notation is proposed. This reduces to the 2 × 2 (and 4 × 4) forms of the RIME under the explicated assumptions. The tensor formalism can be used to step outside the bounds of these assumptions, and can accommodate regimes not readily described in 2 × 2 matrix form. Some examples of the latter are:

Coupling between closelypacked stations cannot be describedin the basic 2 × 2 form (where a Jones chain corresponding to each signal path is used) without additional extrinsic complexity, such as combining the 2 × 2 equations into some kind of larger equation. The tensor formalism describes this regime with a single equation.

Beamforming can only be accommodated in the 2 × 2 form by using separate equations to derive the effective Jones matrix of a beamformer. The tensor formalism combines beamforming and correlation into the same equation.

The Wolf formalism proposed by Carozzi & Woan (2009) uses 3 × 3 matrices to describe polarimetry in the widefield regime. Again, this can only be mapped to the 2 × 2 form by using external equations to derive special Jones matrices. A tensor formalism naturally incorporates the 3component description, and can be used to combine it with the regimes above.
In practice, tensor equations may be implemented via alternative formulations that are mathematically equivalent, but have significantly different computing costs (the 2 × 2 vs. 4 × 4 RIMEs being but one example). Computing costs may be optimized by a repartitioning of the calculations, and some formal methods for analysing this have been proposed in this paper.
I do not propose to completely supplant the 2 × 2 RIME. Where applicable (that is, for the majority of current radio interferometric observations), the latter ought to remain the formalism of choice, both for its conceptual simplicity, and its computational efficiency. Even in these cases, the tensor formalism can be of value as both a rigorous theoretical tool for analysing the limits of the Jones formalism’s applicability, and a practical tool for deriving certain specialized Jones matrices.
Following the typographical conventions of Paper I (Smirnov 2011a, Sect. 1.4), I use normalweight italics for K_{p} to emphasize the fact that it is a scalar term rather than a full matrix.
I will use boldface roman capitals, such as V, for matrices other than 2 × 2. As per the conventions of Paper I (Smirnov 2011a, Sect. 1.4), 2 × 2 Jones matrices are indicated by boldface italic capitals (J). Brightness, coherency and visibility matrices (as well as tensors, introduced later) are indicated by sansserif capitals, e.g. .
The previous papers in this series (Smirnov 2011a,b,c) also refer to these as directiondependent effects (DDEs). As far as the present paper is concerned, the important aspect of these effects is that they arise before the receptor, rather than their directionaldependence per se. I will therefore use the alternative term imageplane effects in order to emphasize this.
This definition is actually fraught with subtleties: see Sect. A.6.1 for a discussion.
Strictly speaking, all tensor indices should have the same range. I’m implicitly invoking mixeddimension tensors at this point. See Sect. A.6.2 for a formal treatment of this issue.
Specifically, Paper I claims 128 ops per Jones term in the 4 × 4 formalism: 112 to multiply two 4 × 4 matrices, and another 16 for the outer product. These numbers are correct per se. However, a 4 × 4 RIME may in fact be evaluated in a more economical order, namely as a series of multiplications of a 4vector by a 4 × 4 matrix. As seen above, this costs 28 ops per each matrixvector product, plus 16 for the outer product, for a total of only 44 ops per Jones term.
Note that in Paper I (Smirnov 2011a, Sect. 6.3) this shows up as J_{T} = TJ_{S}T^{1}, since the T matrix defined therein is exactly the inverse of A here.
Acknowledgments
This effort/activity is supported by the European Community Framework Programme 7, Advanced Radio Astronomy in Europe, grant agreement No.: 227290.
References
 Bergman, J., Carozzi, T. D., & Karlsson, R. 2003, International Patent Publication, WO03/007422, World Intellectual Property Organization, Switzerland (In the text)
 Carozzi, T. D., & Woan, G. 2009, MNRAS, 395, 1558 [NASA ADS] [CrossRef] (In the text)
 Hamaker, J. P., Bregman, J. D., & Sault, R. J. 1996, A&AS, 117, 137 [NASA ADS] [CrossRef] [EDP Sciences] [MathSciNet] [PubMed] (In the text)
 Hamaker, J. P. 2000, A&AS, 143, 515 [NASA ADS] [CrossRef] [EDP Sciences] [MathSciNet] [PubMed] (In the text)
 Johnston, S., Taylor, R., Bailes, M., et al. 2008, Exp. Astron., 22, 151 [NASA ADS] [CrossRef] (In the text)
 Leshem, A., & van der Veen, A. 2000, IEEE Transactions on Information Theory, 46, 1730 [CrossRef] (In the text)
 Levanda, R., & Leshem, A. 2010, IEEE Signal Processing Magazine, 27, 14 [NASA ADS] [CrossRef] (In the text)
 Myers, S. T., Ott, J., & Elias, N. 2010, CASA Synthesis & Single Dish Reduction Cookbook, Release 3.0.1 (In the text)
 Noordam, J. E. 1996, AIPS++ Note 185: the Measurement Equation of a Generic Radio Telescope, Tech. Rep., AIPS++ (In the text)
 Noordam, J. E., & Smirnov, O. M. 2010, A&A, 524, A61 [NASA ADS] [CrossRef] [EDP Sciences] (In the text)
 Rau, U., Bhatnagar, S., Voronkov, M. A., & Cornwell, T. J. 2009, IEEE Proc., 97, 1472 [NASA ADS] [CrossRef] (In the text)
 Simmonds, J. G. 1994, A Brief On Tensor Analysis (SpringerVerlag) (In the text)
 Smirnov, O. M. 2011a, A&A, 527, A106 [NASA ADS] [CrossRef] [EDP Sciences] (In the text)
 Smirnov, O. M. 2011b, A&A, 527, A107 [NASA ADS] [CrossRef] [EDP Sciences] (In the text)
 Smirnov, O. M. 2011c, A&A, 527, A108 [NASA ADS] [CrossRef] [EDP Sciences] (In the text)
 Subrahmanyan, R., & Deshpande, A. A. 2004, MNRAS, 349, 1365 [NASA ADS] [CrossRef] (In the text)
 Synge, J., & Schild, A. 1978, Tensor Calculus (Dover Publications) (In the text)
 van Cappellen, W. A., & Bakker, L. 2010, in Proceedings of the IEEE International Symposium on Phased Array Systems and Technology, ARRAY 2010 (IEEE Aerospace and Electronic Systems Society), 640 (In the text)
 Warnick, K. F., Ivashina, M. V., Wijnholds, S. J., & Maaskant, R. 2011, IEEE Transactions on Antennas and Propagation, submitted (In the text)
 Wijnholds, S. J. 2010, Ph.D. Thesis, Delft University of Technology (In the text)
Appendix A: Elements of tensor algebra
This Appendix gives a primer on elements of tensor theory relevant to the present paper. Most of this is just a summary of existing mathematical theory; the only new results are presented in Sect. A.6, where I formally map the RIME into tensor algebra. More details on tensor theory can be found in any number of textbooks, for example Synge & Schild (1978) and Simmonds (1994).
As a preliminary remark, one should keep in mind that there are, broadly, two complementary ways of thinking about linear and tensor algebra. The coordinate approach defines vectors, matrices, tensors, etc., in terms of their coordinate components in a particular coordinate system, and postulates somewhat mechanistic rules for transforming these components under change of coordinate frames. The intrinsic (or abstract) approach defines these objects as abstract entities (namely, various kinds of linear functions) that exist independently of coordinate systems, and derives rules for coordinate manipulation as a result. For example, in the coordinate approach, a matrix is defined as an n × m array of numbers. In the intrinsic approach, it is a linear function mapping rankm vectors to rankn vectors.
Historically, the coordinate approach was developed first, and favours applications of the theory (which is why it is prevalent in e.g. physics and engineering). The intrinsic approach is favoured by theoretical mathematicians, since it has proven to be a more powerful way of extending the theory. When applying the theory to a new field (e.g. to the RIME), the mechanistic rules may be a necessity (especially when it comes to software implementations), but it is critically important to maintain conceptual links to the intrinsic approach, since that is the only way to verify that the application remains mathematically sound. This appendix therefore tries to explain things in terms of both approaches.
A.1. Einstein notation
Einstein notation uses upper and lower indices to denote components of multidimensional entities. For example, x^{i} refers to the ith component of the vector x (rather than to x to the power of i!), and y_{i} refers to the ith component of the covector (see below) y. Under the closelyrelated abstract index notation, x^{i} may be used to refer to x itself, with the index i only serving to indicate that x is a onedimensional object. Whether x^{i} refers to the whole vector or to its ith component is usually obvious from context (i.e. from whether a specific value for i has been implied or not).
In general, upper indices are associated with contravariant components (i.e., those that transform contravariantly), while lower indices refer to covariant ones. The following section will define these concepts in detail.
Einstein summation is a convention whereby the same index appearing in both an upper and lower position implies summation. That is,
An index that is repeated in the same position (e.g. x_{i}y_{i}) does not imply summation^{13}. I shall be using the summation convention from this point on, unless otherwise stated.
A.2. Vectors, covectors, co and contravariancy
A vector can be thought of (in the coordinate approach) as a list of N scalars drawn from a scalar field F (e.g., the field of complex numbers, C). The set of all such vectors forms up the vector space V = F^{N}. For example, the Jones formalism is based on the vector space C^{2}, while the Wolf formalism is based on C^{3}.
The intrinsic definition of a vector is straightforward but somewhat laborious, and can be looked up in any linear algebra text, so I will not reproduce it here. Intuitively, this is just the familiar concept of a length and direction in Ndimensional space. It is important to distinguish the vector as an abstract geometrical entity, existing independently of coordinate systems, from the list of scalars making up its representation in a specific coordinate frame. The terminology is also unhelpfully ambiguous; I will try to use vector by itself for the abstract entity, and column vector, row vector or components when referring to its coordinates.
A coordinate frame in vector space V is defined by a set of linearly independent basis vectors e_{1},...,e_{N}. Given a coordinate frame, any vector x can be expressed as a linear combination of the basis vectors: x = x^{i}e_{i} (using Einstein notation). Each component of the vector, x^{i}, is a scalar drawn from F. In matrix notation, the representation of x is commonly written as a column vector:
A covector (or a dual vector) f represents a linear function from V to F, i.e. a linear function f(x) that maps vectors to scalars (in other words, covectors operate on vectors). This can also be written as f:V → F. The set of all covectors forms the dual space of V, commonly designated as V^{ ∗ }. In a specific coordinate frame, any covector may be represented by a set of N scalar components f_{i}, so that the operation f(x) becomes a simple sum: f(x) = x^{i}f_{i}. In matrix notation, covectors are written as row vectors:
and the operation f(x) is then just the matrix product of a row vector and a column vector, fx. Note that this definition is completely symmetric: we could as well have postulated a covector space, and defined the vector as a linear function mapping covectors onto scalars.
A.2.1. Coordinate transforms
In the coordinate approach, both vectors and covectors are represented by N scalars: the crucial difference is in how these numbers change under coordinate transforms. Consider two sets of basis vectors, E = { e_{i} } and . Each vector of the basis E′ can be represented by a linear combination of the basis E, as . The components form the transformation matrix A, which is an N × N, invertible matrix. The change of basis can also be written as a matrixvector product, by laying out the symbols for the basis vectors in a column, and formally following the rules of matrix multiplication:
Let x and x′ be two column vectors representing the same vector in basis E and E′, respectively; let f and f′ be two row vectors representing a covector.
The crucial bit is this: in order for x and x′ to represent the same vector in both coordinate systems, their components must transform contravariantly, that is, as
(in matrix or Einstein notation, respectively), where are the components of A^{1}. In other words, the components of a vector transform in an opposite way to the basis^{14}, hence contravariantly.
On the other hand, in order for f and f′ to represent the same covector (i.e. the same linear functional), their components must transform covariantly:
Vectors and linear functions (or covectors) are the two fundamental ingredients of the RIME.
A.3. Vector products and metrics
A.3.1. Inner product
An inner product on the vector space R^{N} or C^{N} is a function that maps two vectors onto a scalar. It is commonly designated as ⟨ x,y ⟩ = c. Any function that is (1) linear; (2) conjugatesymmetric (⟨ x,y ⟩ = ⟨ y,x ⟩ ^{ ∗ }; for vector spaces over R this is simply symmetric), and (3) positivedefinite (⟨ x,x ⟩ > 0 for all x ≠ 0) can be adopted as an inner product.
The dot product on Euclidean space R^{N}
is an example of an inner product. In fact, since this paper (and other RIMErelated literature) already uses angle brackets to denote averaging in time and frequency, I shall instead use the dot notation for inner products in general.
In matrix notation, the general form of an inner product on C^{N} spaces is x·y = y^{H}Mx, where M is a positivedefinite Hermitian N × N matrix. In order for this product to remain invariant under coordinate transform, the M matrix must transform as M′ = A^{H}MA (where A is the transformation matrix defined in the previous section), i.e. doublycovariantly. Looking ahead to Sect. A.4, this is an example of a (0, 2)type tensor. Another way to look at it is that the inner product defines a metric on the vector space, and M gives the covariant metric tensor, commonly designated as M = g_{ij}. In Einstein notation, the inner product of x^{i} and y^{j} is then , where is the complex conjugate of y^{j}.
Given a coordinate system, any choice of Hermitian positivedefinite M induces an inner product and a metric. In particular, choosing M to be unity results in a natural metric of x·y = y^{H}x, which is in fact the one implicitly used in all RIME literature to date. Note, however, that if we change coordinate systems, the metric only remains natural if A is a unitary transformation (A^{H}A = 1). For example, a rigid rotation of the coordinate frame is unitary and thus preserves the metric, while a skew of the coordinates changes the metric. The other coordinate transform commonly encountered in the RIME, that between linear xy and circularlypolarized rl coordinates, is also unitary.
In tensor notation, the Kronecker delta δ_{ij} (δ_{ij} = 1 for i = j, and 0 fo i ≠ j), is often used to indicate a unity M, i.e. as M = g_{ij} = δ_{ij}.
A.3.2. Index lowering and conjugate covectors
An inner product induces a natural mapping (isomorphism) between V and V^{ ∗ }, i.e. a pairing up of vectors and covectors. For any vector y, its conjugate covector can be defined as the linear functional On C^{N} space, this function is given by , meaning simply that
in matrix or Einstein notation, respectively. This operation is also known as index lowering. In a coordinate frame with the natural metric δ_{ij}, index lowering is just the Hermitian transpose: , or For conciseness, this paper uses the notation [y^{i} ] ^{ ∗ } or (i.e. bar over symbol only) to denote the conjugate covector (or its ith component) of the vector y. Note how this is distinct from the complex conjugate of the ith component, which is denoted by a bar over both the symbol and all indices, e.g.
A.3.3. Outer product
Given two vector spaces V and W and the dual space W^{ ∗ }, the outer product of the vector x ∈ V and the covector y^{ ∗ } ∈ W^{ ∗ }, denoted as B = x ⊗ y^{ ∗ }, produces a linear transform between W and V (which, in other words, is a matrix), that is defined as:
i.e. the function given by y^{ ∗ } is applied to w (producing a scalar), which is then multiplied by the vector x.
Intrinsically, the outer product is defined on a vector and a covector. If we also have an inner product on W, we can use it to define the outer product operation on two vectors, as x ⊗ y = , where is the conjugate covector of y (see above).
Given a coordinate system in a complex vector space, the covector corresponds to the linear function and the outer product B = x ⊗ y is then
In other words, the outer product of x and y is given by the matrix product xy^{H}M; in Einstein notation the corresponding matrix components are
Consider now a change of coordinates given by the transformation matrix A. In the new coordinate system, the outer product becomes . i.e. is transformed both contra and covariantly. This is an example of a (1, 1)type tensor.
A.4. Tensors
A tensor is a natural generalization of the vector and matrix concepts. In the coordinate approach, an (n,m)type tensor over the vector space V = F^{N} is given by an (n + m)dimensional array of scalars (from F). A tensor is written using n upper and m lower indices, e.g.: . The rank of the tensor is n + m. A vector (column vector) x^{i} is a (1, 0)type tensor, a covector (row vector) y_{j} is a (0,1)type tensor, and a matrix is typically a (1, 1)type tensor. Note that the range of each tensor index is, implicitly, from 1 to N, where N is the rank of the original vector space.
The upper indices correspond to contravariant components, and the lower indices to covariant components. Under a change of coordinates given by (), the components of the tensor transform n times contravariantly and m times covariantly: (A.1)In the case of a Jones matrix (a (1, 1)type tensor), this rule corresponds to the familiar^{15} matrix transformation rule of J′ = A^{1}JA. Note that on the other hand, the metric M used to specify the inner product (Sect. A.3.1) transforms differently, being a (0, 2)type tensor.
As far as typographical conventions go, this paper uses sansserif capitals () to indicate tensors in general, and lowercase italics (x^{i},y_{j}) for vectors and covectors.
In the intrinsic (abstract) definition, a tensor is simply a linear function mapping m vectors and n covectors onto a scalar. This can be written as
or as All the coordinate transform properties then follow from this one basic definition.
As a useful exercise, consider that a (1, 1)type tensor, which by this definition is a linear function T:V × V^{ ∗ } → F, can be easily recast into as a linear transform of vectors. For any vector v, consider the corresponding function v′(w^{ ∗ }), operating on covectors, defined as v′(w^{ ∗ }) = T(v,w^{ ∗ }). This is a linear function mapping covectors to scalars, which as we know (see Sect. A.2) is equivalent to a vector. We have therefore specified a linear transform between v and v′. On the other hand, we know that the latter can also be specified as a matrix – and therefore a matrix is a (1, 1)type tensor.
This line of reasoning becomes almost tautological if one writes out the coordinate components in Einstein notation. The result of T applied to the vector v^{i} and the covector w_{i} is a scalar given by the sum
Dropping w_{i} and evaluating just the sum for each i results in N scalars, which are precisely the components of v^{′i}:
which on the other hand is just multiplication of a matrix by a column vector, written in Einstein notation.
A.4.1. Transposition and tensor conjugation
As a purely formal operation, transposition (in tensor notation) can be defined as a swapping of upper and lower indices:
and the Hermitian transpose can be defined by combining this with complex conjugation. However, in the presence of a nonnatural metric (Sect. A.3.1), this is a purely mechanical operation with no underlying mathematical meaning, since it turns e.g. a vector into an entirely unrelated covector.
A far more meaningful operation is given by the index lowering procedure of Sect. A.3.2, used to obtain conjugate covectors: , and by its counterpart, index raising: , where g^{ij} is the contravariant metric tensor (essentially the inverse of g_{ij}). This kind of tensor conjugation can be generalized to the matrix case as:
In the case of a natural metric g_{ij} = δ_{ij} (and only in this case), tensor conjugation is the same as a mechanical Hermitian transpose.
For conciseness, this paper uses the notation to denote tensor conjugation, i.e. is the conjugate covector of the vector x^{i}.
A.5. Tensor operations and the Einstein notation
Einstein notation allows for some wonderfully compact representations of linear operations on tensors, which result in other tensors. Some of these were already illustrated above:

Inner product:, resulting in a scalar.

Index lowering: , converting a (1, 0)type tensor (a vector) into a (0, 1)type tensor (its conjugate covector).

Outer product of a vector and a covector, , resulting in a (1, 1)type tensor (a matrix).

Matrix multiplication of a matrix by a vector, resulting in another vector: .
Consider now multiplication of two matrices, which in Einstein notation can be written as
Here, k is a summation index (since it is repeated), while i and j are free indices. Free indices propagate to the lefthand side of the expression. This is a very easy formal rule for keeping track of what the type of the result of a tensor operation is. For example, the result of is a (0, 1)type tensor, d_{l} (i.e. just a humble covector), since l is the only free index in the expression.
In complicated expressions, a useful convention is to use Greek letters for the summation indices, and Latin ones for the free indices: This makes the expressions easier to read, but is not always easy to follow consistently. This paper tries to follow this convention as much as possible when recasting the RIME in tensor form.
The true power of Einstein notation is that it establishes relatively simple formal rules for manipulating tensor expressions. These rules can help reduce complex expressions to manageable forms.
A.5.1. No duplicate indices in the same position
Consider the expression x^{i}y^{i}. The index i is nominally free, so can we treat the result as a (1, 0)type tensor z^{i} = x^{i}y^{i}? The answer is no, because z^{i} does not transform as a (1, 0)type tensor. Under change of coordinates, we have
which is not a single contravariant transform. In fact, z^{i} transforms as a (2, 0)type tensor.
Summation indices cannot appear multiple times either: the expression is not a valid (1, 1)type tensor!
In general, any expression in Einstein notation will not yield a valid tensor if it contains repeated indices in the same (upper or lower) position. However, in this paper I make use of mixeddimension tensors (Sect. A.6.2), with a restricted set of coordinate transforms, which results in some indices being effectively invariant. Invariant indices can be repeated.
A.5.2. Commutation
The terms in an Einstein sum commute! For any particular set of index values, each term in the sum represents a scalar, and the scalars as a whole make up one product in some complicated nested sum – and scalars commute. For example, the matrix product can be rewritten as without changing the result. Were we to swap the matrices themselves around, the Einstein sum would become Note how the relative position (upper vs. lower) of the summation index changes. In one case we’re summing over columns of B and rows of A, in the other case over columns of A and rows of B.
A.5.3. Conjugation
The tensor conjugate of a product is a product of the conjugates, with upper and lower indices swapped: This follows from the definition of conjugation in Sect. A.4.1, and the commutation considerations above.
A.5.4. Isolating subproducts and collapsing indices
Summation indices can be “collapsed” by isolating intermediate products that contains all occurrences of that index. For example, in the sum , the index β can be collapsed by defining the intermediate product . The sum then becomes simply a matrix product, It is important that the isolated subproduct contain all occurrences of the index. For example, it would be formally incorrect to isolate the subproduct , since the sum then become . The “loose” β index on D then changes the type of the result.
A.6. Mapping the RIME onto tensors
This section contains some indepth mathematical details (that have been glossed over in the main paper) pertaining to how the concepts of the RIME map onto formal definitions of tensor theory.
A.6.1. Coherency as an outer product
The outer product operation is crucial to the RIME, since it is used to characterize the coherency of two EMF or voltage vectors. In tensor terms, the outer product can be defined (Sect. A.3.3) in a completely abstract and coordinatefree way. By contrast, the definition usually employed in physics literature, and the RIME literature in particular, consists of a formal, mechanical manipulation of vectors (in the listofnumbers sense). In particular, to derive the 4 × 4 formalism, Hamaker et al. (1996) (see also Paper I, Smirnov 2011a, Sect. 6.1) used the Kronecker product form:
while the Jones formalism is emerged (Hamaker 2000; Smirnov 2011a, Sect. 1) by using the matrix product xy^{H} instead. Note that while the former operation produces 4vectors and the latter 2 × 2 matrices, the two are isomorphic. It is important to establish whether an outer product defined in this way is fully equivalent to that defined in tensor theory.
In fact, by defining the outer product as xy^{H} in a specific coordinate system, we’re implicitly postulating a natural metric (M = δ_{ij}) in that coordinate system. This is of no consequence if only a single coordinate system is used, or if we restrict ourselves to unitary coordinate transformations, as is the case for transformations between xy linearly polarized and rl circularly polarized coordinates (such coordinate frames are called mutually unitary). It is something to be kept in mind, however, if formulating the RIME in a coordinatefree way.
An outer product given by V = xy^{H} in a specific coordinate system transforms as A^{1}VA under change of coordinates, just like Jones matrices do. Alternatively, we may mechanically define an outer productlike operation as W = xy^{H} in all coordinate systems, and this would then transform as A^{1}V [A^{1} ] ^{H}. The two definitions are only equivalent under unitary coordinate transformations! This is an easily overlooked point, most recently missed by the author of this paper: in Paper I (Smirnov 2011a, Sect. 6.3), only the second transform is given for coherency matrices, with no mention of the first. It may be somewhat academic in practice, since all applications of the RIME to date have restricted themselves to the mutually unitary xy and rl coordinate frames, but it may be relevant for future developments.
A.6.2. Mixeddimensionality tensors
Under the strict definition, a tensor is associated with a single vector field F^{N}, and so must be represented by an N × N × ... × N array of scalars. In other words, all its indices must have the same range from 1 to N.
Applied literature (and the present paper in particular) often makes use of mixeddimensionality tensors (MDTs), i.e. arrays of numbers with different dimensions. In particular, Sect. 3.2 introduces the visibility MDT , with nominal dimensions of N × N × 2 × 2. Such entities are not proper tensors in the strict definition, so we should formally establish to what extent they can be treated as such. The point is not entirely academic. Einstein summation (or any of the other operations discussed above) can be mechanically applied to arbitrary arrays of numbers, but the results are not guaranteed to be selfconsistent under change of coordinates unless it can be formally established that they behave like tensors. Conversely, if we can formally establish that some operation yields a tensor of type (n,m), then we know exactly how to transform it.
At first glance, MDTs seem to be significantly different from proper tensors. The difficulty lies in the fact that they seem to have two categories of indices. For example, has “2indices” (or “3indices”) i,j, associated with the vector space C^{2} or C^{3}, with respect to which the MDT behaves like a proper tensor, and “Nindices” like p and q, which only serve to “bundle” lowerranked tensors together. really behaves like a bundle of matrices (rank2 tensors) rather than a proper rank4 tensor. In particular, the coordinate transforms we normally consider involve the 2indices only, and not the Nindices, so really transforms like a (1–1)type tensor. Fortunately, it turns out that MDTs can be mapped to proper tensors in a mathematically rigorous way.
Let’s assume we have a vector space like C^{2} (which we’ll call the core space), with a core metric of g_{ij}, and MDTs with a combination of 2indices and Nindices. For illustration, consider the simpler case of the matrix , which (under the above terminology) is really a bundle of N 2vectors:
Let’s formally map MDTs to conventional tensors over C^{2 + N} space as follows: (A.2)this can be generalized to any mix of 2 and Nindices. We’ll use the term 2restricted tensor for any tensor over C^{2 + N} whose components are null if any Nindex is equal to 2 or less, or any 2index is above 2. Note that this mapping from MDTs to 2restricted tensors is isomorphic: every 2restricted tensor over C^{2 + N} has a unique MDT counterpart.
For the matrix , the mapping procedure effectively pads it out with nulls to make a (N + 2) × (N + 2) matrix: (A.3)In a sense, this procedure partitions the dimensions of the C^{2 + N} space into the core dimensions (the first two), and the “bundling” dimensions (the other N). Formally, all the indices of and Ŵ range from 1 to N + 2, but 2restricted tensors are constructed in such a way that components whose indices are “out of range” are all null.
Now let’s also map the coordinate transforms of the core space C^{2} onto a subset of the coordinate transforms of C^{2 + N}, using a transformation matrix of the form (A.4)where is the Kronecker delta. The Ŵ matrix transforms as A^{1}ŴA; it is easy to verify that it retains the same padded layout as Eq. (A.3) under such restricted coordinate transforms, and that the upperright block of the padded matrix actually transforms to , where A_{(2)} is the upperleft 2 × 2 corner of A (giving the original transform of C^{2}). In other words, every vector w_{j} of the bundle transforms as , exactly as vectors over the core space do!
This property generalizes to higherrank tensors. For example, the 2restricted tensor should formally transform as (see Eq. (A.1)):
However, for p ≤ 2 we have by definition, while for p > 2, for p = σ, and is null otherwise. Therefore, only the p = σ (and, similarly, q = τ) terms contribute to the sum above. Thus,
so our nominally (2, 2)type tensor behaves exactly like a (1, 1)type tensor under any coordinate transform given by Eq. (A.4). The p and q indices can be called invariant (as opposed to co or contravariant). In general, any 2restricted (n,m)type tensor having (n,m′) 2indices always behaves as an (n′,m′)type tensor under such coordinate transforms.
For the same reason, we can relax the rules of Einstein summation to allow repeated invariant indices. For example, z^{i} = x^{i}y^{i} is not a valid tensor (one index, but transforms doublycontravariantly!), but is a perfectly valid tensor, since an extra invariant index p does not change how the components transform.
Furthermore, it is easy to see that a 2restricted tensor remains 2restricted under any coordinate transform of the core vector space, so the property of being 2restricted is, in a sense, intrinsic. Any product of 2restricted tensors is also 2restricted. In other words, 2restricted tensors form a closed subset under coordinate transforms of the core vector space, and under all product operations. To complete the picture, we can define a metric in C^{2 + N} by using the core metric for the core dimensions, and the natural metric for the “bundling” dimensions, so
that tensor conjugation is expressed in terms of the core metric only:
To summarize, we have formally established that MDTs with a core vector space of C^{M} and a second^{16} dimensionality of N can be isomorphically mapped onto the set of Mrestricted tensors over C^{M + N}. Under coordinate transforms of the core vector space, such tensors behave co and contravariantly with respect to the Mindices, and invariantly with respect to the Nindices. We are therefore entitled to treat MDTs as proper tensors for the purposes of this paper.