FOV Variations in CrIS Clear Scene ECMWF Biases and Standard Deviations

L. Larrabee Strow

1 Location

  • Code location: /home/strow/Work/Cris/Calval/Empirical_fov_corr/Longwave
  • Document location: /home/strow/Git/aslhugo/content/strowpages/cris/cris_bias_std

2 Introduction

This work is part of our examination of anomalies in the CrIS radiances. The overall goal is to minimize radiance differences among FOVs for the NWP and retrieval users. Neither of these groups do bias correction based on FOV ID, instead they average over all FOVs. If one or more FOVs have out-of-family radiances, then this bias correction will include those errors and will place limits on how well the assimilation/retrieval algorithm can reduce the (observed - computed) radiances and therefore limit the accuracy of the retrieval. Note that both NWP and the retrieval community do bias correction for all channels. For retrieval systems this bias is usually a static constant, while NWP data assimilation systems do bias correction dynamically and use several fitting variables (latitude, airs-mass type, etc.) to characterize and smooth these biases. This fact argues that FOV-dependent calibration differences are just as important, or more important, that the absolute calibration (up to a point!).

The simplest form for CrIS FOV radiances differences would be static offsets. However, since the CrIS detectors in the long-wave and mid-wave are non-linear there can be FOV differences that depend on the total flux on the detector. The non-linear "a2" coefficients are set to minimize these differences to the degree possible, using a single "a2" for each detector. This works remarkably well for all channels in a band, but it is not perfect. For example, Bob Knuteson (SSEC) has shown that several channels in the the extreme long-wave for FOV5 have anomalous radiances that are only visible for very cold (window) scenes.

The work presented here uses one approach for deriving FOV-dependent static differences by inter-comparing the radiance biases between CrIS observations and radiances computed from ECMWF model fields. The advantage of this approach is that FOV ECMWF bias differences do not depend on the secant of the viewing angle, which even in the mean is not identical for all FOVs. (This assumes that the radiance computation accurately takes the secant angle into account.) This approach also yields accurate results with relatively little data. Direct inter-comparison of FOV differences requires very large statistical sets of data to ensure that each FOV is sampling the same underlying set of geophysical radiances. The derivation of the "a2" coefficients, which must be done relatively quickly, minimizes this issue by only using near-nadir observations where FOV secant angle effects are small.

The disadvantage of our approach here is that the use of clear, tropical ocean scenes limits the range of observed radiances. We limit our observations to these scenes since: (a) it is difficult to find clear scenes over land and in higher latitude, (b) the tropical profiles from ECMWF are very accurate and stable over time, and (c) it is much easier to accurately simulate ocean emissivity than land. This approach therefore enhances are ability to to see instrument anomalies rather than geophysical variability.

Note, for example, that these data are not susceptible to the cold scene FOV-5 anomaly since the total flux on the detector hardly changes for this data set. However, we have found in previous studies of radiances differences (AIRS versus NPP-CrIS) that most radiance differences between instruments are just a bias, and we expect that the same will mostly (but not completely) hold for FOV-dependent differences.

Our next report will examine FOV-dependent biases using very large random data sets in order to test these assumptions, but only for a few long-wave channels.

Finally, although we present the static differences between FOVs here, we concentrate on those spectral regions that show the largest differences, which coincides with regions where the instrument noise is close to the ECMWF/sampling errors in the radiance simulations. (We ignore for now the well known radiance offset of FOV9 in the mid-wave band, which is very evident in the FOV bias differences.)

mean_bt_spectrum.png
Figure 1: Mean B(T) spectrum for clear tropical ocean scenes

However, the most interesting result of this work comes from examination of the bias standard deviations and how these compare to the detector noise as derived from the CrIS ICT looks. In summary, we find that FOV5 in the long-wave appears to have higher noise for earth scenes that for the ICT scenes. In the short-wave we find that the earth scene noise is lower than the ICT-derived noise, which is likely a consequence of the fact that CrIS is shot-noise limited in the short-wave, and the shot-noise for earth scenes can be different than in the ICT looks.

3 Data Set

We will concentrate mostly on the extreme longwave channels, which exhibit the largest inter-FOV differences in NOAA20. This region is particularly suitable for characterizing scene noise issues (rather than ICT noise) since the CrIS noise and the variability of the upwelling radiances in that region have a similar magnitude. In other regions (window, water vapor) the geophysical variability in the ECMWF errors, and sampling errors, are much larger and effectively hide any small differences in instrument noise or anomalies. The shortwave region channels sensitive to the upper troposphere and stratosphere have similar characteristics to the extreme longwave channels, and are also considered here. However, these are less important to NWP and retrieval applications since the CrIS noise is quite high for cold channels in the shortwave.

bias_allfovs.png
Figure 2: ECMWF BT biases for each FOV. At this scale it is difficult to see the FOV variability.

The NOAA-20 clear scene radiances were collected over an 18-day period (all scan angles) between March 1 and 18. The UMBC SARTA radiative transfer algorithm (RTA) was used to compute simulated radiances using matched 3-hour ECMWF forecast/analysis fields. The total number of clear scene observations per FOV was in the 22000-25000 range. The standard deviation of the bias over all scenes was also tabulated.

The radiances used for this work are all clear ocean tropical scenes, with window channel BT values in the 285-300+K range. Therefore these results do not include the FOV5 cold-scene anomalies previously discussed by Bob Knuteson (UW SSEC).

4 Results

4.1 Overview

Figure 1 shows the mean BT spectrum for the data under consideration here. Surface temperatures are slightly below 300K on average. For the discussions below pay particular note of the relatively cold radiances near 2380 cm-1. We cannot directly determine FOV radiance differences from the mean of the clear spectra for the 18 day because: (a) there is no guarantee they are observing identical scenes, and (b) the CrIS FOVs have slightly different mean secant angles which will introduce differences as large as 0.5K in the FOV radiances. Instead of intercompare the FOV biases = (observed - computed) brightness temperature (BT) differences. The computed BTs use the proper secant angle for each scene, so the variation in these biases should only be due to calibration differences among FOVs. Figure 2 shows the ECMWF biases for each of the nine FOVs for this data set.

stats1_bias_diffs.png
Figure 3: FOV bias differences relative to mean over all FOVs.

Figure 3 shows the relative differences in the CrIS biases versus ECMWF. Here we are plotting FOV \(bias_i - (\sum_i bias_i)/9\) for \(i=1:9\) By subtracting the mean bias over all FOVs we are left with what are presumably calibration errors. The most visible differences are FOV9 in the midwave, which we have already examined in a previous report. The other two main differences among FOVs is in the extreme longwave and in the 2250-2385 cm-1 region. The spike near 2380 cm-1 is in the region of the lowest radiance measured in this band, which leads to high variability in the bias differences (and their standard deviations) when displayed in BT units. A plot of the bias standard deviation in radiance units shows no evidence of a spike, it is almost solely a consequence of the high sensitivity in B(T) to errors in radiance for these channels.

stats1.png
Figure 4: FOV bias standard deviations and noise figures.

The standard deviations for each FOV bias is shown in Fig. 4, where we have also plotted the measured noise of each FOV. The noise shown is for hamming apodization and includes the effects of the self-apodization corrections on the noise. FOV9 noise is colored differently, just to highlight how different it is in the midwave.

stats_bias_mean_bias_lw.png
Figure 5: Zoom of Fig. 2 in the longwave region showing FOV bias differences versus the mean bias (over FOV).

4.2 Longwave

Figure 5 is a zoom of Fig. 3 in the extreme longwave where one can easily see the rather large bias differences among FOVs, especially for FOVs 5 and 6. Similarly in Fig. 6 we show the bias standard deviations, and the CrIS noise, in the same spectral region. These curves vary considerably, presumably because the CrIS noise can vary significantly among FOVs.

stats_std_noise_lw_all.png
Figure 6: Longwave zoom of bias standard deviations and noise figures for each FOV.

Figure 7 splits out four of the FOVs in Fig. 6 so we can see the relationship between bias standard deviation and noise for a set of representative FOVs. FOV1 in Fig. 7 is closest to the mean, where we see that the bias standard deviation is about 20% higher than the noise. Presumably, this represents the addition of ECMWF model noise (or sampling noise) to the bias standard deviation. Clearly, CrIS noise dominates the bias standard deviation for almost all FOVs. FOV3 in Fig. 7 is a special case, in that the bias standard deviation is dominated by instrument noise, note that only FOV7 has higher noise than FOV3. However, for unknown reasons the FOV3 bias standard deviation contains almost no "model noise". This also means any attempt to derive "model noise" from FOV3 will be highly inaccurate since the bias standard deviation is totally dominated by instrument noise, which seems a bit unphysical. FOV5 in Fig. 7 shows that the FOV5 bias standard deviation is significantly larger than the instrument noise. The FOV7 bias standard deviation and noise shown here are slightly different, but the FOV7 noise is lower than the standard deviation of the bias for all channels.

noise_bias_montage.png
Figure 7: Same data as shown in Fig. 5, but separated out by FOV to illustrate varying relationships between instrument noise and bias standard deviation.

We use the differences between the FOV noise and the observed ECMWF bias standard deviation to derive what we call "model noise", which is the noise present in the measurement over and above instrument noise. We assume that the model noise is gaussian, and thus is given by

\begin{equation} nedn_{\text{model}} = \sqrt{( bias\_std^2 - nedn_{\text{cris}}^2)} \end{equation}

We then convert \(nedn_{\text{model}}\) to units of brightness temperature and plot the results "model nedt" (or "model noise") in Fig. 8. The darkness of the gray lines is proportional the difference between the radiance bias standard deviation and the instrument noise for each FOV, averaged between 650 to 665 cm-1. Therefore, for FOVs where the standard deviation and noise are very close, such as FOV3, the color of the "model noise" is very light, since it is highly sensitive to errors.

model_std_in_k_absolute.png
Figure 8: \(nedn_{\text{model}}\) from Eq.1, which we call effective "model noise". The mean value averaged over all FOVs is shown in magenta.

Figure 8 shows quite clearly that FOV5 has a very significant excess of what we are calling "model noise". However, since we are using the same model for each FOV, that excess noise is likely due to noise in the radiance signal. This means that the FOV5 detector has different "noise" in the earth scene than in the ICT scene. In general the mean "model noise" is fairly constant with wavenumber, except for the strong 667 cm-1 Q-branch which peaks at far higher altitudes than the rest of these channels, and therefore might have different "model noise". In Fig. 9 we re-plot the data in Fig. 8 but this time remove the mean over FOV of the Model Std. and extend the wavenumber scale to 725 cm-1. This provides a convincing visual that shows the FOV5 excess noise continues to extend well into higher wavenumbers.

model_std_in_k_color_by_signal_minus_mean_lw_to725cm-1.png
Figure 9: \(nedn_{\text{model}}\) from Eq.1, which we call effective "model noise". The mean value averaged over all FOVs is shown in magenta.

We had some concern that these FOV5 effects might somehow be an artifact of our clear-scene detection algorithm. To address this we produced ECMWF bias for a full day's worth of data for all scenes, using a clear-scene RTA. We then subsetted for clear by requiring that the 902 cm-1 window channel bias be between -0.5 and +0.5K. This is not as good as our clear scene test using uniformity constraints among adjacent scenes, but it is extremely good for channels that peak in the upper-atmosphere such as these. The code for this test is extremely simple, and we find the same results, i.e. FOV5 still had the same excess noise.

To determine how much independent gaussian noise must be added to the mean model noise for FOV other then FOV5, we computed what we call \(nedn(5)_{\text{extra}}\) as shown in Eq. 2. This is plotted in Fig. 10 along with the FOV5 ICT noise. This shows that this "extra noise" in FOV5 is almost as large as the ICT noise level. At present we have no explanation for this, other than the observation that FOV5 is more on-axis than the other FOVs and might be susceptible to accidental fringing due to reflections off optical components and their surfaces. Possibly these could be more sensitive to small vibration and mirror movement errors than the radiance interferograms, but this is highly speculative.

\begin{equation} nedn(5)_{\text{extra}} = \sqrt{( nedn(5)_{\text{model}}^2 - \overline{nedn_{\text{model}}^2)}} \end{equation}
fov5_extra_model_noise_vs_ict_noise.png
Figure 10: The amount of extra noise that must be added in quadrature to the mean model noise (over all FOVs) to achieve the same model noise exhibited by FOV5. The FOV5 instrument (ICT) noise is also shown for comparison.

We also examined the complex components of these clear scene radiances. The mean complex residual is shown in Fig. 11 and their standard deviations in Fig. 12. Fig. 11 clearly shows that FOV5 has larger complex components than the other FOVs, all of which are positive except for FOV3. FOV3 exhibits higher variability with wavenumber than the other FOVs. Note that the discussion above suggests that FOV3 seems to have lower noise than it should in the extreme longwave. The complex residual of FOV3 hints that its behavior in indeed out-of-family compared to the other FOVs. The standard deviations of the complex residuals shown in Fig. 12 largely smooth, indicating that the complex radiance residuals are relatively static over time. Note that FOV5 standard deviation does increase above the others past ~750 cm-1.

complex_resid_lw.png
Figure 11: The complex radiance residual for the mean of these clear radiance spectra broken out by FOV. FOV5 clearly has higher complex values extending past 800 cm-1. We also highlight FOV3 with a thick line since it has an anomalous complex value.
complex_resid_std_lw.png
Figure 12: The standard deviation of the complex radiance spectra residuals. These are largely smooth and indicate that the complex radiance residuals are relatively static over time. Note that FOV5 standard deviation does increase above the others past ~750 cm-1.

4.3 Shortwave

As shown in Fig. 4 a number of channels in the shortwave region have bias standard deviations that are close to the instrument noise values, so those regions can be used to understand any anomalous noise characteristics of CrIS FOVs.

stats_bias_mean_bias_sw.png
Figure 13: Shortwave variability in FOV biases in BT units.

Figure 13 shows the shortwave bias relative to the mean bias (averaged over FOVs). The FOV bias differences are extremely small in the shortwave, the slight offset of FOV1 in the 2250-2350 cm-1 region is unimportant and far below the noise in this region of very cold BT observations. However, the FOV differences past ~2383 cm-1 might be important for retrievals (and NWP one day) since these are very good upper-tropospheric sounding channels, and differences of up to ± 0.3K might be important.

The cause of these FOV bias differences in this region are as yet unclear. It does not appear to be a differential frequency calibration error, since that would be largest near 2390 cm-1 where the slope in the radiance with wavenumber is greatest. A more likely candidate are small errors in either the implementation, or theoretical basis, of the Sa-1 matrix that removes the effects of self-apodization. Note that 2381 cm-1 is the region of minimum radiance, which grows by a factor of 3x at 2386 cm-1.

stats_bias_mean_bias_sw_radunits.png
Figure 14: Same as Fig. 9 but now plotted in radiance units, which shows that the features near 2380 cm-1 are not very different than in other spectral regions.

Parametric studies that vary the FOV off-axis locations should be able to determine if these FOV bias differences are due to an in-accurate focal plane geometry. Note that this spectral region is not used to determine the focal plane geometry since it is quite sensitive to RTA errors. This is less of an issue if we are only looking at relative FOV errors.

Figure 14 shows the same biases as in Fig. 13 but now in radiance units. This shows that the FOV differences around 2380 cm-1 are not substantially different than in other regions, but they are magnified when converted to BT by the very cold radiances present in this spectral region.

Figure 15 is a zoom of Fig. 4 in the shortwave, where one can easily see that for some FOVs the shortwave noise is higher than the bias standard deviation. This is unexpected, the bias standard deviations should always be larger than the noise. However, we are using noise generated from the ICT scans that are for a nominal 280K radiance. Since the shortwave noise is dominated by photon shot noise, the scene noise could be different from the ICT derived noise. The results shown in this figure suggest that the ICT noise results are too high for application to the earth scenes. Although there are a number of contributors to the detector shot noise, the scene flux is probably dominant. The integral of the ICT radiance is about 28% larger than the integral of the scene radiance (for these clear tropical ocean scenes), so if photon shot is indeed dominant, once might expect the earth scene noise to be lower than the ICT noise, which is what we appear to be observing.

stats1_sw1.png
Figure 15: Shortwave bias standard deviations. This is a zoom of Fig. 3.

However, this does not preclude us examining the noise characteristics of the different FOVs since the photon shot noise differences from the ICT to the scene should be the same for all FOVs. We now compute the "model noise" for the shortwave spectral region using the same procedures as above. Since the bias standard deviation is sometimes smaller than the shortwave noise figures, this will lead to complex quantities for model noise for some FOVs. To minimize this problem we reduced the ICT-derived noise by 20% for each FOV before applying Eq. 1. Figure 16 is the computed "model noise" in the shortwave, using these modified ICT noise figures.

The mean in Fig. 16 includes all FOVs but FOV3, which produced a complex model noise even with a 20% reduction in ICT noise. This result does show some similarity to the longwave region in that FOV5 is a bit of an outlier and has the largest "model noise".

We note that the midwave has a similar behavior (in the 1620 to 1740 cm-1 region) where FOV5 also has slightly higher "model noise" than the other FOVs except for FOV9, which has noise so close to the bias standard deviation that the model noise is difficult to compute accurately.

model_std_in_k_color_by_signal_sw_noise_x0.8.png
Figure 16: Derived "model noise" for the shortwave using Eq. 1. Note as stated in the text that the detector (ICT) noise has been decreased by 20% before applying Eq. 1.

The origin of these differences is not yet clear, or their impact on the scientific use of CrIS radiances. However, we do believe that further work is indeed needed to quantify the exact scene noise in the shortwave especially as that may impact assimilation and retrievals of the very good shortwave upper-tropospheric sounding channels.

5 Conclusions

The major conclusions of this work are:

  1. FOV5 appears to have excess noise in both the extreme longwave and in the shortwave region between 2250 and 2390 cm-1. This excess noise is likely in all channels, it is just a limitation of our approach that only allows detection of this excess noise in gthese particular spectral regions.
  2. The extreme longwave also exhibits significant bias differences, up to almost 0.5K relative. Some sort of empirical adjustment may be warranted to reduce this variability. However, the data used here is not suitable for this in that we only use clear tropical ocean scenes, which are insufficient to fully analyze these FOV differences over all conditions, especially since it is know that FOV5 becomes very different than the others in very cold scenes.
  3. The shortwave noise derived from the ICT appears to be too large. The results discusses here suggest that photon shot noise is larger for the earth scene than for the ICT scene, making the ICT scene noise unsuitable for some applications. Empirical adjustments to the earth scene shortwave noise should be possible. Given that the retrieval and NWP communities are looking hard at better use of the CrIS shortwave data, continued work on this issue is warranted.

The FOV5 differences in the midwave and shortwave are probably too small to warrant any further analysis or adjustments. However, the the longwave the FOV5 high apparent noise may be of importance for NWP data assimilation and retrievals.

Our next step will be to examine large statistical sets of longwave data for direct inter-comparison since we need to include cold and cloudy scenes for a complete view of FOV radiance differences. We cannot use ECMWF bias statistics for this work since it is impossible to compute cloudy radiances with enough accuracy.