In the ISD data format there are four possible entries for the precipitation data. These are indicated by character code “AA1” to “AA4”. Each of these has period, depth, condition and quality entries. To assist in the quality control of the dewpoint temperature fields, we extracted the first of these four precipitation fields. The netCDF names we assigned these variables are “precip1_depth” and “precip1_period”, as these were from the first ISD precipitation field.
Recently, Kimberly Channell of the Great Lakes Integrated Sciences and Assessments at the University of Michigan highlighted a confusion with the description of the precip1_depth field in the netCDF files. The metadata for versions up to and including v18.104.22.1687p states “Depth of Precipitation Reported over time period”. This, combined with the hourly time stamps, could easily result in an assumption that the precip1_depth field only contains hourly accumulations. Furthermore, our naming of the netCDF variable inadvertently supports this interpretation, that the “1” in the “precip1_depth” suggests hourly accumulation values. Unfortunately, neither of these are the case.
Within one of the ISD precipitation fields, it is possible to have a number of accumulation periods, rather than just a single one across the entire length of the station record. The ISD is itself made up of a number of underlying databases, drawing observations from across a variety of observation networks (e.g. SYNOP, METAR, GTS). Each of these may have a different accumulation period, and also conventions as to the time of observation of e.g. 24 hour accumulations (and to which day these are assigned). These have been combined together to form threaded records for single station locations where possible during both the ISD and HadISD development.
It may be that a station report type (e.g. GTS) was the primary source in the early period (e.g. filling AA1), but that for a later period, a different source with a different standard accumulation period has a higher priority in a merging process, and so supersedes this. Therefore, at observation times where both sources have data, this could move the hourly accumulations down into the later precipitation fields (AA2-4), resulting in the interleaving of the different accumulation periods in the first entry. The example station in Figure 1 exhibits behaviour consistent with this. It is possible that further hourly accumulation values are present in AA2-4 of the ISD file for this station, but as we have not extracted those, they are not available to users of the HadISD at this time.
In light of this possible confusion from our netCDF variable names, we have/will take a number of actions:
1) Added notes to the HadISD webpages to clarify our naming scheme and inform users about the need to use both the “precip1_depth” and “precip1_period” fields. We’ve also improved the metadata for these two variables on the webpages too.
2) Improve the metadata of the “precip1_depth” and “precip1_period” fields in the netCDF files in the next update (v22.214.171.1247f).
3) In the longer term, extract all four ISD precipitation fields where available, and attempt to disaggregate into 1, 3 , 6, 12, and 24 hourly accumulation fields within the netCDF files. However, it is unlikely that we will be doing any quality control on these data and so we will still advise caution when using these.
We note again that the precipitation information in HadISD is not quality controlled at the moment.
Please do get in touch if you would like more information.