README File for CALDB 4.8.2 Upgrade Only Instructions 11 December 2018 DE Graessle, Chandra CALDB Manager Includes brief Intro, Upgrade download and installation instructions, and pointers for further assistance. To learn more about the Chandra CALDB, and to find this information on the WEB, you are referred to http://cxc.harvard.edu/caldb/index.html. For Release Notes to the Chandra CALDB4, and specifically CalDB 4.8.2, see http://cxc.harvard.edu/caldb/downloads/releasenotes.html CalDB 4.8.2 requires CIAO 4.5 (or later version) because of an upgrade to the caldb4 software that was included since the release of CIAO 4.5 in December of 2012. The caldb4 upgrade in question provides for the proper selection of time-displaced CalDB files with overlapping validity date ranges, which does not exist in earlier CIAO versions. CalDB 4.8.2 is optimized for CIAO 4.8 (or later version) which includes an upgrade to the acis_process_events tool for handling CC-mode observations, specifically to perform the CTI-correction properly for them. As a result, the EDSER SUBPIX algorithm is now applied in a-p-e to CC-modes, where it had not been before. CalDB 4.8.2 is being released simultaneously with CIAO 4.11. These instructions apply only to those wanting to upgrade their CalDB version 4.7.3 or later version to version 4.8.2 quickly, installing only the updated calibration files and index updates. You must have installed CalDB 4.7.3 or later version previously, or this upgrade installation will not work correctly. Be sure to use the CIAO command "check_ciao_caldb" to verify your CalDB version before proceeding with these instructions. Condensed Release Notes for CalDB 4.8.2 ------------------------------------------------------------------------------------------ I. Introduction CalDB 4.8.2 is an upgrade to the Chandra CalDB, which includes the following items: * HRC-I GMAP 2018-09-17 Upgrade * HRC-S QEU Version N0010 * HRC-I GMAP 2015 Header Correction * PIMMS Cycle 21 Effective Area FITS files (http://cxc.cfa.harvard.edu/caldb4/prop_plan/pimms/index21.html) For the CIAO 4.11 / CalDB 4.8.2 release notes see How CalDB 4.8.2 Affects Your Analysis, at http://cxc.harvard.edu/ciao/releasenotes/ciao_4.11_release.html#HowCALDB4.8.2AffectsYourAnalysis ------------------------------------------------------------------------------------------ II. SUMMARY OF CHANGES A. HRC-I GMAP 2018-09-17 Upgrade Location: $CALDB/data/chandra/hrc/gmap/ Filename: hrciD2018-09-17sampgainN0001.fits Location: $CALDB/data/chandra/hrc/pibgspec/ Filename: hrciD2018-09-17pibgspecN0001.fits The September 2018 adjustment to the HRC-I time-dependent gain map has been calibrated and has been released. The rate of gain decay continues to increase with time; however the HRC calibration team has determined that an annual GMAP adjustment is adequate to maintain approximately 2-4% global accuracy in the gain. The a new compilation of the same prescribed set of ArLac observations has been used to measure the gain corrections. Details including a plot of the new GMAP and its differences with the previous corrections for 2017 are included in the technical details section of the CalDB 4.8.2 release notes. As with previous HRC-I GMAP updates, these changes will apply only to recent HRC-I observations, specifically those with DATE-OBS later than 2018-09-17T12:00:00 UTC. See the HRC-I gain map why page for more information. PIPELINES/TOOLS AFFECTED: DS and CIAO level 1 (re)processing tool hrc_process_events Also: CIAO reprocessing script chandra_repro THREADS AFFECTED: Reprocessing Data to Create a New L2 Events File Along with the new 2017 HRC-I GMAP, the incumbent PIBGSPEC for September 2018 is also being released. The PI background spectrum changes with the GMAP, because background events reprocessed using the new GMAP, using the point-source observations as are used to generate the new GMAP. This results in a shift in the background spectrum in channel space relative to the previous spectrum file. Details of how the derivation is done, and a plot of the new spectrum in comparison with previous PIBGSPEC files are given in the technical details section of the CalDB 4.8.2 release notes on the CalDB web page. PIPELINES/TOOLS AFFECTED: CIAO tool hrc_bkgrnd_lookup THREADS AFFECTED: HRC-I Background Spectra Files B. HRC-S QEU Version N0010 Location: $CALDB/data/chandra/hrc/qeu/ Filename: hrcsD1999-07-22qeuN0010.fits hrcsD2000-01-01qeuN0010.fits hrcsD2001-01-01qeuN0010.fits hrcsD2002-01-01qeuN0010.fits hrcsD2003-01-01qeuN0010.fits hrcsD2004-01-01qeuN0010.fits hrcsD2005-01-01qeuN0010.fits hrcsD2006-01-01qeuN0010.fits hrcsD2007-01-01qeuN0010.fits hrcsD2008-01-01qeuN0010.fits hrcsD2009-01-01qeuN0010.fits hrcsD2009-08-08qeuN0010.fits hrcsD2010-09-14qeuN0010.fits hrcsD2012-03-29qeuN0010.fits hrcsD2012-10-05qeuN0010.fits hrcsD2013-09-21qeuN0010.fits hrcsD2015-02-17qeuN0010.fits hrcsD2016-02-22qeuN0010.fits hrcsD2016-07-28qeuN0010.fits hrcsD2017-01-23qeuN0010.fits hrcsD2017-06-05qeuN0010.fits hrcsD2017-09-26qeuN0010.fits hrcsD2018-01-19qeuN0010.fits hrcsD2018-05-27qeuN0010.fits As the LETGS calibration team has monitored the accelerated rate of decay in the HRC-S quantum efficiency as a function of wavelength, they have elected to replace the current set of time dependent QE Uniformity (QEU) files (version N0009) with another new set of files, version N0010. One additional file has been added to the set, with new effective date of 2018-05-20T00:00:00, so that the set includes 24 files now. See the technical details section of the release notes for illustrations and details of the derivation of these new QE Uniformity corrections. In general, this latest set accounts for an additional 2.5% of QE loss over the 0.060 - 0.652 keV range; above that range, the change is minimal. See also the why page for more general information on the HRC-S QE/QEU corrections in the CalDB. CIAO SCRIPTS/TOOLS AFFECTED: See the script fluximage, which uses mkinstmap THREADS AFFECTED: For exposure-corrected imaging analysis with HRC-S, see the thread: HRC-S Exposure Map and Exposure-corrected Image For grating spectroscopy with the LETG/HRC-S, see the thread: LETG/HRC-S Grating ARFs C. HRC-I GMAP 2015 Header Correction Location: $CALDB/data/chandra/hrc/gmap/ Filename: hrciD2015-09-27sampgainN0001.fits The HRC-I GMAP (sampgain) file named above has an incorrect CVSD0001 keyword value, which causes it to become effective earlier than it should be, but because of the justapostion of previously released HRC-I GMAP files in CalDB, results in the file only being selected when it should be after all. Hence, the change being made here has zero effect on GMAP file selection for any HRC-I OBS_ID; however we are correcting it just in case a future change to an earlier GMAP file will not result in new selection issues that are not currently occurring. The calibration validity start date of the above file has been originally set at (UTC) 2012-09-27T12:00:00 instead of the correct value of 2015-09-27T12:00:00. With the CalDB 4.8.2 release, this value will be set to the correct value in the named file. The CalDB Manager has verified the named file has been being selected and applied in reprocessing with either the CIAO tool chandra_repro, as well as in the DS software that is used for scheduled archival reprocessing, despite the header error. More details are given in the technical section of the release notes, but in general users may ignore this information and proceed with any HRC-I observation reprocessing without concern for this change. ------------------------------------------------------------------------------------------ III. Instructions for installing the upgrade from CalDB 4.7.3 or later version to 4.8.2. The following are manual installation instructions. You may also download and install CalDB 4.8.2 using the "ciao-install" script at http://cxc.harvard.edu/ciao/download/, or follow the instruction at http://cxc.cfa.harvard.edu/caldb/downloads/index.html. Before you begin, you must have write privileges in your local CalDB area. If you don't have your system administrator do this upgrade! A. As system admin, verify your current CalDB version. With CIAO installed and loaded, enter the command "check_ciao_caldb" If you do not see that the CalDB version is 4.7.3 or later version, you need to use the MAIN CalDB download procedure from Table 1 of the CIAO CalDB downloads page. If the version shown is 4.7.3 or later, proceed with the following: B. Downloading Instructions: Set your working directory to $CALDB, and verify that you are there. Please download the "upgrade" tar ball and either or both of the other tar balls you may need (as indicated below) into the $CALDB area. The following FTP links will allow you to access the files from the Chandra Data Archive. You may also use your web browser to locate the CalDB Download instructions, and proceed from there: http://cxc.harvard.edu/caldb/downloads/index.html CALDB UPGRADE FILE: ftp://cda.harvard.edu/pub/arcftp/caldb/upgrade/caldb_4.8.2_upgrade.tar.gz The ACIS BKGRND files have been updated to include (1) eleven N0002 files in Group G for 2012-01-01 through the present. Added as of the release of CalDB 4.7.6 on 18 Aug 2017. ftp://cda.harvard.edu/pub/arcftp/caldb/acis_bkgrnd_4.7.6.tar.gz Three new HRC-I BKGRND files, effective for calendar years 2015-2017 respectively, have been added to the CalDB as of version 4.7.7 (14 Dec 2017). As has been the case since their original addition to CalDB, they are packaged separately in the following tar file: ftp://cda.harvard.edu/pub/arcftp/caldb/hrc_bkgrnd_4.7.7.tar.gz TABLE 1: Files, sizes, and md5sum values: FILENAME Ship Size Unpacking space md5sum (bytes) caldb_4.8.2_upgrade.tar.gz 1,527,365,221 4.2 GB 69c735bfe42a1eabd322ded2c1e62fda acis_bkgrnd_4.7.6.tar.gz 1,387,251,364 2.9 GB 192d4871813c9d5d3e857726195d1261 hrc_bkgrnd_4.7.7.tar.gz 2,323,747,030 3.2 GB 3c9b4e5d6966929793d726b12ae4a4b2 C. Unpacking instructions: We prefer that you use gtar with the appropriate options to unzip and untar the files in a single step, to save disk space and to apply the safest unpacking procedures: gtar xvUfz caldb_4.8.2_upgrade.tar.gz gtar xvfz acis_bkgrnd_4.7.6.tar.gz gtar xvfz hrc_bkgrnd_4.7.7.tar.gz LINUX users: You may omit the "U" uption in the first gtar command. D. Upgrade verification checks See the CalDB downloads web page for steps to verify your upgrade installation, at http://cxc.harvard.edu/caldb/downloads/index.html#dl_config. - Dale Graessle Chandra CalDB Manager