processfos -- Pre-process and re-calibrate Faint Object Spectrograph (FOS) data
processfos input output
The processfos task performs the pre-processing of the raw HST data as well as the re-calibration of these data within one task. It is a script which runs the tasks poa_preproc_fos and poa_calfos one after the other. The pre-processor checks to see whether the FOS data fits the POA processing criteria. If the criteria are matched, then the pre-processor updates the input header to prepare it for calibration processing; poa_calfos is executed after the pre-processor is finished.
Running processfos on data for which the POA processing criteria are not met, will issue a WARNING to STDOUT, telling the user that there is no POA correction for that particular dataset. Instead of running the POA version of the pipeline, the current version of calfos (from stsdas.hst_calib.fos) will be run on the data instead. The result will be the standard set of calfos output products, with no POA changes in the calibration.
Please see the poa_preproc_fos help file for more information on the processing criteria and the pre-processor itself. See the poa_calfos help file for more information on the calibration processing.
This task can also be used to run on a list of FOS datafiles; see the input parameter description below for more information.
The POA FOS pipeline relies on the STSDAS and TABLES packages; therefore, we advise that one adds the following to their IRAF login.cl file (before the keep statement):
tables stsdas hst_calib fos ctools stpoa poa_fos
If these packages are not loaded via the login.cl file, then one must open them on the command line prior to running the POA FOS tools.
1. Run the pre-processor and perform calibration for observation y0k4510dt. All data files for this observation are in the directory poa_spec$ and are copied to the current working directory. Output files are to have the same root name as the input files.
st> copy poa_spec$y0k4510dt.* . st> processfos y0k4510dt ""
2. Pre-process and calibrate the observation y3ee2804t and produce output files with a root name of test186 in the subdirectory temp.
st> copy poa_spec$y3ee2804t.* . st> mkdir temp st> processfos y3ee2804t temp/test186
3. Pre-process and calibrate a list of observations (in one step), using an ascii text file of the root names to be processed; output file rootnames will be the same as the input. The sample data are in the poa_spec$ directory; as is the sample list file, which is called y0.list.
st> copy poa_spec$y0cw0109t.* . st> copy poa_spec$y0cw010it.* . st> copy poa_spec$y0cw0110t.* . st> copy poa_spec$y0k4510dt.* . st> copy poa_spec$y0ue0103t.* . st> copy poa_spec$y0.list . st> processfos y0.list ""
Once the POA pre-processor has been run on the FOS data, one should not use calfos on these pre-processed data. The wavelength calibration files and the flat field files have been changed in the header to point to the POA version; calfos should not use these files for processing. Therefore, we highly recommend that one does not use calfos on POA pre-processed data. Keep a copy of the original non-pre-processed data, if you want to run calfos.
In the unusual case where one would like to reset the header back to the way it was before the POA pre-processing, one can use hedit to manually change the header values. Use the POA pre-processor STDOUT messages as the source of what the original values were, prior to pre-processing the data files.
An example for changing header keyword values after the pre-processor has been run, is as follows. If the following changes took place during the pre-processing:
OFF_CORR=OMIT ===> OFF_CORR=PERFORM SCT_CORR=PERFORM ===> SCT_CORR=OMIT FL1HFILE=yref$i1k1220cy.r1h ===> FL1HFILE=pref$l7m1413ly.r1h FL2HFILE=yref$N/A ===> FL2HFILE=yref$N/A CCS6=ytab$e5v11576y.cy6 ===> CCS6=pwav$l611655oy.cy6
The user can change the values back to the original values:
st> hedit root.*h OFF_CORR "OMIT" verify- update+ st> hedit root.*h SCT_CORR "PERFORM" verify- update+ st> hedit root.*h FL1HFILE "yref$i1k1220cy.r1h" verify- update+ st> hedit root.*h CCS6 "ytab$e5v11576y.cy6" verify- update+
Once the header edits the done, one should not run either the poa_preproc_fos or the processfos tasks, since they will overwrite the changes which have just been made. The only reason to set the header back to the original values, is to be able to run calfos on these data. The POA pipeline will not run on data which have not been POA pre-processed.
When running on a list of rootnames, if there is an error in processing any of the datasets in the list, the rest of the list will not be processed. This is an IRAF bug, which exits processing if there is an error of any kind while processing any list.
References to the Post Operational Archive system for HST data can be found on:
For assistance using this particular task, please contact email@example.com, or firstname.lastname@example.org (see http://www.stecf.org/poa).
For assistance using this or any other tasks, please contact email@example.com or call the help desk at 410-338-1082.
poa_preproc_fos, poa_calfos, hedit, chcalpar
Type "help poa_fos opt=sys" for a higher-level explanation of the poa_fos package and the process of re-calibrating a FOS data set.
Type "help poa_preproc_fos" for an explanation of the FOS data pre-processor.
Type "help poa_calfos" for an explanation of the poa_calfos task for re-calibrating a FOS data.