File Types
This page documents the file types that are used and/or generated by TXPipe. File types in TXPipe are all associated with a class that ceci uses to open, read, and write them. Some of the classes are generic, like HDFFile, and some are specific like ShearCatalog.
Ingested Catalog Files
TXPipe starts from galaxy catalogs and various bits of anciliary information. In most cases Ingestion stages generate these files from external data sets, such as GCRCatalogs, or generates mock data for them. Some are optional depending on the pipeline being run.
The catalog inputs are all in HDF5 format, and are:
Photometry Catalogs: a general-purpose catalog of detected objects and their photometry.
Shear Catalogs: galaxy shape/shear catalogs. TXPipe supports several different types:
Metadetect catalogs: from the method of Sheldon et al.
Metacal catalogs: from the method of Sheldon & Huff.
Lensfit catalogs: a catalog of galaxy shapes measured by Lensfit.
HSC catalogs: a catalog of galaxy shapes measured by ngmix.
Generic shear catalogs: a catalog of mock galaxy shears requiring no calibration
Star catalogs: a catalog of stars, used for PSF-related diagnostics.
Exposure catalogs: a catalog of exposures, used for more diagnostics.
Cluster Catalogs: a catalog of cluster locations and richnesses
The other inputs are:
Depending on the algorithms chosen, possibly photo-z training or prior-related information.
Intermediate Catalog Files
Various stages in TXPipe generate intermediate catalogs, which are used as inputs to later stages. They are all saved in HDF5 format.
Those associated with photo-z are described in the next section.
Tomography catalogs: contain the tomographic bin index for each galaxy.
Lens tomography catalogs: additionally contains lens weights.
Shear tomography catalogs: additionally contains calibration and n_eff and sigma_e
Random Catalogs: galaxies randomly distributed within the survey mask
Binned catalogs: calibrated/weighted versions of the inputs catalogs, binned by tomography.
Photometric Redshift Files
Photo-z files: per-galaxy photo-z PDFs and ensemble (stacked) per-bin n(z) information.
Map Files
Various TXPipe stages generate maps of different kinds. They are stored in HDF5 files. An overview is here: Map Files, and individual map types are described here: