Ingestion

These stages import data into TXPipe input formats, or generate mock data from simpler input catalogs.

class txpipe.exposure_info.TXExposureInfo(args, comm=None, aliases=None)[source]

Ingest exposure information from an OpSim database

This is used later for measurements, e.g. shear around exposure centers.

Inputs: None

Outputs:

  • exposures: HDFFile

Parallel: No - Serial

Configuration
  • dc2_name: (str) Default=1.2p.
  • opsim_db: (str) Default=/global/projecta/projectdirs/lsst/groups/SSim/DC2/minion_1016_desc_dithered_v4.db.
  • propId: (int) Default=54.
class txpipe.ingest.dp02.TXIngestDataPreview02(args, comm=None, aliases=None)[source]

Ingest galaxy catalogs from DP0.2

There is no metacal on this, and there won’t be.

Inputs: None

Outputs:

  • photometry_catalog: HDFFile

  • shear_catalog: HDFFile

Parallel: No - Serial

Configuration
  • pq_path: (str) Default=/global/cfs/cdirs/lsst/shared/rubin/DP0.2/objectTable/.
  • tracts: (str) Default=.
class txpipe.ingest.mocks.TXCosmoDC2Mock(args, comm=None, aliases=None)[source]

Simulate mock shear and photometry measurements from CosmoDC2 (or similar)

This stage simulates metacal data and metacalibrated photometry measurements, starting from a cosmology catalogs of the kind used as an input to DC2 image and obs-catalog simulations.

This is mainly useful for testing infrastructure in advance of the DC2 catalogs being available, but might also be handy for starting from a purer simulation.

Inputs:

  • response_model: HDFFile

Outputs:

  • shear_catalog: ShearCatalog

  • photometry_catalog: HDFFile

Parallel: No - Serial

Configuration
  • cat_name: (str) Default=cosmoDC2.
  • visits_per_band: (int) Default=165.
  • snr_limit: (float) Default=4.0.
  • max_size: (int) Default=99999999999999.
  • extra_cols: (str) Default=.
  • max_npix: (int) Default=99999999999999.
  • unit_response: (bool) Default=False.
  • cat_size: (int) Default=0.
  • flip_g2: (bool) Default=True.
  • apply_mag_cut: (bool) Default=False.
  • Mag_r_limit: (int) Default=-19.
  • metadetect: (bool) Default=True.
  • add_shape_noise: (bool) Default=True.
  • healpixels: (list) Default=[-1].
class txpipe.ingest.mocks.TXBuzzardMock(args, comm=None, aliases=None)[source]

Simulate mock photometry from Buzzard.

May be obsolete.

Inputs:

  • response_model: HDFFile

Outputs:

  • shear_catalog: ShearCatalog

  • photometry_catalog: HDFFile

Parallel: No - Serial

Configuration
  • cat_name: (str) Default=buzzard.
  • visits_per_band: (int) Default=165.
  • snr_limit: (float) Default=4.0.
  • max_size: (int) Default=99999999999999.
  • extra_cols: (str) Default=.
  • max_npix: (int) Default=99999999999999.
  • unit_response: (bool) Default=False.
  • flip_g2: (bool) Default=True.
class txpipe.ingest.mocks.TXGaussianSimsMock(args, comm=None, aliases=None)[source]

Simulate mock photometry from gaussian simulations

This stage simulates metacal data and metacalibrated photometry measurements, starting from simple Gaussian simulations produced starting from CCL power spectra and poission sampling galaxies from it.

This is mainly useful for testing infrastructure starting from a purer simulation.

Inputs:

  • response_model: HDFFile

Outputs:

  • shear_catalog: ShearCatalog

  • photometry_catalog: HDFFile

Parallel: No - Serial

Configuration
  • cat_name: (str) Default=GaussianSims.
  • visits_per_band: (int) Default=165.
  • snr_limit: (float) Default=0.0.
  • max_size: (int) Default=99999999999999.
  • extra_cols: (str) Default=.
  • max_npix: (int) Default=99999999999999.
  • unit_response: (bool) Default=True.
  • cat_size: (int) Default=0.
  • flip_g2: (bool) Default=False.
  • apply_mag_cut: (bool) Default=False.
  • metadetect: (bool) Default=True.
  • add_shape_noise: (bool) Default=False.
class txpipe.ingest.mocks.TXSimpleMock(args, comm=None, aliases=None)[source]

Load an ascii astropy table and put it in shear catalog format.

Inputs:

  • mock_shear_catalog: TextFile

Outputs:

  • shear_catalog: ShearCatalog

Parallel: No - Serial

Configuration
  • mock_size_snr: (bool) Default=False.
class txpipe.ingest.mocks.TXMockTruthPZ(args, comm=None, aliases=None)[source]

Stage TXMockTruthPZ

Inputs:

  • shear_catalog: ShearCatalog

Outputs:

  • photoz_pdfs: QPPDFFile

Parallel: No - Serial

Configuration
  • mock_sigma_z: (float) Default=0.001.
class txpipe.ingest.gcr.TXMetacalGCRInput(args, comm=None, aliases=None)[source]

Ingest metacal catalogs from GCRCatalogs

This loads a matched shear and photometry catalog.

Inputs: None

Outputs:

  • shear_catalog: ShearCatalog

  • photometry_catalog: HDFFile

Parallel: No - Serial

Configuration
  • cat_name: (str) Required.
  • single_tract: (str) Default=.
  • length: (int) Default=0.
  • table_dir: (str) Default=.
  • data_release: (str) Default=.
class txpipe.ingest.gcr.TXIngestStars(args, comm=None, aliases=None)[source]

Ingest a star catalog from GCRCatalogs

Includes shape information (i.e. PSF samples) and whether the star was used in PSF estimation.

Inputs: None

Outputs:

  • star_catalog: HDFFile

Parallel: No - Serial

Configuration
  • single_tract: (str) Default=.
  • cat_name: (str) Required.
  • length: (int) Default=0.
class txpipe.ingest.redmagic.TXIngestRedmagic(args, comm=None, aliases=None)[source]

Ingest a redmagic catalog

This starts with the FITS file format, but may be outdated.

Inputs:

  • redmagic_catalog: FitsFile

Outputs:

  • lens_catalog: HDFFile

  • lens_tomography_catalog_unweighted: HDFFile

  • lens_photoz_stack: QPNOfZFile

Parallel: No - Serial

Configuration
  • lens_zbin_edges: (list) Default=[].
  • chunk_rows: (int) Default=100000.
  • zmin: (float) Default=0.0.
  • zmax: (float) Default=3.0.
  • dz: (float) Default=0.01.
  • bands: (str) Default=grizy.
class txpipe.simulation.TXLogNormalGlass(args, comm=None, aliases=None)[source]

Uses GLASS to generate a simulated catalog from lognormal fields GLASS citation: https://ui.adsabs.harvard.edu/abs/2023OJAp….6E..11T

Contamination is applied to the density field by poission sampling the density field at a higher rate than target density, then removing objects with prob proportional to 1/input_weight This allows us to produce contaminated/ucontamined maps of the same galaxy realisation

Inputs:

  • mask: MapsFile

  • lens_photoz_stack: QPNOfZFile

  • fiducial_cosmology: FiducialCosmology

  • input_lss_weight_maps: MapsFile

Outputs:

  • photometry_catalog: HDFFile

  • lens_tomography_catalog_unweighted: TomographyCatalog

  • glass_cl_shells: HDFFile

  • glass_cl_binned: HDFFile

  • density_shells: HDFFile

Parallel: No - Serial

Configuration
  • num_dens: (NoneType) Default=None.
  • zmin: (float) Default=0.0.
  • zmax: (float) Default=2.0.
  • dx: (int) Default=100.
  • bias0: (float) Default=2.0.
  • alpha_bz: (float) Default=0.0.
  • zpivot: (float) Default=0.6.
  • shift: (float) Default=1.0.
  • contaminate: (bool) Default=False.
  • random_seed: (int) Default=0.
  • cl_optional_file: (str) Default=none.
  • ell_binned_min: (float) Default=0.1.
  • ell_binned_max: (float) Default=500000.0.
  • ell_binned_nbins: (int) Default=100.
  • output_density_shell_maps: (bool) Default=False.