Running TXPipe at NERSC
=======================

You can now use the standard installation script to install TXPipe at NERSC in your scratch directory.


NERSC Interactive Sessions
--------------------------

You should then only run small test commands on the login node, with only a small number of cores. To run larger test jobs you can start an interactive session. This example would give you one node for 1 hour:

.. code:: bash

    salloc --nodes 1 --qos interactive --time 01:00:00 --constraint haswell

Run the setup command again after starting your job. 

Legacy: Running pipelines at NERSC
----------------------------------

**This command is deprecated - do not use it for new projects!**

The ``tx`` command runs programs in a TXPipe environment. To run whole pipelines, you can do this:

.. code:: bash

    tx ceci examples/metacal/pipeline.yml


You can also use the TX command to run individual stages, to test or develop them.

The easiest way to find the correct command to run is to run a pipeline with ceci (as above)
using the ``--dry-run`` flag to print out a list of commands.

They will normally have a form something like this at NERSC:

.. code:: bash

    srun -u --ntasks=4 --cpus-per-task=2 --nodes=1 tx python -m txpipe TXSourceSelector ...