====== Staging files manually ====== ===== Problem ===== If you want to run over some rarely used files, it is very likely that they have to be first staged. While running this is done in sequence, so the file is only staged at the moment the algorithm wants to use it. This is of course very time consuming. But there is a possibility to pre-stage the files manually and in parallel. ===== Solution ===== ==== Stage the files === Create first a list of the castor file names advanced by -M and store it in variable. So if you have the two files /castor/cern.ch/grid/lhcb/data/2011/RAW/FULL/LHCb/CALIBRATION11/86753/086753_0000000001.raw /castor/cern.ch/grid/lhcb/data/2011/RAW/FULL/LHCb/CALIBRATION11/86753/086753_0000000002.raw and you store them in $FILELIST echo $FILELIST should give -M /castor/cern.ch/grid/lhcb/data/2011/RAW/FULL/LHCb/CALIBRATION11/86753/086753_0000000001.raw -M /castor/cern.ch/grid/lhcb/data/2011/RAW/FULL/LHCb/CALIBRATION11/86753/086753_0000000002.raw . Afterwards stage them by stager_get -U $FILELIST where is an arbitrary name use to later control the staging process. ==== Control staging process ==== To look if the files are already staged, type stager_qry -U if the staging is still going on the file is marked with STAGEIN, if it is staged it is marked with STAGED.