castor:stagefiles
Differences
This shows you the differences between two versions of the page.
| Next revision | Previous revision | ||
| castor:stagefiles [2012/05/05 16:11] – created che | castor:stagefiles [2012/05/08 08:20] (current) – che | ||
|---|---|---|---|
| Line 1: | Line 1: | ||
| + | ====== Staging files manually ====== | ||
| + | ===== Problem ===== | ||
| If you want to run over some rarely used files, it is very likely that they have to be first staged. While running this is done in sequence, so the file is only staged at the moment the algorithm wants to use it. This is of course very time consuming. | If you want to run over some rarely used files, it is very likely that they have to be first staged. While running this is done in sequence, so the file is only staged at the moment the algorithm wants to use it. This is of course very time consuming. | ||
| But there is a possibility to pre-stage the files manually and in parallel. | But there is a possibility to pre-stage the files manually and in parallel. | ||
| + | |||
| + | ===== Solution ===== | ||
| + | ==== Stage the files === | ||
| + | Create first a list of the castor file names advanced by -M and store it in variable. | ||
| + | So if you have the two files | ||
| + | < | ||
| + | / | ||
| + | / | ||
| + | </ | ||
| + | and you store them in $FILELIST | ||
| + | < | ||
| + | echo $FILELIST | ||
| + | </ | ||
| + | should give | ||
| + | < | ||
| + | -M / | ||
| + | </ | ||
| + | Afterwards stage them by | ||
| + | < | ||
| + | stager_get -U < | ||
| + | </ | ||
| + | where < | ||
| + | |||
| + | ==== Control staging process ==== | ||
| + | To look if the files are already staged, type | ||
| + | < | ||
| + | stager_qry -U < | ||
| + | </ | ||
| + | if the staging is still going on the file is marked with STAGEIN, if it is staged it is marked with STAGED. | ||
| + | |||
castor/stagefiles.1336227096.txt.gz · Last modified: 2012/05/05 16:11 by che
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Noncommercial-Share Alike 4.0 International
