User Tools
grid:storegrid
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
| grid:storegrid [2009/07/29 16:05] – abuechle | grid:storegrid [2009/07/29 16:23] (current) – abuechle | ||
|---|---|---|---|
| Line 1: | Line 1: | ||
| - | ====== Storing Data on a Grid Storage Element ====== | + | ====== Storing Data on a Grid Storage Element |
| ===== Introduction ===== | ===== Introduction ===== | ||
| When running a job on the Grid (backend = Dirac()), the output data can be stored on a Grid Storage Element (SE) instead of the lxplus AFS account. The access to the files is however a bit different than on lxplus. | When running a job on the Grid (backend = Dirac()), the output data can be stored on a Grid Storage Element (SE) instead of the lxplus AFS account. The access to the files is however a bit different than on lxplus. | ||
| Line 6: | Line 6: | ||
| go to your home directory on lxplus | go to your home directory on lxplus | ||
| open the .gangarc file | open the .gangarc file | ||
| - | modify the following line (line 313 in standard .gangarc file (to get a standard one do 'ganga -g')) : | + | modify the following line (line 313 in standard .gangarc file (to get a standard one do 'ganga -g')): |
| - | < | + | < |
| # | # | ||
| </ | </ | ||
| Line 26: | Line 26: | ||
| </ | </ | ||
| - | ===== Where are the output files (on which SE)? ===== | ||
| - | in Ganga when the job has completed do: | ||
| - | < | ||
| - | jobs(jobnumber).subjobs(subjobnumber).backend.getOutputData() | ||
| - | </ | ||
| - | that gives you a logical filename (LFN): | ||
| - | < | ||
| - | ['/ | ||
| - | </ | ||
| - | The data will end up in the SE closest to the location where your job did run.\\ | ||
| - | To find out on which SE your file actually is, execute the following commands on lxplus: | ||
| - | < | ||
| - | SetupProject Dirac | ||
| - | dirac-dms-lfn-replicas / | ||
| - | </ | ||
| - | there you get back for instance the following: | ||
| - | < | ||
| - | 2009-07-29 12:10:41 UTC dirac-dms-lfn-replicas.py/ | ||
| - | {' | ||
| - | ' | ||
| - | </ | ||
| - | so the file is on RAL at srm:// | ||
| - | |||
| - | ===== How to copy the output to Zuerich ===== | ||
| - | In order to copy files directly from a SE to a machine in Zurich, first do on a Zurich machine | ||
| - | < | ||
| - | export LHCBPRODROOT=/ | ||
| - | . ${LHCBPRODROOT}/ | ||
| - | . ${LHCBPRODROOT}/ | ||
| - | export X509_CERT_DIR=/ | ||
| - | grid-proxy-init | ||
| - | </ | ||
| - | which will prepare your machine for file-transport. | ||
| - | Then do (e.g.): | ||
| - | < | ||
| - | lcg-cp -v ' | ||
| - | </ | ||
| - | The '' | ||
| - | ** Note: ** You need a Grid Certificate to do this! | ||
grid/storegrid.1248876302.txt.gz · Last modified: by abuechle
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Noncommercial-Share Alike 4.0 International
