Command: | bulkCopyAndRegisterFile |
Description: | Put many files into Grid Storage and register them in the Catalog, all in one atomic operation. |
Arguments: | filelist A file containing a list of local files to be bulk uploaded. This should be specified as a URI (with scheme `file'). |
Options: | -d or - -destination destination-SURL or SE host |
-s or - -logical-filename-suffix suffix | |
-l or - -logical-file-names filename | |
-p or - -protocol protocol | |
-n or - -streams number of streams | |
Example: | edg-replica-manager -vo=wpsix bulkCopyAndRegisterFile file:///home/mydir/myfile-list |
COMMAND LINE TOOL
usage: edg-replica-manager bulkCopyAndRegister filelist [command-options] Bulk upload multiple files to a given SE and register them in the replica catalog. -d,--destination-host <host> The destination SE host. If it is not given, the closeSE is found from the info services. The destination SURLs are always automatically generated. -s,--logical-filename-suffix <suffix> The logical filename suffix to register this entry with. The LFN will be constructed using the full filename plus this suffix. If this option is not specified, no LFN will be registered. This cannot be used with the --logical-files (-l) option. -l,--logical-files <filename> A file containing the list of LFNs to register for each source file. This must have the same number of entries as filelist. This filename should be specified as a URI (with scheme 'file'). This option cannot be used with the --logical-file-name-suffix (-s) option. -n,--streams <#streams> The number of parallel streams to use. Defaults to 8. This only has an effect if the protocol supports parallel streams. Currently the only protocol to do so is gsiftp. -p,--protocol <protocol> The protocol to be used for transfer. Defaults to gsiftp. Arguments: filelist A file containing a list of local files to be bulk uploaded. This should be specified as a URI (with scheme 'file').
The functionality is very similar to the command copyAndRegisterFile and thus we only outline the most important differences here.
Semantics
If several files need to be ``uploaded'' to the Grid in one operation, running the command line copyAndRegisterFile might take a rather long time as each time the Java virtual machine has to be started. In order to reduce the start-up latency, the following command takes several files in one operation and thus the latency is decreased. The major difference to the command copyAndRegisterFile is that for possible LFNs one can only specify a suffix for all of the files rather than individual LFNs.
Arguments
A single file (identified by a URI with the scheme file) needs to be specified that contains all files that are a locally available and are to be transferred to the Grid.
Options
There two ways in which one can specify the LFNs for the set of files to be bulk uploaded:
Return value
The call returns 0 on success and -1 on failure.