Command line interface¶
rjm_config¶
This is an interactive script to set up Globus and funcX on NeSI for use with RJM. It will create a new Globus guest collection (shared directory) on NeSI and check whether the user already has a funcX endpoint running on NeSI. If a funcX endpoint is not already running, one will be created and started on NeSI. If an existing funcX endpoint is found to be running, it will not be restarted. Finally, all configuration values from the above steps will be written to the RJM config file on the local machine and the authentication steps will be run.
While running this script, you will need to enter your NeSI username, password and second factor, your NeSI project code and will need to use a web browser to carry out the Globus authentication as required.
usage: rjm_config [-h] [-l LOGFILE] [-ll {debug,info,warn,error,critical}]
[-r] [-w] [-v]
Named Arguments¶
- -l, --logfile
logfile. if not specified, all messages will be printed to the terminal.
- -ll, --loglevel
Possible choices: debug, info, warn, error, critical
level of log verbosity (setting the level here overrides the config file)
- -r, --reauth
Force reauthentication of globus-compute-endpoint
Default:
False
- -w, --where-config
Print location of the config file and exit
Default:
False
- -v, --version
show program's version number and exit
rjm_restart¶
This is an interactive script that will restart the funcX endpoint running on NeSI. Sometimes the endpoint gets into a bad state due to network, file system, etc issues on NeSI and this script will attempt to fix it.
While running this script, you will need to enter your NeSI username, password and second factor, your NeSI project code and will need to use a web browser to carry out the Globus authentication as required.
usage: rjm_restart [-h] [-l LOGFILE] [-ll {debug,info,warn,error,critical}]
[-v]
Named Arguments¶
- -l, --logfile
logfile. if not specified, all messages will be printed to the terminal.
- -ll, --loglevel
Possible choices: debug, info, warn, error, critical
level of log verbosity (setting the level here overrides the config file)
- -v, --version
show program's version number and exit
rjm_health_check¶
Perform basic checks of the interface to the remote machine
usage: rjm_health_check [-h] [-l LOGFILE]
[-ll {debug,info,warn,error,critical}] [-le] [-k] [-r]
[-v]
Named Arguments¶
- -l, --logfile
logfile. if not specified, all messages will be printed to the terminal.
- -ll, --loglevel
Possible choices: debug, info, warn, error, critical
level of log verbosity (default: 'critical')
Default:
'critical'
- -le, --logextra
Also log funcx and globus at the chosen loglevel
Default:
False
- -k, --keep
Keep health check files on remote system, i.e. do not delete them after completing the check (default=False)
Default:
False
- -r, --retries
Allow retries on function failures
Default:
False
- -v, --version
show program's version number and exit
rjm_batch_submit¶
Upload files and start jobs
usage: rjm_batch_submit [-h] -f LOCALJOBDIRFILE [-l LOGFILE]
[-ll {debug,info,warn,error,critical}] [-le] [--force]
[-n] [-c CMD] [-d REMOTEDIR] [-j JOBTYPE] [-m MEM]
[-p PROJECTCODE] [-w WALLTIME] [-v]
Named Arguments¶
- -f, --localjobdirfile
file that contains the names of the local job directories, one name per line
- -l, --logfile
logfile. if not specified, all messages will be printed to the terminal.
- -ll, --loglevel
Possible choices: debug, info, warn, error, critical
level of log verbosity (setting the level here overrides the config file)
- -le, --logextra
Also log funcx and globus at the chosen loglevel
Default:
False
- --force
ignore progress from previous runs stored in job directory, i.e. start from scratch
Default:
False
- -n, --defaultlogname
Use default log name instead of "batch_submit"
Default:
False
- -c, --cmd
not used; provided for compatibility with previous versions
- -d, --remotedir
not used; provided for compatibility with previous versions
- -j, --jobtype
not used; provided for compatibility with previous versions
- -m, --mem
not used; provided for compatibility with previous versions
- -p, --projectcode
not used; provided for compatibility with previous versions
- -w, --walltime
not used; provided for compatibility with previous versions
- -v, --version
show program's version number and exit
rjm_batch_wait¶
Wait for the jobs to complete and download files
usage: rjm_batch_wait [-h] -f LOCALJOBDIRFILE [-l LOGFILE]
[-ll {debug,info,warn,error,critical}] [-le]
[-z POLLINGINTERVALSEC] [-o] [-n] [-v]
Named Arguments¶
- -f, --localjobdirfile
file that contains the names of the local job directories, one name per line
- -l, --logfile
logfile. if not specified, all messages will be printed to the terminal.
- -ll, --loglevel
Possible choices: debug, info, warn, error, critical
level of log verbosity (setting the level here overrides the config file)
- -le, --logextra
Also log funcx and globus at the chosen loglevel
Default:
False
- -z, --pollingintervalsec
job status polling interval in seconds (minimum is 60 unless -o specified too)
- -o, --min-polling-override
override minimum polling interval of 60 s
Default:
False
- -n, --defaultlogname
Use default log name instead of "batch_wait"
Default:
False
- -v, --version
show program's version number and exit