glite

gLite contrib functionality.

Class GLiteWorkflow

class GLiteWorkflow(*args, **kwargs)

Bases: BaseRemoteWorkflow

workflow_proxy_cls

alias of GLiteWorkflowProxy

glite_workflow_run_context()

Hook to provide a context manager in which the workflow run implementation is placed. This can be helpful in situations where resurces should be acquired before and released after running a workflow.

glite_job_resources(job_num, branches)

Hook to define resources for a specific job with number job_num, processing branches. This method should return a dictionary.

glite_dump_intermediate_job_data()

Whether to dump intermediate job data to the job submission file while jobs are being submitted.

glite_post_submit_delay()

Configurable delay in seconds to wait after submitting jobs and before starting the status polling.

glite_poll_callback(poll_data)

Configurable callback that is called after each job status query and before potential resubmission. It receives the variable polling attributes poll_data (PollData) that can be changed within this method.

If False is returned, the polling loop is gracefully terminated. Returning any other value does not have any effect.

glite_post_poll_callback(success, duration)

Configurable callback that is called after the polling loop has ended. It receives a boolean success that indicates whether the job polling was successful, and the duration of the job polling in seconds.

Class GLiteJobManager

class GLiteJobManager(ce=None, delegation_id=None, threads=1)

Bases: BaseJobManager

submit(job_file, ce=None, delegation_id=None, retries=0, retry_delay=3, silent=False, _processes=None)

Abstract atomic or group job submission. Can throw exceptions. Should return a list of job ids.

cancel(job_id, silent=False, _processes=None)

Abstract atomic or group job cancellation. Can throw exceptions. Should return a dictionary mapping job ids to per-job return values.

cleanup(job_id, silent=False, _processes=None)

Abstract atomic or group job cleanup. Can throw exceptions. Should return a dictionary mapping job ids to per-job return values.

query(job_id, silent=False, _processes=None)

Abstract atomic or group job status query. Can throw exceptions. Should return a dictionary mapping job ids to per-job return values.

Class GLiteJobFileFactory

class GLiteJobFileFactory(file_name='glite_job.jdl', command=None, executable=None, arguments=None, input_files=None, output_files=None, postfix_output_files=True, output_uri=None, stdout='stdout.txt', stderr='stderr.txt', vo=None, custom_content=None, absolute_paths=False, **kwargs)

Bases: BaseJobFileFactory

create(postfix=None, render_variables=None, **kwargs)

Abstract job file creation method that must be implemented by inheriting classes.