rhessyscalibrator.calibration_runner.CalibrationRunnerLSF Class Reference

CalibrationRunner for use with LSF job management system. More...

Inheritance diagram for rhessyscalibrator.calibration_runner.CalibrationRunnerLSF:

Public Member Functions
def	getRunCmd (self, args, kwargs)
	Get job submission command given selected options. More...
def	getRunStatusCmd (self, args, kwargs)
	Get job status command. More...
def	getRunCmdRegex (self)
	Get compiled regular expression for parsing run command output. More...
def	getRunStatusCmdRegex (self)
	Get compiled regular expression for parsing run status command output. More...
def	mapStatusCode (self, status_code)
	Map between status codes of the underlying queue system and calibrator status codes. More...
def	__init__
def	submitJob (self, job)
	Submit a job using LSF. More...
def	getRunCmd (self, args, kwargs)
	Get job submission command given selected options. More...
def	getRunStatusCmd (self, args, kwargs)
	Get job status command. More...
def	getRunCmdRegex (self)
	Get compiled regular expression for parsing run command output. More...
def	getRunStatusCmdRegex (self)
	Get compiled regular expression for parsing run status command output. More...
def	mapStatusCode (self, status_code)
	Map between status codes of the underlying queue system and calibrator status codes. More...
def	__init__
def	submitJob (self, job)
	Submit a job using LSF. More...
def	getRunCmd (self, args, kwargs)
	Get job submission command given selected options. More...
def	getRunStatusCmd (self, args, kwargs)
	Get job status command. More...
def	getRunCmdRegex (self)
	Get compiled regular expression for parsing run command output. More...
def	getRunStatusCmdRegex (self)
	Get compiled regular expression for parsing run status command output. More...
def	mapStatusCode (self, status_code)
	Map between status codes of the underlying queue system and calibrator status codes. More...
def	__init__
def	submitJob (self, job)
	Submit a job using LSF. More...
Public Member Functions inherited from rhessyscalibrator.calibration_runner.CalibrationRunnerQueue
def	getRunCmd (self, args, kwargs)
	Get job submission command given selected options. More...
def	getRunStatusCmd (self, args, kwargs)
	Get job status command. More...
def	getRunCmdRegex (self)
	Get compiled regular expression for parsing run command output. More...
def	getRunStatusCmdRegex (self)
	Get compiled regular expression for parsing run status command output. More...
def	submitJob (self, job)
	Submit a job to the underlying queue system. More...
def	mapStatusCode (self, status_code)
	Map between status codes of the underlying queue system and calibrator status codes. More...
def	__init__ (self, basedir, session_id, queue, db_path, run_path, logger, restart_runs, submit_queue, polling_delay, mem_limit, max_active_jobs)
	Concrete classes must use getRunCmd() and getRunStatusCmd() to initialize self.run_cmd and self.run_status_cmd before the run() method can be called. More...
def	pollJobsStatus (self)
	Check status of jobs submitted. More...
def	run (self)
	Method to be run in a consumer thread/process to launch a run submitted by procuder thread/process. More...
def	getRunCmd (self, args, kwargs)
	Get job submission command given selected options. More...
def	getRunStatusCmd (self, args, kwargs)
	Get job status command. More...
def	getRunCmdRegex (self)
	Get compiled regular expression for parsing run command output. More...
def	getRunStatusCmdRegex (self)
	Get compiled regular expression for parsing run status command output. More...
def	submitJob (self, job)
	Submit a job to the underlying queue system. More...
def	mapStatusCode (self, status_code)
	Map between status codes of the underlying queue system and calibrator status codes. More...
def	__init__ (self, basedir, session_id, queue, db_path, run_path, logger, restart_runs, submit_queue, polling_delay, mem_limit, max_active_jobs)
	Concrete classes must use getRunCmd() and getRunStatusCmd() to initialize self.run_cmd and self.run_status_cmd before the run() method can be called. More...
def	pollJobsStatus (self)
	Check status of jobs submitted. More...
def	run (self)
	Method to be run in a consumer thread/process to launch a run submitted by procuder thread/process. More...
def	getRunCmd (self, args, kwargs)
	Get job submission command given selected options. More...
def	getRunStatusCmd (self, args, kwargs)
	Get job status command. More...
def	getRunCmdRegex (self)
	Get compiled regular expression for parsing run command output. More...
def	getRunStatusCmdRegex (self)
	Get compiled regular expression for parsing run status command output. More...
def	submitJob (self, job)
	Submit a job to the underlying queue system. More...
def	mapStatusCode (self, status_code)
	Map between status codes of the underlying queue system and calibrator status codes. More...
def	__init__ (self, basedir, session_id, queue, db_path, run_path, logger, restart_runs, submit_queue, polling_delay, mem_limit, max_active_jobs)
	Concrete classes must use getRunCmd() and getRunStatusCmd() to initialize self.run_cmd and self.run_status_cmd before the run() method can be called. More...
def	pollJobsStatus (self)
	Check status of jobs submitted. More...
def	run (self)
	Method to be run in a consumer thread/process to launch a run submitted by procuder thread/process. More...
Public Member Functions inherited from rhessyscalibrator.calibration_runner.CalibrationRunner
def	__init__
def	__del__ (self)
def	run (self)
def	storeJobInDB (self, job)
	Store new job in ModelRunnerDB2. More...
def	jobCompleteCallback (self, args, kwargs)
	Called when a job is complete. More...
def	__init__
def	__del__ (self)
def	run (self)
def	storeJobInDB (self, job)
	Store new job in ModelRunnerDB2. More...
def	jobCompleteCallback (self, args, kwargs)
	Called when a job is complete. More...
def	__init__
def	__del__ (self)
def	run (self)
def	storeJobInDB (self, job)
	Store new job in ModelRunnerDB2. More...
def	jobCompleteCallback (self, args, kwargs)
	Called when a job is complete. More...

Public Attributes
	bsub_exclusive_mode
	simulator_path
	run_cmd
	run_status_cmd
Public Attributes inherited from rhessyscalibrator.calibration_runner.CalibrationRunnerQueue
	submit_queue
	mem_limit
	max_active_jobs
	run_cmd
	run_status_cmd
Public Attributes inherited from rhessyscalibrator.calibration_runner.CalibrationRunner
	basedir
	session_id
	queue
	db_path
	run_path
	logger
	restart_runs
	db
	numActiveJobs

Additional Inherited Members
Static Public Attributes inherited from rhessyscalibrator.calibration_runner.CalibrationRunnerQueue
int	INIT_SLEEP_SECS = 15
int	JOB_STATUS_SLEEP_SECS = 60
int	JOB_SUBMIT_PENDING_THRESHOLD_SLEEP_SECS = 90
int	QUEUE_GET_TIMEOUT_SECS = 15
int	EXIT_SLEEP_SECS = 5

Detailed Description

CalibrationRunner for use with LSF job management system.

Constructor & Destructor Documentation

def rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.__init__	(		self,
			basedir,
			session_id,
			queue,
			db_path,
			run_path,
			logger,
			restart_runs,
			submit_queue,
			polling_delay,
			mem_limit,
			max_active_jobs,
			bsub_exclusive_mode = False,
			simulator_path = None
	)

def rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.__init__	(		self,
			basedir,
			session_id,
			queue,
			db_path,
			run_path,
			logger,
			restart_runs,
			submit_queue,
			polling_delay,
			mem_limit,
			max_active_jobs,
			bsub_exclusive_mode = False,
			simulator_path = None
	)

def rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.__init__	(		self,
			basedir,
			session_id,
			queue,
			db_path,
			run_path,
			logger,
			restart_runs,
			submit_queue,
			polling_delay,
			mem_limit,
			max_active_jobs,
			bsub_exclusive_mode = False,
			simulator_path = None
	)

Member Function Documentation

def rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.getRunCmd	(		self,
			args,
			kwargs
	)

Get job submission command given selected options.

Valid keyword args:

Parameters

simulator_path	String representing path to LSF simulator. Default: None. If specified simulator will be used instead of real LSF commands.
mem_limit	Integer representing memory limit for jobs. Unit: GB, Default: 4.
bsub_exclusive_mode	Boolean specifying that bsub_exclusive_mode. Default: False should be used

Returns

String representing job submission command

def rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.getRunCmd	(		self,
			args,
			kwargs
	)

Get job submission command given selected options.

Valid keyword args:

Parameters

simulator_path	String representing path to LSF simulator. Default: None. If specified simulator will be used instead of real LSF commands.
mem_limit	Integer representing memory limit for jobs. Unit: GB, Default: 4.
bsub_exclusive_mode	Boolean specifying that bsub_exclusive_mode. Default: False should be used

Returns

String representing job submission command

def rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.getRunCmd	(		self,
			args,
			kwargs
	)

Get job submission command given selected options.

Valid keyword args:

Parameters

simulator_path	String representing path to LSF simulator. Default: None. If specified simulator will be used instead of real LSF commands.
mem_limit	Integer representing memory limit for jobs. Unit: GB, Default: 4.
bsub_exclusive_mode	Boolean specifying that bsub_exclusive_mode. Default: False should be used

Returns

String representing job submission command

def rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.getRunCmdRegex

(

self

)

Get compiled regular expression for parsing run command output.

def rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.getRunCmdRegex

(

self

)

Get compiled regular expression for parsing run command output.

def rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.getRunCmdRegex

(

self

)

Get compiled regular expression for parsing run command output.

def rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.getRunStatusCmd	(		self,
			args,
			kwargs
	)

Get job status command.

Valid keyword args:

Parameters

simulator_path

String representing path to LSF simulator. Default: None. If specified simulator will be used instead of real LSF commands.

Returns

String representing job status command

def rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.getRunStatusCmd	(		self,
			args,
			kwargs
	)

Get job status command.

Valid keyword args:

Parameters

simulator_path

String representing path to LSF simulator. Default: None. If specified simulator will be used instead of real LSF commands.

Returns

String representing job status command

def rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.getRunStatusCmd	(		self,
			args,
			kwargs
	)

Get job status command.

Valid keyword args:

Parameters

simulator_path

String representing path to LSF simulator. Default: None. If specified simulator will be used instead of real LSF commands.

Returns

String representing job status command

def rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.getRunStatusCmdRegex

(

self

)

Get compiled regular expression for parsing run status command output.

Concrete classes must return a regex that matches the job ID in group 1 and the job status in group 2.

def rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.getRunStatusCmdRegex

(

self

)

Get compiled regular expression for parsing run status command output.

Concrete classes must return a regex that matches the job ID in group 1 and the job status in group 2.

def rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.getRunStatusCmdRegex

(

self

)

Get compiled regular expression for parsing run status command output.

Concrete classes must return a regex that matches the job ID in group 1 and the job status in group 2.

def rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.mapStatusCode	(		self,
			status_code
	)

Map between status codes of the underlying queue system and calibrator status codes.

Parameters

status_code

String representing status code of underlying queue system

Returns

String representing calibrator status code

def rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.mapStatusCode	(		self,
			status_code
	)

Map between status codes of the underlying queue system and calibrator status codes.

Parameters

status_code

String representing status code of underlying queue system

Returns

String representing calibrator status code

def rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.mapStatusCode	(		self,
			status_code
	)

Map between status codes of the underlying queue system and calibrator status codes.

Parameters

status_code

String representing status code of underlying queue system

Returns

String representing calibrator status code

def rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.submitJob	(		self,
			job
	)

Submit a job using LSF.

Will add job to DB.

       @param job model_runner_db.ModelRun representing the job to run

       @raise Exception if bsub output is not what was expected

def rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.submitJob	(		self,
			job
	)

Submit a job using LSF.

Will add job to DB.

       @param job model_runner_db.ModelRun representing the job to run

       @raise Exception if bsub output is not what was expected

def rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.submitJob	(		self,
			job
	)

Submit a job using LSF.

Will add job to DB.

       @param job model_runner_db.ModelRun representing the job to run

       @raise Exception if bsub output is not what was expected

Member Data Documentation

rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.bsub_exclusive_mode

rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.run_cmd

rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.run_status_cmd

rhessyscalibrator.calibration_runner.CalibrationRunnerLSF.simulator_path

---

The documentation for this class was generated from the following file:

• build/lib/rhessyscalibrator/calibration_runner.py