The following manual steps for EAR will be replaced with a simplified workflow for command line users and alternatively, the Mangement Console (Web UI) will be able to replace most of these steps, as well.
Connect to Your LSF Head Node
...
| Expand |
|---|
|
| Code Block |
|---|
Begin Queue
QUEUE_NAME = xiobatchxio
PRIORITY = 5090
NICE = 20
FAIRSHARE = USER_SHARES[[default,10]]
RC_HOSTS DEMAND_POLICY = xiohost
RC_DEMAND_POLICY = THRESHOLD[ [1, 1] [10, 60] [100] ]
DESCRIPTIONRC_HOSTS = For xio batch jobs NEW_JOB_SCHED_DELAY = 0 REQUEUE_EXIT_VALUES = 99xiohost
MAX_JOB_REQUEUE=10RES_REQ RERUNNABLE=Y End Queue |
|
Add a line to the Resource Definitions in lsb.shared:
...
...
...
...
Example before modification:
...
...
...
...
...
...
...
...
...
...
...
...
...
= xspot
NEW_JOB_SCHED_DELAY |
|
...
...
...
...
Add three lines to the Resource Definitions in lsf.shared:
| Code Block |
|---|
cd ${LSF_TOP}/conf
vi lsb.shared |
Example with the required line added:
| Code Block |
|---|
Begin Resource
RESOURCENAME TYPE INTERVAL INCREASING DESCRIPTION (vm types for different templates) # templateIDKeywords
...
String xiohost () Boolean () (template) ID for the external hosts) End Resource |
Examples with the required line added:
| Code Block |
|---|
Begin Resource
RESOURCENAME TYPE INTERVAL INCREASING DESCRIPTION # Keywords
awshost (instances from Infrastructure Optimizer)
rc_account String () Boolean () ()account name for the (instances from AWSexternal hosts)
xiohosttemplateID String Boolean () () (instancestemplate fromID Infrastructurefor Optimizer)the vm_type String () () (vm types for different templates)
templateID String () () (template ID for the external hosts)
End Resourceexternal hosts)
...
End Resource |
Add Required Lines to lsf.conf
| Code Block |
|---|
#exostellar
LSB_STDOUT_DIRECT=Y
LSB_RC_EXTERNAL_HOST_FLAG=xiohost
LSF_LOCAL_RESOURCES="[resource xiohost] [type X86_64]"
LSF_DYNAMIC_HOST_WAIT_TIME=2
LSF_DYNAMIC_HOST_TIMEOUT=10m
ENABLE_DYNAMIC_HOSTS=Y
LSF_REG_FLOAT_HOSTS=Y
EBROKERD_HOST_CLEAN_DELAY=5
LSF_MQ_BROKER_HOSTS=head
LSB_RC_EXTERNAL_HOST_IDLE_TIME=2
LSB_BHOSTS_FORMAT="HOST_NAME:47 status:13 max:-8 njobs:-8 run:-8 ssusp:-8 ususp:-8 comments"
LSF_LSHOSTS_FORMAT="HOST_NAME:47 res:13 nprocs:-8 ncores:-8 nthreads:-8 ncpus:-8 maxmem:-8:S maxswp:8:S server:7 type"
EGO_DEFINE_NCPUS=threads |
Compute AMI Import
During Prepping the LSF Integration an AMI for compute nodes was identified or created. This step will import that AMI into Infrastructure Optimizer. Ideally, this AMI is capable of booting quickly.
...
