v2.5.2 Frequently Asked Questions (FAQs)

Exostellar has an algorithm to predict Amazon EC2 Spot Instance terminations in advance, enabling proactive migration before actual termination occurs. In the worst-case scenario, where AWS provides only a two-minute warning, Exostellar quickly and automatically initiates the migration process. Smaller-sized instances typically migrate faster and often have better EC2 Spot availability. Exostellar recommends using these selected instance types and ensures on-demand reliability with them.

Open

Exostellar recommends selecting a diversification of instance types to maximize the likelihood of finding EC2 Spot instance availability within the region. The scheduler dynamically searches for Spot availability across related instance types you identified. If no EC2 Spot instance types are available for those types, the system will automatically and safely migrate your workloads back to diverse on-demand instances, ensuring no disruption to your operations.

Based on existing tests performed on HPC workloads, the latency is minimal compared with AWS native EC2 Instances. However, performance can vary depending on the specific application. On average, the performance overhead is very small, and in some cases, workloads run even faster.

The exact savings depend on several factors, including your actual cloud usage, chosen region, selected instance types, and EC2 Spot availability. Exostellar provides a savings estimation tool on our website's homepage, which helps you calculate potential savings based on your specific setup. You can try it out here: https://exostellar.io/ .

Open

For diagnosing issues related to the Exostellar Management Server, you will primarily rely on the following log locations:

• /var/log/messages

• /var/log/munge/munged

• /var/log/slurm

• /home/slurm

For any debugging relating to the Exostellar Controller and the Worker, the logs can be found at:

• /xcompute/slurm/bin/xcompute-daemon/data

• /xcompute/logs

  • Within this directory you will find the messages directory and an xspot directory. This xspot directory will contain X-Spot specific logs, in addition to logs for the jobs and workers spawned by that controller.

For any debugging relating to Exokarpenter, the logs can be found at the following pods:

• Pods with the prefix karpenter-exo- in namespace exokarpenter

• Pods with the prefix exo-node-controller- in the namespace `exokarpenter
  
  

If you need help troubleshooting, please use the following command to pack all logs on the Exostellar Management Server and upload the file with your support request here: