Using the queue system on skd-cyclone

From gfi

General information

  1. Purpose
  2. Advantages
  3. Disadvantages
  4. Rules and procedures

Short tutorial

1. create a basic wrapper script for your job

  # SLURM wrapper script
  # start this job with sbatch NAME_OF_THIS_FILE directly on the machine

  #SBATCH --job-name=my_slurm_job
  #SBATCH --workdir=/scratch/$USER
  #SBATCH --partition=default
  #SBATCH --output=results.%j.txt
  #SBATCH --error=errors.%j.out
  #SBATCH --mail-type=END
  #SBATCH --time=12:00:00
  #SBATCH --mem-per-cpu=100

  <apply any required path settings>
  <change to your working directory>
  <command to start your job>

  # done
  

2. submit the script

sbatch ./my_queue_job.sh

3. receive an email when the job is finished

From: slurm@klientdrift.uib.no
To: <username>@uib.no
Subject: SLURM Job_id=34 Name=WaterSip3.0 Ended, Run time 00:01:00

Converting a script to a queue script

  1. add elements to the header

Description of each element

  1. parameters explained in short
  • work_dir: output files will be created in this directory.

Example: --workdir=/scratch/$USER

  • queue: which queue the output should be processed on.

Example: --partition=default

  • job-name:

Example: --job-name=my_slurm_job

  • output:

Example: --output=results.%j.txt

  • error:

Example: --error=errors.%j.out

  • mail-type:

Example: --mail-type=END

  • time:

Example: --time=12:00:00

  • mem-per-cpu:

Example: --mem-per-cpu=100

Best practices, Q&A

Further information

  1. Contacts
  2. Links