Submit many jobs at once (and go out for a coffee)

• Suppose you wish to run many jobs:
  • which are largely identical
  • can be indexed by a single parameter
• Use SGE arrays:

    
      #$ -t 1-1000
          # ...tell SGE that this is an array job, with "tasks" numbered from 1 
          #    to 10000...
  
      ./myprog < data.$SGE_TASK_ID > results.$SGE_TASK_ID
      

  Submit 1000 related jobs at once (without upsetting everyone else).

---

More:

• SGE is the batch/queue system on many HPC/HTC clusters at UoM

...previous

up (conts)

next...