Job Schedular

[monk.e.boy]

Hi,

I would like to schedule jobs so they run one after another. At the moment they are run like:

job --id=9 &> log.txt &

but they are fighting for resources. The jobs are started by different users through a web interface. I'd like to run these through a scheduler that would takes these commands, then batch them up and run them one at a time.

How would I do this?

Many thanks,

monk.e.boy

[Ben Cotton]

You might want to check out

SLURM https://computing.llnl.gov/linux/slurm/

OpenPBS PBS GridWorks: OpenPBS

[monk.e.boy]

thanks for the reply. Those look a little hard core for what I need

monk.e.boy

[Ben Cotton]

Okay, so basically all you need is a simple program to execute the commands one at a time, without consideration for anything other than the order in which they were received? If that's the case, you can have your web interface append the command to the end of a text file (for example, queue.txt) and then run a script that will execute them. The script might look something like this:

#!/usr/bin/perl

# Queue file
$queue = 'queue.txt';

open (QUEUE, "$queue") or die;
@commands = <QUEUE>;
close (QUEUE);
$runMe = shift (@commands);
open (QUEUE, ">$queue") or die;
foreach ( @commands ) { print QUEUE "$_\n"; }
close (QUEUE);
system("$runMe");

This Perl script will go through your queue, write all but the top command back to the queue file, run the top command and exit. Obviously, you'll need to flesh it out and test it a bit. You'll need to make it so that it runs repeatedly (after each script has ended), but this should get you started at least.

[monk.e.boy]

Doh! It is so obvious when you say it like that

The external .txt queue is a very very neat idea. I will use it, thanks again

monk.e.boy