Job queueing on a single machineIs the shell ksh93 dead?stopping atd job at specified timeTrigger job only...
Is Having my Players Control Two Parties a Good Idea?
What's the most efficient way to draw this region?
5v home network
Slow coworker receiving compliments while I receive complaints
'Kukhtarev's model' or 'THE Kukhtarev's model'?
String Operation to Split on Punctuation
C4_4 Reflection!
Which collation should I use for biblical Hebrew?
Can you take Bowwow out after returning him to MeowMeow?
How to execute a project with two resources where you need three resources?
Can I use both 気温 and 温度 when asking for the weather temperature?
Short story about aliens who tried using the common cold as a weapon
Why is coffee provided during big chess events when it contains a banned substance?
How do I weigh a kitchen island to determine what size castors to get?
Sum in bash outside while read line
How did Ron get five hundred Chocolate Frog cards?
How can my hammerspace safely "decompress"?
How to deal with intolerable behavior of a subordinate?
Why are seats at the rear of a plane sometimes unavailable even though many other seats are available in the plane?
Is it possible to do a low carb diet for a month in Sicily?
How to respond when insulted by a grad student in a different department?
Could Alpha Centauri be made of anti-matter?
Does Teshuva protect from punishment or not?
Disrespectful employee going above my head and telling me what to do. I am his manager
Job queueing on a single machine
Is the shell ksh93 dead?stopping atd job at specified timeTrigger job only once and only when load is lowSchedule job at irregular intervalsConfigure job to expireHow to setup an invisible cron job?Cron job with a dynamic dateSchedule a Job to run once a day in maestro scheduler
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{
margin-bottom:0;
}
I have a shiny new server for running simulations on, with a pair of Tesla GPUs and 32 cores, running CentOS 7.2. I'd like for multiple users to be able to submit jobs to the server that get queued up and run when the previous finishes, preferably with some sort of prioritisation system and time limit, like PBS/TORQUE but for a single machine rather than a cluster. I know I can install and configure TORQUE for a single machine, but it seems like overkill - theoretically, the scheduler should only have to run when jobs finish or run overtime. I can probably homebrew a set of scripts, but I was wondering if a solution already exists?
centos scheduling process-management
bumped to the homepage by Community♦ 31 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
|
show 1 more comment
I have a shiny new server for running simulations on, with a pair of Tesla GPUs and 32 cores, running CentOS 7.2. I'd like for multiple users to be able to submit jobs to the server that get queued up and run when the previous finishes, preferably with some sort of prioritisation system and time limit, like PBS/TORQUE but for a single machine rather than a cluster. I know I can install and configure TORQUE for a single machine, but it seems like overkill - theoretically, the scheduler should only have to run when jobs finish or run overtime. I can probably homebrew a set of scripts, but I was wondering if a solution already exists?
centos scheduling process-management
bumped to the homepage by Community♦ 31 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
1
I would suggest just using an existing batch scheduler like PBS or TORQUE. Why hack up a sub-optimal solution of your own when there's already something available that is meant to solve exactly the problem you're trying to solve? Sure, you have a "cluster" of 1, but you're still looking for a job submission and scheduling system.
– larsks
Feb 5 '16 at 2:06
ksh93
comes with this ability builtin in thecoshell
builtin and the library'scs
utility's connect stream services. Its associated userspace 3d filesystem viewpaths really enhance the the usability of such things, in my opinion.
– mikeserv
Feb 5 '16 at 2:24
larsks - I'll see how I go, but I find it hard to believe that no-one else has this problem, so I figured I'd ask. Thanks! @mikeserv - I can't find any documentation for coshell, and when I try to run it in my install of ksh it can't find the command. Could you point me in the right direction?
– Yoshanuikabundi
Feb 5 '16 at 2:51
You needksh93
-ksh88
will not do. But you might start here.
– mikeserv
Feb 5 '16 at 2:57
@mikeserv - I compiled the beta branch and could get everything to run, but submitting jobs in a test environment withcoshell -r localhost /home/yoshanuikabundi/test.sh
resulted in a segfault.coshell --man
andcoshell -h
both don't give any useful info.
– Yoshanuikabundi
Feb 5 '16 at 5:40
|
show 1 more comment
I have a shiny new server for running simulations on, with a pair of Tesla GPUs and 32 cores, running CentOS 7.2. I'd like for multiple users to be able to submit jobs to the server that get queued up and run when the previous finishes, preferably with some sort of prioritisation system and time limit, like PBS/TORQUE but for a single machine rather than a cluster. I know I can install and configure TORQUE for a single machine, but it seems like overkill - theoretically, the scheduler should only have to run when jobs finish or run overtime. I can probably homebrew a set of scripts, but I was wondering if a solution already exists?
centos scheduling process-management
I have a shiny new server for running simulations on, with a pair of Tesla GPUs and 32 cores, running CentOS 7.2. I'd like for multiple users to be able to submit jobs to the server that get queued up and run when the previous finishes, preferably with some sort of prioritisation system and time limit, like PBS/TORQUE but for a single machine rather than a cluster. I know I can install and configure TORQUE for a single machine, but it seems like overkill - theoretically, the scheduler should only have to run when jobs finish or run overtime. I can probably homebrew a set of scripts, but I was wondering if a solution already exists?
centos scheduling process-management
centos scheduling process-management
edited Aug 25 '16 at 1:31
Jeff Schaller♦
50.2k11 gold badges74 silver badges167 bronze badges
50.2k11 gold badges74 silver badges167 bronze badges
asked Feb 5 '16 at 0:24
YoshanuikabundiYoshanuikabundi
212 bronze badges
212 bronze badges
bumped to the homepage by Community♦ 31 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
bumped to the homepage by Community♦ 31 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
bumped to the homepage by Community♦ 31 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
1
I would suggest just using an existing batch scheduler like PBS or TORQUE. Why hack up a sub-optimal solution of your own when there's already something available that is meant to solve exactly the problem you're trying to solve? Sure, you have a "cluster" of 1, but you're still looking for a job submission and scheduling system.
– larsks
Feb 5 '16 at 2:06
ksh93
comes with this ability builtin in thecoshell
builtin and the library'scs
utility's connect stream services. Its associated userspace 3d filesystem viewpaths really enhance the the usability of such things, in my opinion.
– mikeserv
Feb 5 '16 at 2:24
larsks - I'll see how I go, but I find it hard to believe that no-one else has this problem, so I figured I'd ask. Thanks! @mikeserv - I can't find any documentation for coshell, and when I try to run it in my install of ksh it can't find the command. Could you point me in the right direction?
– Yoshanuikabundi
Feb 5 '16 at 2:51
You needksh93
-ksh88
will not do. But you might start here.
– mikeserv
Feb 5 '16 at 2:57
@mikeserv - I compiled the beta branch and could get everything to run, but submitting jobs in a test environment withcoshell -r localhost /home/yoshanuikabundi/test.sh
resulted in a segfault.coshell --man
andcoshell -h
both don't give any useful info.
– Yoshanuikabundi
Feb 5 '16 at 5:40
|
show 1 more comment
1
I would suggest just using an existing batch scheduler like PBS or TORQUE. Why hack up a sub-optimal solution of your own when there's already something available that is meant to solve exactly the problem you're trying to solve? Sure, you have a "cluster" of 1, but you're still looking for a job submission and scheduling system.
– larsks
Feb 5 '16 at 2:06
ksh93
comes with this ability builtin in thecoshell
builtin and the library'scs
utility's connect stream services. Its associated userspace 3d filesystem viewpaths really enhance the the usability of such things, in my opinion.
– mikeserv
Feb 5 '16 at 2:24
larsks - I'll see how I go, but I find it hard to believe that no-one else has this problem, so I figured I'd ask. Thanks! @mikeserv - I can't find any documentation for coshell, and when I try to run it in my install of ksh it can't find the command. Could you point me in the right direction?
– Yoshanuikabundi
Feb 5 '16 at 2:51
You needksh93
-ksh88
will not do. But you might start here.
– mikeserv
Feb 5 '16 at 2:57
@mikeserv - I compiled the beta branch and could get everything to run, but submitting jobs in a test environment withcoshell -r localhost /home/yoshanuikabundi/test.sh
resulted in a segfault.coshell --man
andcoshell -h
both don't give any useful info.
– Yoshanuikabundi
Feb 5 '16 at 5:40
1
1
I would suggest just using an existing batch scheduler like PBS or TORQUE. Why hack up a sub-optimal solution of your own when there's already something available that is meant to solve exactly the problem you're trying to solve? Sure, you have a "cluster" of 1, but you're still looking for a job submission and scheduling system.
– larsks
Feb 5 '16 at 2:06
I would suggest just using an existing batch scheduler like PBS or TORQUE. Why hack up a sub-optimal solution of your own when there's already something available that is meant to solve exactly the problem you're trying to solve? Sure, you have a "cluster" of 1, but you're still looking for a job submission and scheduling system.
– larsks
Feb 5 '16 at 2:06
ksh93
comes with this ability builtin in the coshell
builtin and the library's cs
utility's connect stream services. Its associated userspace 3d filesystem viewpaths really enhance the the usability of such things, in my opinion.– mikeserv
Feb 5 '16 at 2:24
ksh93
comes with this ability builtin in the coshell
builtin and the library's cs
utility's connect stream services. Its associated userspace 3d filesystem viewpaths really enhance the the usability of such things, in my opinion.– mikeserv
Feb 5 '16 at 2:24
larsks - I'll see how I go, but I find it hard to believe that no-one else has this problem, so I figured I'd ask. Thanks! @mikeserv - I can't find any documentation for coshell, and when I try to run it in my install of ksh it can't find the command. Could you point me in the right direction?
– Yoshanuikabundi
Feb 5 '16 at 2:51
larsks - I'll see how I go, but I find it hard to believe that no-one else has this problem, so I figured I'd ask. Thanks! @mikeserv - I can't find any documentation for coshell, and when I try to run it in my install of ksh it can't find the command. Could you point me in the right direction?
– Yoshanuikabundi
Feb 5 '16 at 2:51
You need
ksh93
- ksh88
will not do. But you might start here.– mikeserv
Feb 5 '16 at 2:57
You need
ksh93
- ksh88
will not do. But you might start here.– mikeserv
Feb 5 '16 at 2:57
@mikeserv - I compiled the beta branch and could get everything to run, but submitting jobs in a test environment with
coshell -r localhost /home/yoshanuikabundi/test.sh
resulted in a segfault. coshell --man
and coshell -h
both don't give any useful info.– Yoshanuikabundi
Feb 5 '16 at 5:40
@mikeserv - I compiled the beta branch and could get everything to run, but submitting jobs in a test environment with
coshell -r localhost /home/yoshanuikabundi/test.sh
resulted in a segfault. coshell --man
and coshell -h
both don't give any useful info.– Yoshanuikabundi
Feb 5 '16 at 5:40
|
show 1 more comment
1 Answer
1
active
oldest
votes
Consider TaskSpooler -- http://viric.name/soft/ts/.
It seems to work like 'at' but drops everything into the same sequential queue.
add a comment
|
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "106"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/4.0/"u003ecc by-sa 4.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f259999%2fjob-queueing-on-a-single-machine%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Consider TaskSpooler -- http://viric.name/soft/ts/.
It seems to work like 'at' but drops everything into the same sequential queue.
add a comment
|
Consider TaskSpooler -- http://viric.name/soft/ts/.
It seems to work like 'at' but drops everything into the same sequential queue.
add a comment
|
Consider TaskSpooler -- http://viric.name/soft/ts/.
It seems to work like 'at' but drops everything into the same sequential queue.
Consider TaskSpooler -- http://viric.name/soft/ts/.
It seems to work like 'at' but drops everything into the same sequential queue.
answered Sep 3 '17 at 4:01
user2066657user2066657
4463 silver badges12 bronze badges
4463 silver badges12 bronze badges
add a comment
|
add a comment
|
Thanks for contributing an answer to Unix & Linux Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f259999%2fjob-queueing-on-a-single-machine%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
I would suggest just using an existing batch scheduler like PBS or TORQUE. Why hack up a sub-optimal solution of your own when there's already something available that is meant to solve exactly the problem you're trying to solve? Sure, you have a "cluster" of 1, but you're still looking for a job submission and scheduling system.
– larsks
Feb 5 '16 at 2:06
ksh93
comes with this ability builtin in thecoshell
builtin and the library'scs
utility's connect stream services. Its associated userspace 3d filesystem viewpaths really enhance the the usability of such things, in my opinion.– mikeserv
Feb 5 '16 at 2:24
larsks - I'll see how I go, but I find it hard to believe that no-one else has this problem, so I figured I'd ask. Thanks! @mikeserv - I can't find any documentation for coshell, and when I try to run it in my install of ksh it can't find the command. Could you point me in the right direction?
– Yoshanuikabundi
Feb 5 '16 at 2:51
You need
ksh93
-ksh88
will not do. But you might start here.– mikeserv
Feb 5 '16 at 2:57
@mikeserv - I compiled the beta branch and could get everything to run, but submitting jobs in a test environment with
coshell -r localhost /home/yoshanuikabundi/test.sh
resulted in a segfault.coshell --man
andcoshell -h
both don't give any useful info.– Yoshanuikabundi
Feb 5 '16 at 5:40