GNU parallel wait for command even with --line-bufferUsing GNU Parallel With SplitHow to use GNU parallel...
Should an arbiter claim draw at a K+R vs K+R endgame?
What do abbreviations in movie scripts stand for?
Thread Pool C++ Implementation
Generate a Graeco-Latin square
System.StringException: Unexpected end of expression
Were Alexander the Great and Hephaestion lovers?
Does Disney no longer produce hand-drawn cartoon films?
Character descriptions
English word for "product of tinkering"
Is using haveibeenpwned to validate password strength rational?
Should I avoid hard-packed crusher dust trails with my hybrid?
What is the actual quality of machine translations?
What's up with this leaf?
What ways have you found to get edits from non-LaTeX users?
Does an ice chest packed full of frozen food need ice?
Where Mongol herds graze
How can "научись" mean "take it and keep trying"?
Is it legal for a bar bouncer to conficaste a fake ID
Déjà vu, again?
Using "subway" as name for London Underground?
What to do when surprise and a high initiative roll conflict with the narrative?
Should I give professor gift at the beginning of my PhD?
Compiling C files on Ubuntu and using the executable on Windows
How is water heavier than petrol, even though its molecular weight is less than petrol?
GNU parallel wait for command even with --line-buffer
Using GNU Parallel With SplitHow to use GNU parallel effectivelygnu parallel with no argument scriptcsh array/command substitution with gnu parallelGNU Parallel for a iteration while loop, nestedKeeping dirs in order with GNU ParallelGNU parallel with for loop?Copying & Renaming Files with GNU Parallelgnu parallel with bash arrayChange max line length of GNU parallel
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ margin-bottom:0;
}
Im trying to parallelize websocket events, after searching a bit, i made a command like that
websocat "$URL" | env_parallel -k --lb --pipe -N1 parse-event
The problem is that every time, parallel waits for the first command to close before calling parse-event
, even with --line-buffer
I tested if the problem was on parallel arguments, but with another input, it works exactly as i need it, spawning instantly as it reads the data
while true; do echo "test"; done | env_parallel -k --lb --pipe -N1 parse-event
And the websocat output alone is fine too, works normally on the terminal, other commands, and on a while read LINE
loop
websocat "$URL" | xxd
Probably im missing something, what can be causing that?
The only command that i made that could replicate the issue was
(for x in {1..100}; do echo "$x"; done; sleep 100) | env_parallel -k --lb --pipe -N1 parse-event
shell-script shell gnu-parallel
New contributor
add a comment |
Im trying to parallelize websocket events, after searching a bit, i made a command like that
websocat "$URL" | env_parallel -k --lb --pipe -N1 parse-event
The problem is that every time, parallel waits for the first command to close before calling parse-event
, even with --line-buffer
I tested if the problem was on parallel arguments, but with another input, it works exactly as i need it, spawning instantly as it reads the data
while true; do echo "test"; done | env_parallel -k --lb --pipe -N1 parse-event
And the websocat output alone is fine too, works normally on the terminal, other commands, and on a while read LINE
loop
websocat "$URL" | xxd
Probably im missing something, what can be causing that?
The only command that i made that could replicate the issue was
(for x in {1..100}; do echo "$x"; done; sleep 100) | env_parallel -k --lb --pipe -N1 parse-event
shell-script shell gnu-parallel
New contributor
add a comment |
Im trying to parallelize websocket events, after searching a bit, i made a command like that
websocat "$URL" | env_parallel -k --lb --pipe -N1 parse-event
The problem is that every time, parallel waits for the first command to close before calling parse-event
, even with --line-buffer
I tested if the problem was on parallel arguments, but with another input, it works exactly as i need it, spawning instantly as it reads the data
while true; do echo "test"; done | env_parallel -k --lb --pipe -N1 parse-event
And the websocat output alone is fine too, works normally on the terminal, other commands, and on a while read LINE
loop
websocat "$URL" | xxd
Probably im missing something, what can be causing that?
The only command that i made that could replicate the issue was
(for x in {1..100}; do echo "$x"; done; sleep 100) | env_parallel -k --lb --pipe -N1 parse-event
shell-script shell gnu-parallel
New contributor
Im trying to parallelize websocket events, after searching a bit, i made a command like that
websocat "$URL" | env_parallel -k --lb --pipe -N1 parse-event
The problem is that every time, parallel waits for the first command to close before calling parse-event
, even with --line-buffer
I tested if the problem was on parallel arguments, but with another input, it works exactly as i need it, spawning instantly as it reads the data
while true; do echo "test"; done | env_parallel -k --lb --pipe -N1 parse-event
And the websocat output alone is fine too, works normally on the terminal, other commands, and on a while read LINE
loop
websocat "$URL" | xxd
Probably im missing something, what can be causing that?
The only command that i made that could replicate the issue was
(for x in {1..100}; do echo "$x"; done; sleep 100) | env_parallel -k --lb --pipe -N1 parse-event
shell-script shell gnu-parallel
shell-script shell gnu-parallel
New contributor
New contributor
New contributor
asked 39 mins ago
Andre AugustoAndre Augusto
1
1
New contributor
New contributor
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "106"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Andre Augusto is a new contributor. Be nice, and check out our Code of Conduct.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f522956%2fgnu-parallel-wait-for-command-even-with-line-buffer%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Andre Augusto is a new contributor. Be nice, and check out our Code of Conduct.
Andre Augusto is a new contributor. Be nice, and check out our Code of Conduct.
Andre Augusto is a new contributor. Be nice, and check out our Code of Conduct.
Andre Augusto is a new contributor. Be nice, and check out our Code of Conduct.
Thanks for contributing an answer to Unix & Linux Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f522956%2fgnu-parallel-wait-for-command-even-with-line-buffer%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown