Virtual Memory Usage Exceeding Physical Drive SpaceTop showing virtual memory usage of hundreds of...
I agreed to cancel a long-planned vacation (with travel costs) due to project deadlines, but now the timeline has all changed again
Are the Gray and Death Slaad's Bite and Claw attacks magical?
What was the ASCII end of medium (EM) character intended to be used for?
Why can't i use !(single pattern) in zsh even after i turn on kshglob?
Is this house-rule removing the increased effect of cantrips at higher character levels balanced?
Simplify the code
usage of y" not just for locations?
What was the point of separating stdout and stderr?
Cannot overlay, because ListPlot does not draw same X range despite the same PlotRange
Find the closest three-digit hex colour
Why are examinees often not allowed to leave during the start and end of an exam?
Making arrow with a gradual colour
When does it become illegal to exchange bitcoin for cash?
Emphasize numbers in tables
Is it theoretically possible to hack printer using scanner tray?
What could a Medieval society do with excess animal blood?
What do you call the fear of forgetting (specifically something one cherishes a lot)?
What is the point of using the kunai?
Avoiding repetition when using the "snprintf idiom" to write text
Can I deep fry food in butter instead of vegetable oil?
How to idiomatically express the idea "if you can cheat without being caught, do it"
Why is the saxophone not common in classical repertoire?
Old story where computer expert digitally animates The Lord of the Rings
Installed software from source, how to say yum not to install it from package?
Virtual Memory Usage Exceeding Physical Drive Space
Top showing virtual memory usage of hundreds of gigabytesExcessively high memory usage reported (3 GB) after rebootSwap bash script pins htop's memory usageGNU Parallel Limit Memory Usagehttpd memory usagePossible slab memory leak related to bio and btrfs?GNU/Linux OOM (out of memory) freezes - solution ideasLinux kernel: LOWMEM + HIGHMEM > Total memory?Limit a process or users physical memory shareMemory fragmentation on RHEL7Top showing virtual memory usage of hundreds of gigabytes
I have a machine running Ubuntu on Amazon EC2. The machine has a 43 Gb root drive and 30 Gb of RAM. I am running a processor and memory intensive process and I've noticed that it sometimes stalls for no apparent reason.
I'm looking at the system usage via the htop program. I've included a screenshot below.
Does it make sense that the VIRT column adds up to more than the physical drive space of the system? My understanding is that is virtual memory usage. Essentially I'm trying to understand whether my process is freezing because it's running out of resources, and which resources it's running out of.
memory top htop
asked May 27 '14 at 20:01
gallaminegallamine
1211 silver badge6 bronze badges
bumped to the homepage by Community♦ 1 hour ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
|
show 3 more comments
I have a machine running Ubuntu on Amazon EC2. The machine has a 43 Gb root drive and 30 Gb of RAM. I am running a processor and memory intensive process and I've noticed that it sometimes stalls for no apparent reason.
I'm looking at the system usage via the htop program. I've included a screenshot below.
Does it make sense that the VIRT column adds up to more than the physical drive space of the system? My understanding is that is virtual memory usage. Essentially I'm trying to understand whether my process is freezing because it's running out of resources, and which resources it's running out of.
memory top htop
asked May 27 '14 at 20:01
gallaminegallamine
1211 silver badge6 bronze badges
bumped to the homepage by Community♦ 1 hour ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
RSSis the physical memory used,VIRTis the entire address space (swap+RSS)
– Bratchley
May 27 '14 at 20:13
RSS, do you meanRES? The sum of theREScolumn exceeds the total memory the system has - 30gb
– gallamine
May 27 '14 at 20:16
YeahRSSis the same asRES. Since theVIRTandRESfor several of those processes match up, I'd see if those PID's are threads of the same process, in which case they'll share the same memory and so should only be counted once.
– Bratchley
May 27 '14 at 20:28
The processes I'm talking about are the 10.1GB for VIRT and 9121MB for RSS.
– Bratchley
May 27 '14 at 20:28
1
I'm assuming you checked and they are? If you aren't sure, you can try going go intosetup>display optionsand tell it to display threads in a different color.
– Bratchley
May 27 '14 at 20:41
|
show 3 more comments
I have a machine running Ubuntu on Amazon EC2. The machine has a 43 Gb root drive and 30 Gb of RAM. I am running a processor and memory intensive process and I've noticed that it sometimes stalls for no apparent reason.
I'm looking at the system usage via the htop program. I've included a screenshot below.
Does it make sense that the VIRT column adds up to more than the physical drive space of the system? My understanding is that is virtual memory usage. Essentially I'm trying to understand whether my process is freezing because it's running out of resources, and which resources it's running out of.
memory top htop
asked May 27 '14 at 20:01
gallaminegallamine
1211 silver badge6 bronze badges
I have a machine running Ubuntu on Amazon EC2. The machine has a 43 Gb root drive and 30 Gb of RAM. I am running a processor and memory intensive process and I've noticed that it sometimes stalls for no apparent reason.
I'm looking at the system usage via the htop program. I've included a screenshot below.
Does it make sense that the VIRT column adds up to more than the physical drive space of the system? My understanding is that is virtual memory usage. Essentially I'm trying to understand whether my process is freezing because it's running out of resources, and which resources it's running out of.
memory top htop
memory top htop
asked May 27 '14 at 20:01
gallaminegallamine
1211 silver badge6 bronze badges
asked May 27 '14 at 20:01
gallaminegallamine
1211 silver badge6 bronze badges
asked May 27 '14 at 20:01
gallaminegallamine
1211 silver badge6 bronze badges
asked May 27 '14 at 20:01
gallaminegallamine
1211 silver badge6 bronze badges
asked May 27 '14 at 20:01
gallaminegallamine
1211 silver badge6 bronze badges
1211 silver badge6 bronze badges
bumped to the homepage by Community♦ 1 hour ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
bumped to the homepage by Community♦ 1 hour ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
RSSis the physical memory used,VIRTis the entire address space (swap+RSS)
– Bratchley
May 27 '14 at 20:13
RSS, do you meanRES? The sum of theREScolumn exceeds the total memory the system has - 30gb
– gallamine
May 27 '14 at 20:16
YeahRSSis the same asRES. Since theVIRTandRESfor several of those processes match up, I'd see if those PID's are threads of the same process, in which case they'll share the same memory and so should only be counted once.
– Bratchley
May 27 '14 at 20:28
The processes I'm talking about are the 10.1GB for VIRT and 9121MB for RSS.
– Bratchley
May 27 '14 at 20:28
1
I'm assuming you checked and they are? If you aren't sure, you can try going go intosetup>display optionsand tell it to display threads in a different color.
– Bratchley
May 27 '14 at 20:41
|
show 3 more comments
RSSis the physical memory used,VIRTis the entire address space (swap+RSS)
– Bratchley
May 27 '14 at 20:13
RSS, do you meanRES? The sum of theREScolumn exceeds the total memory the system has - 30gb
– gallamine
May 27 '14 at 20:16
YeahRSSis the same asRES. Since theVIRTandRESfor several of those processes match up, I'd see if those PID's are threads of the same process, in which case they'll share the same memory and so should only be counted once.
– Bratchley
May 27 '14 at 20:28
The processes I'm talking about are the 10.1GB for VIRT and 9121MB for RSS.
– Bratchley
May 27 '14 at 20:28
1
I'm assuming you checked and they are? If you aren't sure, you can try going go intosetup>display optionsand tell it to display threads in a different color.
– Bratchley
May 27 '14 at 20:41
RSS is the physical memory used, VIRT is the entire address space (swap+RSS)– Bratchley
May 27 '14 at 20:13
RSS is the physical memory used, VIRT is the entire address space (swap+RSS)– Bratchley
May 27 '14 at 20:13
RSS, do you mean RES? The sum of the RES column exceeds the total memory the system has - 30gb– gallamine
May 27 '14 at 20:16
RSS, do you mean RES? The sum of the RES column exceeds the total memory the system has - 30gb– gallamine
May 27 '14 at 20:16
Yeah
RSS is the same as RES. Since the VIRT and RES for several of those processes match up, I'd see if those PID's are threads of the same process, in which case they'll share the same memory and so should only be counted once.– Bratchley
May 27 '14 at 20:28
Yeah
RSS is the same as RES. Since the VIRT and RES for several of those processes match up, I'd see if those PID's are threads of the same process, in which case they'll share the same memory and so should only be counted once.– Bratchley
May 27 '14 at 20:28
The processes I'm talking about are the 10.1GB for VIRT and 9121MB for RSS.
– Bratchley
May 27 '14 at 20:28
The processes I'm talking about are the 10.1GB for VIRT and 9121MB for RSS.
– Bratchley
May 27 '14 at 20:28
1
1
I'm assuming you checked and they are? If you aren't sure, you can try going go into
setup>display options and tell it to display threads in a different color.– Bratchley
May 27 '14 at 20:41
I'm assuming you checked and they are? If you aren't sure, you can try going go into
setup>display options and tell it to display threads in a different color.– Bratchley
May 27 '14 at 20:41
|
show 3 more comments
1 Answer
1
active
oldest
votes
This is normal; it's because Linux has overcommit (overcommit.ratio) and VIRT is also shared memory between processes that use the same shared objects.
answered May 28 '14 at 4:04
user1529891user1529891
2,1106 gold badges26 silver badges47 bronze badges
add a comment |
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "106"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f132270%2fvirtual-memory-usage-exceeding-physical-drive-space%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
This is normal; it's because Linux has overcommit (overcommit.ratio) and VIRT is also shared memory between processes that use the same shared objects.
answered May 28 '14 at 4:04
user1529891user1529891
2,1106 gold badges26 silver badges47 bronze badges
add a comment |
This is normal; it's because Linux has overcommit (overcommit.ratio) and VIRT is also shared memory between processes that use the same shared objects.
answered May 28 '14 at 4:04
user1529891user1529891
2,1106 gold badges26 silver badges47 bronze badges
add a comment |
This is normal; it's because Linux has overcommit (overcommit.ratio) and VIRT is also shared memory between processes that use the same shared objects.
answered May 28 '14 at 4:04
user1529891user1529891
2,1106 gold badges26 silver badges47 bronze badges
This is normal; it's because Linux has overcommit (overcommit.ratio) and VIRT is also shared memory between processes that use the same shared objects.
answered May 28 '14 at 4:04
user1529891user1529891
2,1106 gold badges26 silver badges47 bronze badges
answered May 28 '14 at 4:04
user1529891user1529891
2,1106 gold badges26 silver badges47 bronze badges
answered May 28 '14 at 4:04
user1529891user1529891
2,1106 gold badges26 silver badges47 bronze badges
answered May 28 '14 at 4:04
user1529891user1529891
2,1106 gold badges26 silver badges47 bronze badges
2,1106 gold badges26 silver badges47 bronze badges
add a comment |
add a comment |
Thanks for contributing an answer to Unix & Linux Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f132270%2fvirtual-memory-usage-exceeding-physical-drive-space%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
RSSis the physical memory used,VIRTis the entire address space (swap+RSS)– Bratchley
May 27 '14 at 20:13
RSS, do you meanRES? The sum of theREScolumn exceeds the total memory the system has - 30gb– gallamine
May 27 '14 at 20:16
Yeah
RSSis the same asRES. Since theVIRTandRESfor several of those processes match up, I'd see if those PID's are threads of the same process, in which case they'll share the same memory and so should only be counted once.– Bratchley
May 27 '14 at 20:28
The processes I'm talking about are the 10.1GB for VIRT and 9121MB for RSS.
– Bratchley
May 27 '14 at 20:28
1
I'm assuming you checked and they are? If you aren't sure, you can try going go into
setup>display optionsand tell it to display threads in a different color.– Bratchley
May 27 '14 at 20:41