OpenVZ Forum


Home » General » Discussions » Memory & SWAP
Memory & SWAP [message #9791] Mon, 22 January 2007 21:08 Go to next message
devonblzx is currently offline  devonblzx
Messages: 127
Registered: December 2006
Senior Member
All right,

After reading a few discussions on these forums, I think I'm getting a partial hang of it...but I still want some clarification.

free -m, when --meminfo privvmpages:1 is set returns the "physpages", right? So why is there such a gap between my physpages and whats actually being used in privvmpages?

vzmemcheck -vA returns this:

Output values in Mbytes
veid        LowMem  LowMem     RAM MemSwap MemSwap   Alloc   Alloc   Alloc
              util  commit    util    util  commit    util  commit   limit
1             6.15   13.61   90.50   90.50   37.61  250.94 1037.61 1037.61
-------------------------------------------------------------------------
Summary:      6.15   13.61   90.50   90.50   37.61  250.94 1037.61 1037.61
        1579.00 1579.00 3949.00 10093.00 10093.00 10093.00 10093.00 10093.00


I realize the kernel memory isn't included, but free -m returns 84MB being used and in privvmpages, it says I'm using ~250MB.


Also where does SWAP come into play? I have 4GB of RAM and 6GB swap partition but it seems that the SWAP is never used even when a VPS is maxed out on RAM usage. I started getting fork errors but I still had 0/6GB Swap usage.

Is there a setting I should set for how much SWAP a VPS can use? Or do I set privvmpages for SWAP + RAM and then maybe vmguarpages for just RAM?

Any help would be greatly appreciated!

Thanks,
Devon

[EDIT]
Maybe someone can give me some exact values...

I want a VPS with 1024MB RAM and 1024MB SWAP available, right now I have privvmpages and vmguarpages to 262144.


http://static.openvz.org/userbars/openvz-user-2.png
ByteOnSite President

[Updated on: Mon, 22 January 2007 21:11]

Report message to a moderator

Re: Memory & SWAP [message #9793 is a reply to message #9791] Tue, 23 January 2007 01:15 Go to previous messageGo to next message
rickb is currently offline  rickb
Messages: 368
Registered: October 2006
Senior Member
privvm and phys will never be equal or even close in most cases. As the manual/wiki states, privvm is memory allocation whereas phys is memory usage. Most applications allocate large gobs of memory and actually use a fraction of it. you can look at privvm as the potential memory usage of the running applications and phys as the actual memory usage.

-------------
Common Terms I post with: http://wiki.openvz.org/Category:Definitions

UBC. Learn it, love it, live it: http://wiki.openvz.org/Proc/user_beancounters
Re: Memory & SWAP [message #9794 is a reply to message #9791] Tue, 23 January 2007 02:15 Go to previous messageGo to next message
devonblzx is currently offline  devonblzx
Messages: 127
Registered: December 2006
Senior Member
All right I understand what your saying. Why does it give me fork messages when I run out of privvmpages?

And do you know anything about my SWAP problem (above)?


http://static.openvz.org/userbars/openvz-user-2.png
ByteOnSite President
Re: Memory & SWAP [message #9800 is a reply to message #9794] Tue, 23 January 2007 09:17 Go to previous messageGo to next message
xemul is currently offline  xemul
Messages: 248
Registered: November 2005
Senior Member
When you fork your new task inherits all memory from its parent. Thus if your task has allocated 128M of private anonymous mappings and forks new system can potentially eat 256M of memory - if this exceeds privvmpages we don't allow forking.

SWAP isn't limited now - it's just accounted into oomguarpages. When system becomes low of memory it starts to oom kill tasks taking oomguarpages into account.

When VE eats all provvmpages no swapout starts - only when the whole system runs out of mem.

Also note, that freeing memory consists of 3 stages:
1. shrink kernel caches
2. sysncing file caches to disk
3. swapping anonymous pages out

so if kernel caches were shrinked no user pages go away.


http://static.openvz.org/userbars/openvz-developer.png
Re: Memory & SWAP [message #9822 is a reply to message #9791] Wed, 24 January 2007 03:00 Go to previous messageGo to next message
devonblzx is currently offline  devonblzx
Messages: 127
Registered: December 2006
Senior Member
So there is no way to set how much SWAP a VPS can use without affecting the amount of allocated RAM with it?

Lets say this scenario:

I have 4 clients on a 2GB RAM box with 2GB SWAP, can I give each of my clients privvmpages 262144 vmguarpages 131072 oomguarpages 262144 so they will have 512MB guaranteed RAM but have the ability to use the extra 512MB in SWAP? Is there another way to do this if that doesn't work?


http://static.openvz.org/userbars/openvz-user-2.png
ByteOnSite President
Re: Memory & SWAP [message #9823 is a reply to message #9822] Wed, 24 January 2007 04:14 Go to previous messageGo to next message
rickb is currently offline  rickb
Messages: 368
Registered: October 2006
Senior Member
As xemul said.. the VE has no concept of the difference between ram and swap. Its just "memory" at the VE level. So, your HN can have 64MB of ram and 64GB of swap. Or, your HN can have 64GB of ram and 64MB of swap. In the VE, the privvm, oomguar, vmguar are uneffected by this. Only the performance changes between the two scenarios. In either case, you can guarantee and limit each VE to an arbitrary amount of memory. This drastically differs from the conventional mem management of vmware/xen (isoloation). VZ is a shared kernel model and no resources are "hard dedicated" or "hard assigned".

-not possible to give/assign/guarantee a VE XX swap and YY physical memory
-not possible to restrict a VE from using physical memory and use swap instead


Think of the VZ virtual servers like resource containers, not individual linux boxes- VZ is a shared kernel approach to virtualization.

Hope this clears it up for you.


Rick Blundell


-------------
Common Terms I post with: http://wiki.openvz.org/Category:Definitions

UBC. Learn it, love it, live it: http://wiki.openvz.org/Proc/user_beancounters
Re: Memory & SWAP [message #9824 is a reply to message #9823] Wed, 24 January 2007 05:03 Go to previous messageGo to next message
devonblzx is currently offline  devonblzx
Messages: 127
Registered: December 2006
Senior Member
Yes thank you.

So when I give 1GB burstable RAM that will give them the ability to use that but they won't necessarily be using the SWAP but when the physical RAM does runs out the new memory left over memory will be SWAP, right? So I can give 512MB to 1GB burst even though I don't have the physical RAM to support it?


http://static.openvz.org/userbars/openvz-user-2.png
ByteOnSite President
Re: Memory & SWAP [message #9834 is a reply to message #9824] Wed, 24 January 2007 14:27 Go to previous messageGo to next message
rickb is currently offline  rickb
Messages: 368
Registered: October 2006
Senior Member
This is your same question reworded.

Think of a normal linux kernel with two instances of Apache. Now, can you tell the kernel to allow each to allocate XX MB of physical mem and YY MB of swap?- no you cannot. Now, think of each of those apaches being a VZ VE. Bottom line, in this simple scenario, the same memory manager is used on the HN vs. a conventional kernel. The only differences is that the kernel can reap back memory to enforce guarantees (vmguar+oomguar) or apply an upper alloc limit (privvm).

Quote:

So when I give 1GB burstable RAM that will give them the ability to use that but they won't necessarily be using the SWAP but when the physical RAM does runs out the new memory left over memory will be SWAP, right?


I already answered this with:
Quote:


not possible to give/assign/guarantee a VE XX swap and YY physical memory


----------------------
Quote:


So I can give 512MB to 1GB burst even though I don't have the physical RAM to support it?

I already answered this with:
Quote:


you can guarantee and limit each VE to an arbitrary amount of memory.


-------------
Common Terms I post with: http://wiki.openvz.org/Category:Definitions

UBC. Learn it, love it, live it: http://wiki.openvz.org/Proc/user_beancounters

[Updated on: Wed, 24 January 2007 14:30]

Report message to a moderator

Re: Memory & SWAP [message #37142 is a reply to message #9791] Fri, 21 August 2009 09:12 Go to previous messageGo to next message
pzYsTorM is currently offline  pzYsTorM
Messages: 5
Registered: January 2008
Junior Member
Sorry, but I have some questions to that.

What happens if I assign (f.ex.) /dev/sdb12 with 4GB swap space to a VE (vzctl --devnodes) and type swapon /dev/sdb12 inside the VE?
It is useless? Does it work like I hope? Is there a workaround?

Or would it be better to give 20GB swap space (5 VEs, each one should have 4GB swap) to the host system and no swap to the VE?


Thanks.
Re: Memory & SWAP [message #37763 is a reply to message #9834] Sun, 18 October 2009 13:10 Go to previous message
poige is currently offline  poige
Messages: 2
Registered: January 2009
Junior Member
Quote:
Think of a normal linux kernel with two instances of Apache. Now, can you tell the kernel to allow each to allocate XX MB of physical mem and YY MB of swap?- no you cannot. Now, think of each of those apaches being a VZ VE.


Ok, but OpenVZ is kernel level software and comparing it to Apache's looking wrong. The real problem is that OpenVZ doesn't support swap space partitioning (i. e., one can not say "ok, this instance can have as much as N MiBs/GiBs of swap"), though it could be really cool. And Apache isn't around at all.
Previous Topic: disk space usage
Next Topic: Any news on a new kernel branch?
Goto Forum:
  


Current Time: Tue Mar 19 03:44:35 GMT 2024

Total time taken to generate the page: 0.02410 seconds