OpenVZ Forum: Support » Has anyone run more than 49 VEs?

Home » General » Support » Has anyone run more than 49 VEs?

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Has anyone run more than 49 VEs? [message #28264]

Wed, 12 March 2008 19:44

yoolee
Messages: 23
Registered: November 2007

Junior Member

Hi,
I am using 2.6.18-fza-028stab051.1-686-bigmem kernel on a Debian 4.0 host.
I can not start more than 49 VEs, I have read many documents which talk about running hundreds of VEs using OpenVZ. I am wondering why I can't get there.
I appreciate your help.

Report message to a moderator

Re: Has anyone run more than 49 VEs? [message #28267 is a reply to message #28264]

Wed, 12 March 2008 22:29

rickb
Messages: 368
Registered: October 2006

Senior Member

it is certainly possible. If you are looking for a specific answer, start by posting the error message or condition you see.

-------------
Common Terms I post with: http://wiki.openvz.org/Category:Definitions

UBC. Learn it, love it, live it: http://wiki.openvz.org/Proc/user_beancounters

Report message to a moderator

Re: Has anyone run more than 49 VEs? [message #28273 is a reply to message #28267]

Thu, 13 March 2008 01:40

yoolee
Messages: 23
Registered: November 2007

Junior Member

Thanks!
My machine has 8GB memory.
I have 49 VE running (101-149), when I start VE 150, I got the followings:
The dmesg gives:
VE: 150: failed to start with err=-11
UBC: preparing to turn dcache accounting on, size 20300 pages, watermarks 0 20300
UBC: turning dcache accounting on succeeded, usage 3943688, time 0.016

The vzctl.log gives:
vzctl : VE 150 : Starting VE ...
vzctl : VE 150 : Mounting root: /vz/root/150 /vz/private/150
vzctl : VE 150 : Running: /etc/vz/conf/vps.mount
vzctl : VE 150 : VE is mounted
vzctl : VE 150 : Set iptables mask 0x000017bf
vzctl : VE 150 : Set features mask 0000000000000000/0000000000000000
vzctl : VE 150 : VE start failed
vzctl : VE 150 : Running: /usr/sbin/vzquota stat 150 -f
vzctl : VE 150 : VE is unmounted

And there are no fails in the /proc/user_beancounters.

I have tried to set the parameters in the "ulimit" as large as I can. But it did not solve the problem.

Report message to a moderator

Re: Has anyone run more than 49 VEs? [message #28277 is a reply to message #28273]

Thu, 13 March 2008 02:56

shuaib85
Messages: 59
Registered: September 2007

Member

Well, if you are intending to run a lot of containers for the purpose of checking how many container you can run on your machine. I guess use vzsplit to split the resources equally on all of them. As for my case I managed to run 55 container on a 2 GB RAM.

WebVZ: OpenVZ Web Management Tool
http://webvz.sourceforge.net

Report message to a moderator

Re: Has anyone run more than 49 VEs? [message #28283 is a reply to message #28273]

Thu, 13 March 2008 07:39

kir
Messages: 1645
Registered: August 2005
Location: Moscow, Russia

Senior Member

You might experience some memory shortage due to limitation of x86 arch.

To solve that, we recommend running x86_64 kernel on a boxes with more than 4GB of RAM. You can still run x86 VEs fine.

Kir Kolyshkin

http://static.openvz.org/userbars/openvz-developer.png

Report message to a moderator

Re: Has anyone run more than 49 VEs? [message #28308 is a reply to message #28283]

Thu, 13 March 2008 15:20

yoolee
Messages: 23
Registered: November 2007

Junior Member

Thank you!
I am using Xeon CPU E5335 which applies EM64T.
Yes, I will try x86_64 kernel.
Because I am using a Debian box so I have to recompile the kernel with OpenVZ config (specifically kernel-2.6.18-x86_64-smp.config.ovz), right?

Thanks again!

[Updated on: Thu, 13 March 2008 15:24]

Report message to a moderator

Re: Has anyone run more than 49 VEs? [message #28309 is a reply to message #28308]

Thu, 13 March 2008 16:51

alexu
Messages: 7
Registered: January 2008

Junior Member

to take full advantage of 64bit architecture, I'd advise to install 64bit distro instead of 32bit one Smile

you don't really need to compile kernel from scratch unless you have some specific needs. just add the following to your /etc/apt/sources.list:

deb http://download.openvz.org/debian-systs etch openvz
deb-src http://download.openvz.org/debian-systs etch openvz

and, import the key

wget -q -O - http://download.openvz.org/debian-systs/dso_archiv_signing_key.asc | apt-key add -

and do:

apt-get update && apt-get install ovzkernel-2.6.18-smp

(assuming you use multiprocessor or multicore server)

Report message to a moderator

Re: Has anyone run more than 49 VEs? [message #28312 is a reply to message #28309]

Thu, 13 March 2008 18:15

yoolee
Messages: 23
Registered: November 2007

Junior Member

Good point.
Now I can run more than 49 VEs, thanks.

But I only find 3GB memory with this kernel (ovzkernel-2.6.18-smp),
while my HN has 8GB memory.

How can I fix this?

Report message to a moderator

Re: Has anyone run more than 49 VEs? [message #28313 is a reply to message #28312]

Thu, 13 March 2008 18:30

alexu
Messages: 7
Registered: January 2008

Junior Member

You can fix it by installing 64bit Debian, it should not have any problem accessing memory over 3Gb. You get get it here:
http://www.debian.org/distrib/netinst
For your 64 bit Xeon machine you need to pick 'amd64' distro.

Report message to a moderator

[Solved] Re: Has anyone run more than 49 VEs? [message #28325 is a reply to message #28313]

Thu, 13 March 2008 23:39

yoolee
Messages: 23
Registered: November 2007

Junior Member

Thank you all.
Now I am using kernel ovzkernel-2.6.18-enterprise, everything is fine. I started 500 VEs.

Report message to a moderator

Re: [Solved] Re: Has anyone run more than 49 VEs? [message #34274 is a reply to message #28325]

Fri, 19 December 2008 11:03

robertkoch
Messages: 2
Registered: December 2008

Junior Member

the ovzkernels are no more in the repository.

are there any other workarrounds to get more the 49 VEs to run under debian etch?

Report message to a moderator

Re: [Solved] Re: Has anyone run more than 49 VEs? [message #34276 is a reply to message #34274]

Fri, 19 December 2008 15:52

yoolee
Messages: 23
Registered: November 2007

Junior Member

You could use the "enterprise" config file to compile a new kernel.

http://wiki.openvz.org/Different_kernel_flavors_(UP,_SMP,_ENTERPRISE,_ENTNOSPLIT)

Report message to a moderator