Hello all,
I'm running openVZ on centOS 5.7
uname -r
2.6.18-274.3.1.el5.028stab094.3
When I create new containers using a customized fedora v15 template, everythings works ok.
But when I have a certain number of CT's running, mysqld can't start for the last started CT's. If I stop some containers then I can start mysqld and it works.
I enter in a container and see:
[root]# tail -100 /var/logs/mysqld.log
111112 10:22:50 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
111112 10:22:50 [Note] Plugin 'FEDERATED' is disabled.
111112 10:22:50 InnoDB: The InnoDB memory heap is disabled
111112 10:22:50 InnoDB: Mutexes and rw_locks use GCC atomic builtins
111112 10:22:50 InnoDB: Compressed tables use zlib 1.2.5
111112 10:22:50 InnoDB: Using Linux native AIO
111112 10:22:50 InnoDB: Warning: io_setup() failed with EAGAIN. Will make 5 attempts before giving up.
InnoDB: Warning: io_setup() attempt 1 failed.
InnoDB: Warning: io_setup() attempt 2 failed.
InnoDB: Warning: io_setup() attempt 3 failed.
InnoDB: Warning: io_setup() attempt 4 failed.
InnoDB: Warning: io_setup() attempt 5 failed.
111112 10:22:52 InnoDB: Error: io_setup() failed with EAGAIN after 5 attempts.
InnoDB: You can disable Linux Native AIO by setting innodb_native_aio = off in my.cnf
111112 10:22:52 InnoDB: Initializing buffer pool, size = 128.0M
111112 10:22:52 InnoDB: Completed initialization of buffer pool
111112 10:22:52 - mysqld got signal 11 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
We will try our best to scrape up some info that will hopefully help diagnose
the problem, but since we have already crashed, something is definitely wrong
and this may fail.
key_buffer_size=8388608
read_buffer_size=131072
max_used_connections=0
max_threads=151
thread_count=0
connection_count=0
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 337868 K
bytes of memory
Hope that's ok; if not, decrease some variables in the equation.
Thread pointer: 0x0
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
111112 10:22:52 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended
I get also this error:
111112 10:58:31 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
111112 10:58:31 [Note] Plugin 'FEDERATED' is disabled.
111112 10:58:31 InnoDB: The InnoDB memory heap is disabled
111112 10:58:31 InnoDB: Mutexes and rw_locks use GCC atomic builtins
111112 10:58:31 InnoDB: Compressed tables use zlib 1.2.5
111112 10:58:31 InnoDB: Using Linux native AIO
111112 10:58:31 InnoDB: Warning: io_setup() failed with EAGAIN. Will make 5 attempts before giving up.
InnoDB: Warning: io_setup() attempt 1 failed.
InnoDB: Warning: io_setup() attempt 2 failed.
InnoDB: Warning: io_setup() attempt 3 failed.
InnoDB: Warning: io_setup() attempt 4 failed.
InnoDB: Warning: io_setup() attempt 5 failed.
111112 10:58:34 InnoDB: Error: io_setup() failed with EAGAIN after 5 attempts.
InnoDB: You can disable Linux Native AIO by setting innodb_native_aio = off in my.cnf
111112 10:58:34 InnoDB: Initializing buffer pool, size = 128.0M
111112 10:58:34 InnoDB: Completed initialization of buffer pool
111112 10:58:34 - mysqld got signal 11 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
111112 10:58:34 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended
Here is the /etc/my.cnf file of a container:
[mysqld]
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
user=mysql
# Disabling symbolic-links is recommended to prevent assorted security risks
symbolic-links=0
[mysqld_safe]
log-error=/var/log/mysqld.log
pid-file=/var/run/mysqld/mysqld.pid
Here are the UBC:
[root]# cat /proc/user_beancounters
Version: 2.5
uid resource held maxheld barrier limit failcnt
113: kmemsize 2526590 3377739 168442484 185286732 0
lockedpages 0 0 8224 8224 0
privvmpages 11502 78323 1381448 1519592 0
shmpages 128 128 138144 138144 0
dummy 0 0 0 0 0
numproc 14 28 4112 4112 0
physpages 4268 10532 0 9223372036854775807 0
vmguarpages 0 0 1381448 9223372036854775807 0
oomguarpages 4268 10532 1381448 9223372036854775807 0
numtcpsock 4 4 4112 4112 0
numflock 4 5 1000 1100 0
numpty 1 1 411 411 0
numsiginfo 0 4 1024 1024 0
tcpsndbuf 70016 70016 39304742 56147494 0
tcprcvbuf 65536 65536 39304742 56147494 0
othersockbuf 2328 12200 19652371 36495123 0
dgramrcvbuf 0 8472 19652371 19652371 0
numothersock 2 5 4112 4112 0
dcachesize 231933 255408 36792419 37896192 0
numfile 519 778 65792 65792 0
dummy 0 0 0 0 0
dummy 0 0 0 0 0
dummy 0 0 0 0 0
numiptent 24 24 100 100 0
SELINUX is disabled on the hn.
I've found the fantstic vzsplit and used it for partitioning the resources, but the problem still persists.
How do you solve it?
I'm reading some articles but I don't identify where lies the problem.
Please can anyone help?
Thanks in advance!!!
P