OpenVZ Forum: Support » vzctl stop failed: Unable to stop VPS, operation timed out

Home » General » Support » vzctl stop failed: Unable to stop VPS, operation timed out

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

vzctl stop failed: Unable to stop VPS, operation timed out [message #6300]

Wed, 13 September 2006 19:25

demark
Messages: 10
Registered: July 2006

Junior Member

hi there,

maybe someone has hints on this one: i tried to stop one of my VPS using: vzctl stop VPSID

however, i get:

[root@vsrv ~]# vzctl --verbose stop 17
Unable to open /usr/lib/vzctl/modules/: No such file or directory
Stopping VPS ...
Unable to stop VPS, operation timed out

all processes are killed, the veth device is removed, but the vps is still up so i can neither stop nor restart it.

i'm at a loss here ...

thanks,
marc

Report message to a moderator

Re: vzctl stop failed: Unable to stop VPS, operation timed out [message #6321 is a reply to message #6300]

Thu, 14 September 2006 06:45

Vasily Tarasov
Messages: 1345
Registered: January 2006

Senior Member

Can you strace vzctl, please?
strace -f -o strace.out vzctl stop 17
And attach strace.out file here.

Thanks.

Report message to a moderator

Re: vzctl stop failed: Unable to stop VPS, operation timed out [message #6347 is a reply to message #6300]

Thu, 14 September 2006 12:12

demark
Messages: 10
Registered: July 2006

Junior Member

good idea, thank you for the hint. here's a strace attached.

Attachment: vzctl.strace.out
(Size: 206.63KB, Downloaded 464 times)

Report message to a moderator

Re: vzctl stop failed: Unable to stop VPS, operation timed out [message #6348 is a reply to message #6347]

Thu, 14 September 2006 12:38

Vasily Tarasov
Messages: 1345
Registered: January 2006

Senior Member

Well, what we can see... While stoping VE:

         ......
                ret = real_env_stop(h, veid, root, stop_mode);
         ......
        for (i = 0; i < MAX_SHTD_TM; i++) {
                sleep(1);
                if (!vps_is_run(h, veid)) {
                        ret = 0;
                        goto out;
                }
        }

real_env_stop() function just invokes "halt" in VE...
Do you have halt in VE? BTW, what template do you use?
You can try to stop VE be specifying --fast option:

vzctl stop <VEID> --fast

then vzctl won't execute halt, it just try to kill VE's init.

Report message to a moderator

Re: vzctl stop failed: Unable to stop VPS, operation timed out [message #6350 is a reply to message #6348]

Thu, 14 September 2006 13:32

demark
Messages: 10
Registered: July 2006

Junior Member

hi,

i used the standard debian 3.1 template, as downloaded from openvz.org; the vps contains "halt".

what happens is that i execute vzctl stop XX, and vzctl timeouts. it does kill most of the processes (just leaving 3 running, other times it kills all of them). for example, vzlist shows:

17 0 running vsrv17

the --fast option didn't help either

Report message to a moderator

Re: vzctl stop failed: Unable to stop VPS, operation timed out [message #6351 is a reply to message #6350]

Thu, 14 September 2006 13:36

Vasily Tarasov
Messages: 1345
Registered: January 2006

Senior Member

Looks like something bad...
What kernel version, host OS do you use?
Can you provide temporary access to the node in question?

Thanks.

Report message to a moderator

Re: vzctl stop failed: Unable to stop VPS, operation timed out [message #6352 is a reply to message #6351]

Thu, 14 September 2006 13:49

demark
Messages: 10
Registered: July 2006

Junior Member

hi,

this is CentOS release 4.3 (Final) with kernel 2.6.16-026test017.1-smp (rpm from openvz)
remote access is unfortunately impossible since this is behind a firewall, using internal ips.
i'm using veth

i found something else in "dmesg":

unregister_netdevice: waiting for lo to become free. Usage count = 4267

(lots of those messages, that is)
apparently something in networking causes these hangs. interestingly, when i run network-related commands like "ifconfig" or "ip addr show" in any VPS node AND in the hardware node, it hangs. other commands run just fine.

reminds me of a test kernel some months ago, where the entire system would crash after "vzctl stop" if the veth device wasn't manually shut down and removed before.

Report message to a moderator