OpenVZ Forum


Home » General » Support » Update to 7.0.9 release and journalctl verify system freeze
Update to 7.0.9 release and journalctl verify system freeze [message #53507] Fri, 03 May 2019 01:31 Go to next message
wsap is currently offline  wsap
Messages: 70
Registered: March 2018
Location: Halifax, NS
Member
All of the following occurred exactly the same on two distinct bare metal boxes:

- At the start we were running OpenVZ release 7.0.8 with the factory kernel version vzkernel-3.10.0-862.20.2.vz7.73.27.x86_64 (note that it was *only* the kernel on the factory version -- everything else was on release)
- We updated to 7.0.9 release version with matching release kernel 3.10.0-862.20.2.vz7.73.29 then reboot the machine
- System reboots successfully
- `journalctl --verify` running at 100% CPU and /var/log/messages had nothing new in it since the shutdown part of the reboot. (Presumably because of the in-progress verification)
- Within approximately 7-10 minutes the whole server froze and reboots would bring it back to the same state as in the above step
- On a reboot, and within that 7-10 minute grace period before freezing, we killed the journalctl --verify process on both machines, and the bare metal nodes remained stable -- no more freeze.

My guess would be that either:

1. journalctl's verify process has a bug in it that causes the freeze, or
2. The lack of logging that occurs while journalctl --verify is running causes something else on the box to freak out and lock up

We're curious to see if anyone else has experienced a similar issue with journalctl --verify causing hardware lock-ups after a reboot (or update and reboot).
Re: Update to 7.0.9 release and journalctl verify system freeze [message #53517 is a reply to message #53507] Mon, 13 May 2019 10:36 Go to previous messageGo to next message
khorenko is currently offline  khorenko
Messages: 533
Registered: January 2006
Location: Moscow, Russia
Senior Member
We did not face this problem and for investigation we need a memory dump when the node is frozen.
Please crash it with "echo c > /proc/sysrq-trigger" or with Alt+SysRQ+c and file a bug with the dump at http://bugs.openvz.org


If your problem is solved - please, report it!
It's even more important than reporting the problem itself...
Re: Update to 7.0.9 release and journalctl verify system freeze [message #53528 is a reply to message #53507] Mon, 20 May 2019 07:07 Go to previous messageGo to next message
bkbbkb is currently offline  bkbbkb
Messages: 4
Registered: August 2015
Junior Member
Please update to systemd-219-63.vl7.6
journalctl --verify is fixed there.
Re: Update to 7.0.9 release and journalctl verify system freeze [message #53531 is a reply to message #53528] Mon, 20 May 2019 20:58 Go to previous messageGo to next message
wsap is currently offline  wsap
Messages: 70
Registered: March 2018
Location: Halifax, NS
Member
That's great, thank you!
Re: Update to 7.0.9 release and journalctl verify system freeze [message #53533 is a reply to message #53528] Mon, 27 May 2019 01:40 Go to previous message
wsap is currently offline  wsap
Messages: 70
Registered: March 2018
Location: Halifax, NS
Member
bkbbkb wrote on Mon, 20 May 2019 04:07
Please update to systemd-219-63.vl7.6
journalctl --verify is fixed there.


Thanks bkbbkb! Updated to 7.0.10 release along with all release packages of vzlinux 7.5 and can confirm this issue is repaired Smile

[Updated on: Mon, 27 May 2019 01:41]

Report message to a moderator

Previous Topic: factory repo, should it be used or not?
Next Topic: OpenVZ 7 + mdadm slow rebuild
Goto Forum:
  


Current Time: Sat Jul 13 23:33:27 GMT 2024

Total time taken to generate the page: 0.02197 seconds