OpenVZ Forum


Home » General » Support » I/O Error
I/O Error [message #12838] Fri, 11 May 2007 08:45 Go to next message
sspt is currently offline  sspt
Messages: 100
Registered: August 2006
Location: Portugal
Senior Member
Hello,
I had a I/O error this morning affecting a node and randomly some VEs.

In Host System
[root@laxvps ~]# ls -ls
ls > ls: reading directory .: Input/output error

Inside VEs
Sometimes everything works fine and sometimes get the same HN error

I have checked user_beancounters and there are no errors


http://static.openvz.org/userbars/openvz-user.png
Re: I/O Error [message #12845 is a reply to message #12838] Fri, 11 May 2007 11:43 Go to previous messageGo to next message
rickb is currently offline  rickb
Messages: 368
Registered: October 2006
Senior Member
This is a storage layer problem from my experience. what does dmesg say?



-------------
Common Terms I post with: http://wiki.openvz.org/Category:Definitions

UBC. Learn it, love it, live it: http://wiki.openvz.org/Proc/user_beancounters
Re: I/O Error [message #13803 is a reply to message #12838] Wed, 06 June 2007 00:22 Go to previous messageGo to next message
sspt is currently offline  sspt
Messages: 100
Registered: August 2006
Location: Portugal
Senior Member
About one month later, with a new HDD it happened again, in the same conditions.

When i was compiling some stuff and the node load average goes up to 100, it start giving me errors.

laxvps kernel: journal commit I/O error

[root@laxvps ~]# dmesg -a | less
-bash: /bin/dmesg: Input/output error
Segmentation fault

Is there any way to check if the problem is related with my node/ve I/O prios?


http://static.openvz.org/userbars/openvz-user.png
Re: I/O Error [message #13807 is a reply to message #13803] Wed, 06 June 2007 03:52 Go to previous messageGo to next message
kingneutron is currently offline  kingneutron
Messages: 30
Registered: May 2007
Location: NE IL, USA
Member
What filesystem are you using on host / VE?
Re: I/O Error [message #13815 is a reply to message #13803] Wed, 06 June 2007 10:11 Go to previous messageGo to next message
rickb is currently offline  rickb
Messages: 368
Registered: October 2006
Senior Member
Its a storage layer problem and not isolated/due to a VE. I would set up netconsole (check wiki), and you can view your server's dmesg output even after the problem occurs.

What is happening is the system cannot even read the dmesg binary. If your kernel is exporting its ring buffer over the network, I think you can see whats going on. Likely, you will see some error on /dev/hdX, /dev/sdX, etc.

When the problem occurs, you have no choice but to reboot the node, correct? Are there any messages on the local console?



-------------
Common Terms I post with: http://wiki.openvz.org/Category:Definitions

UBC. Learn it, love it, live it: http://wiki.openvz.org/Proc/user_beancounters

[Updated on: Wed, 06 June 2007 10:12]

Report message to a moderator

Re: I/O Error [message #13828 is a reply to message #13803] Wed, 06 June 2007 11:16 Go to previous messageGo to next message
Vasily Tarasov is currently offline  Vasily Tarasov
Messages: 1345
Registered: January 2006
Senior Member
The problem can be not in HDD, but in controller, that is on your motherboard. Anyway, you have to setup remote console (http://wiki.openvz.org/Remote_console_setup) and gather kernel messages...

Vasily.
Re: I/O Error [message #13834 is a reply to message #12838] Wed, 06 June 2007 12:43 Go to previous message
sspt is currently offline  sspt
Messages: 100
Registered: August 2006
Location: Portugal
Senior Member
I'll setup the netconsole now, but it really seems to be with the controller.

When it happens:
1 - laxvps kernel: journal commit I/O error
2 - FS(Ext3) - read-only
3 - Some files are accessible, others don't
? ?--------- 1 ? ? ? Feb 24 01:11 install.log


http://static.openvz.org/userbars/openvz-user.png
Previous Topic: agp support
Next Topic: *SOLVED* VE Network hangs
Goto Forum:
  


Current Time: Thu Nov 07 14:19:13 GMT 2024

Total time taken to generate the page: 0.05979 seconds