OpenVZ Forum


Home » General » Support » [Solved] vzmigrate strange quota problem
[Solved] vzmigrate strange quota problem [message #34032] Wed, 26 November 2008 13:53 Go to next message
piavlo is currently offline  piavlo
Messages: 159
Registered: January 2007
Senior Member
Hi, Today i was migrating a VE to other HN and it's disk usage is ~3G while quota is 4G
projsrv3 ~ # vzquota show 103
vzquota : (warning) Quota is running, so data reported from quota file may not reflect current values
   resource          usage       softlimit      hardlimit    grace
  1k-blocks        3092244         4194304        5242880        
     inodes         148954          900000        1000000      


I noticed that the rsync was taking too long, so i've looked at the destination HN logs and found:
Nov 26 14:06:13 localhost VZ QUOTA: disk softlimit exceeded for id=103
Nov 26 14:06:13 localhost VZ QUOTA: disk quota softlimit expired for id=103


I've checked with df -hx /vz/private/103 on destination HN, and it was ~3G as should. So i aborted the migration and started over again. This time i again did df -hx /vz/private/103 on destination HN and noticed
that after it reached ~3G , it stoped growing as should for servral seconds delay. Then suddenly it started to grow more up to 4G, then the sofquota was quota reached and disk usage dropped
back to ~3G. And the vzmigrate was stuck again. With lsof on both HNs, i was that the rsync processes where both waiting on select, i.e a deadlock.

Besides the potential deadlock, do you have any idea why on earth did VE disk space grow more that ~3G?

After I've enlarged the softlimit quota to 5G , vzmigrated worked ok. And /vz/private/103 disk usage was ~3G as should.
Strange...

ker Version is 2.6.18-028stab056-r1 & vzctl 3.0.22

[Updated on: Thu, 11 December 2008 08:54]

Report message to a moderator

Re: vzmigrate strange quota problem [message #34072 is a reply to message #34032] Sun, 30 November 2008 16:52 Go to previous messageGo to next message
piavlo is currently offline  piavlo
Messages: 159
Registered: January 2007
Senior Member
bump 2

[Updated on: Wed, 03 December 2008 20:57]

Report message to a moderator

Re: vzmigrate strange quota problem [message #34115 is a reply to message #34072] Wed, 03 December 2008 20:58 Go to previous messageGo to next message
piavlo is currently offline  piavlo
Messages: 159
Registered: January 2007
Senior Member
bump
Re: vzmigrate strange quota problem [message #34159 is a reply to message #34115] Tue, 09 December 2008 21:03 Go to previous messageGo to next message
piavlo is currently offline  piavlo
Messages: 159
Registered: January 2007
Senior Member
bump 3
Re: vzmigrate strange quota problem [message #34164 is a reply to message #34032] Wed, 10 December 2008 08:40 Go to previous messageGo to next message
maratrus is currently offline  maratrus
Messages: 1495
Registered: August 2007
Location: Moscow
Senior Member
Hi,


Quote:


projsrv3 ~ # vzquota show 103
vzquota : (warning) Quota is running, so data reported from quota file may not reflect current values
   resource          usage       softlimit      hardlimit    grace
  1k-blocks        3092244         4194304        5242880        
     inodes         148954          900000        1000000 




It's unfair to obtain quota statistics via quota file when quota is running (and you got appropriate message). Instead of "vzquota show" please use "vzquota stat".


Quote:


df -hx /vz/private/103


Is this misprint? Did you mean du instead df?

Quote:


I've checked with df -hx /vz/private/103 on destination HN



Could you check this information on the source node?

Was /vz/private/103 directory empty on the destination node before migration had started?

As far as I understand you've tried to perform online migration, haven't you?

vzmigrate should write progress messages on the source node. Is it possible to compare the messages on the source node to the events on the destination node, i.e.

"Syncing private" on the source node <----> the quota is growing up to 3 Gb on the destination node
etc

I think this could help us to determine what stage cause growing quota up to 4Gb.

Anything in logs/dmesg on the source/destination nodes?



Re: vzmigrate strange quota problem [message #34166 is a reply to message #34164] Wed, 10 December 2008 15:16 Go to previous messageGo to next message
maratrus is currently offline  maratrus
Messages: 1495
Registered: August 2007
Location: Moscow
Senior Member
Hello,

have you subscribed to openvz mailing list?

Seems the same problem was reported.

Please look at the --inplace option of the rsync utility.
And if you want you can add it to RSYNC_OPTIONS variable in /usr/sbin/vzmigrate script.
[Solved] Re: vzmigrate strange quota problem [message #34176 is a reply to message #34166] Thu, 11 December 2008 08:53 Go to previous message
piavlo is currently offline  piavlo
Messages: 159
Registered: January 2007
Senior Member
Then the large webserver logs explain why this happens.
Thanks a lot.
Previous Topic: delete
Next Topic: VPS Start Script
Goto Forum:
  


Current Time: Wed Jul 17 22:26:27 GMT 2024

Total time taken to generate the page: 0.04498 seconds