OpenVZ Forum


Home » General » Support » rsync problem
rsync problem [message #8155] Thu, 09 November 2006 15:11 Go to next message
till is currently offline  till
Messages: 5
Registered: November 2006
Junior Member

Hello,
I have a problem again.

I try to rsync my server to back it up(via snapshot).
The prog uses this cmd to do so:
/usr/bin/rsync -azHx --delete --numeric-ids --relative --delete-excluded --stats --rsh="/usr/bin/ssh -c blowfish" root@ip.here:/ /var/cache/rsnapshot/hourly.0/myserver/

Looks good. On the one vz it works good. The other one crashes. I cant login via ssh or so. via vzctl I can enter. But I have to restart the vz to get it back to work.

This is the user_beancounters for the box that works:
       101: kmemsize        2565294    3224974   16384000   18022400          0
            lockedpages           0       4072       4096       4096       1175
            privvmpages      153755     261999     262144     292912       3945
            shmpages            692       1348     131072     131072          0
            dummy                 0          0          0          0          0
            numproc              77         89        500        500          0
            physpages          8718      13130          0 2147483647          0
            vmguarpages           0          0       6144 2147483647          0
            oomguarpages       8718      13130       6144 2147483647          0
            numtcpsock            5          7        500        500          0
            numflock              3          8        200        210          0
            numpty                1          3         64         64          0
            numsiginfo            0          3        512        512          0
            tcpsndbuf         46956     219128    5365760   10485760          0
            tcprcvbuf         81920      81920    5365760   10485760          0
            othersockbuf       4472     132000     132096     336896       9956
            dgramrcvbuf           0       2236    1503232    4063232          0
            numothersock          5         15        500        500          0
            dcachesize            0          0    4194304    4317184          0
            numfile            1330       1557       8192       8192          0
            dummy                 0          0          0          0          0
            dummy                 0          0          0          0          0
            dummy                 0          0          0          0          0
            numiptent            10         10        128        128          0

and this for the one that dos not:
       105: kmemsize        1918950    3591777   16384000   18022400          0
            lockedpages           0          0       4096       4096          0
            privvmpages       42463      87224     262144     292912          0
            shmpages            142        908     131072     131072          0
            dummy                 0          0          0          0          0
            numproc              30         55        500        500          0
            physpages          9905      49164          0 2147483647          0
            vmguarpages           0          0       6144 2147483647          0
            oomguarpages       9905      49164       6144 2147483647          0
            numtcpsock            8         25        500        500          0
            numflock              4          8        200        210          0
            numpty                0          2         64         64          0
            numsiginfo            0         28        512        512          0
            tcpsndbuf         71552     230308    5365760   10485760          0
            tcprcvbuf        131072          0    5365760   10485760          0
            othersockbuf      29068     132036     132096     336896       4709
            dgramrcvbuf           0       8380    1503232    4063232          0
            numothersock         17         27        500        500          0
            dcachesize            0          0    4194304    4317184          0
            numfile             822       1516       8192       8192          0
            dummy                 0          0          0          0          0
            dummy                 0          0          0          0          0
            dummy                 0          0          0          0          0
            numiptent            10         10        128        128          0


I cant find something in the logfiles.

Runnig now a 2.6.9 Kernel from debian.

[Updated on: Thu, 09 November 2006 19:01] by Moderator

Report message to a moderator

Re: rsync problem [message #8182 is a reply to message #8155] Thu, 09 November 2006 19:10 Go to previous messageGo to next message
dev is currently offline  dev
Messages: 1693
Registered: September 2005
Location: Moscow
Senior Member

> I try to rsync my server to back it up(via snapshot).
> The prog uses this cmd to do so:
> /usr/bin/rsync -azHx --delete --numeric-ids --relative
> --delete-excluded --stats --rsh="/usr/bin/ssh -c blowfish"
> root@ip.here:/ /var/cache/rsnapshot/hourly.0/myserver/

1. what do you mean by snapshot? LVM snapshot or what? rsync doesn't do any real(!) snapshots.
2. Do I understand correctly that you run this command from inside VE to backup its data *to* remote server?

> Looks good. On the one vz it works good.
> The other one crashes.
1. Can you shed some light on this? rsync requires 2 nodes. So I can't understand what "on the one vz it works, the other crashes" mean.
Do you mean that source node or destination (where backups are stored) crashes?
2. What do you mean by crashes?
Does your host system continues to work?
Can you ssh to the host?
Do you see some kernel messages on the screen?
3. is it reproducable? if yes, can you demonstrate it with exact commands/details and maybe provide us login to resolve it?
4. what are kernel versions on source and destination nodes (uname -a)? have you taken kernels from binary RPMs or rebuilt kernel yourself? what kernel configs have you used?

> I cant login via ssh or so. via vzctl I can enter.
> But I have to restart the vz to get it back to work.
Ok, this makes me believe that host system continues to work, right?
But VE networking somehow stops responding?
Does ping ve-ip-addr works?
Do you mean "restart vz" == "/etc/init.d/vz restart"? If yes, I guess 'vzctl restart VEID' helps as well?

P.S. I renamed the title of your post, since it was too emotional, with too incomplete information.


http://static.openvz.org/userbars/openvz-developer.png
Re: rsync problem [message #8190 is a reply to message #8182] Thu, 09 November 2006 23:14 Go to previous messageGo to next message
till is currently offline  till
Messages: 5
Registered: November 2006
Junior Member

dev wrote on Thu, 09 November 2006 14:10

> I try to rsync my server to back it up(via snapshot).
> The prog uses this cmd to do so:
> /usr/bin/rsync -azHx --delete --numeric-ids --relative
> --delete-excluded --stats --rsh="/usr/bin/ssh -c blowfish"
> root@ip.here:/ /var/cache/rsnapshot/hourly.0/myserver/

1. what do you mean by snapshot? LVM snapshot or what? rsync doesn't do any real(!) snapshots.


The program is namend rsnapshot ( http://www.rsnapshot.org/ ). Its something that generates rsync cmds and moves the old files away. Nothing special.
Quote:


2. Do I understand correctly that you run this command from inside VE to backup its data *to* remote server?


oke, my fault. The setup:
fileserver (for the backup)
box with openvz-kernel
-->virtual box 1 (works with the rsnapshot/rsync)
-->virtual box 2 (does not work with rsnapshot/rsync)

the fileserve runs the rsync cmd.
Quote:


2. What do you mean by crashes?
Does your host system continues to work?
Can you ssh to the host?
Do you see some kernel messages on the screen?


After some MB of the rsync, rsync dies. So it does not copy eny more files.
I _can_ ping the virtual box.
I _cant_ ssh the virtual box.
I _cant_ ping from inside of the virtual box.
Quote:


3. is it reproducable? if yes, can you demonstrate it with exact commands/details and maybe provide us login to resolve it?


The good news: It is reproducable. And it is simple. I simply run this cmd from the fileserver: rsync -rv root@ip.of.virtual.box.2.:/ .
Give you access: May be possible. The problem is that this box runs a memberdatabase of two NGOs. Perhaps we will find a way to do this via screen, hm?
Quote:


4. what are kernel versions on source and destination nodes (uname -a)? have you taken kernels from binary RPMs or rebuilt kernel yourself? what kernel configs have you used?


uame -a:
Linux bi-o-mass 2.6.9-023stab032.1-ovz-i386 #1 Thu Oct 26 19:39:19 UTC 2006 i686 GNU/Linux
The kernel is from debian testing. I used the binary build of the guys.
Quote:


> I cant login via ssh or so. via vzctl I can enter.
> But I have to restart the vz to get it back to work.
Ok, this makes me believe that host system continues to work, right?
But VE networking somehow stops responding?
Does ping ve-ip-addr wo]rks?
Do you mean "restart vz" == "/etc/init.d/vz restart"? If yes, I guess 'vzctl restart VEID' helps as well?


I restart the machine via vzctl restart VZID. VZ seems running fine as well as the other virtual systems. Normaly it takes ~10 sec to restart this virtual server(2). But in case of doing an rsync before it takes ~60 sec.
I dont find any output in any logfiles. If I have time at the weekend I will drive to the serverroom and look at the screenoutput.
Quote:


P.S. I renamed the title of your post, since it was too emotional, with too incomplete information.


No probem. It was just a funny idea Wink
Thanks for your time!
Re: rsync problem [message #8196 is a reply to message #8190] Fri, 10 November 2006 08:43 Go to previous messageGo to next message
dev is currently offline  dev
Messages: 1693
Registered: September 2005
Location: Moscow
Senior Member

does increasing othersockbuf parameter for the VE helps?


http://static.openvz.org/userbars/openvz-developer.png
Re: rsync problem [message #8244 is a reply to message #8196] Sat, 11 November 2006 12:57 Go to previous messageGo to next message
till is currently offline  till
Messages: 5
Registered: November 2006
Junior Member

Hello,
thanks for your answer!

It does not help. It would be very stange if it would help. The one virtual machine works great with the same settings and does not stop after ~100 mb.

What could I do?
Re: rsync problem [message #8273 is a reply to message #8244] Mon, 13 November 2006 09:37 Go to previous message
dev is currently offline  dev
Messages: 1693
Registered: September 2005
Location: Moscow
Senior Member

strace -f -tt -v -o out <your command>
attach out file here.


http://static.openvz.org/userbars/openvz-developer.png
Previous Topic: *SOLVED* Newbie questions about traffic throttling and control panel
Next Topic: *SOLVED* optimization on privvmpages failcnt
Goto Forum:
  


Current Time: Mon Sep 09 09:47:08 GMT 2024

Total time taken to generate the page: 0.04533 seconds