OpenVZ Forum


Home » General » Support » Is ploop stable/Any progress on quotas for simfs
Is ploop stable/Any progress on quotas for simfs [message #53588] Tue, 15 October 2019 23:12 Go to next message
seanfulton is currently offline  seanfulton
Messages: 102
Registered: May 2007
Senior Member
From: *mobile.att.net
When ploop first came out we used it from lost many, many containers to corrupt ploop filesystems. We went back to simfs. Now looking at upgrading some nodes to OpenVZ 7 and it looks like ploop is the only way to get quotas for containers.

So for those who have upgraded, how stable is it?

Is there any progress on first-level quotas for SIMFS???
Re: Is ploop stable/Any progress on quotas for simfs [message #53590 is a reply to message #53588] Wed, 23 October 2019 12:19 Go to previous messageGo to next message
ccto is currently offline  ccto
Messages: 56
Registered: October 2005
Member
From: 180.92.180*
We have servers running with both OpenVZ 6, OpenVZ 7. Gradually migrating to OpenVZ 7 platform

We use ploop, snapshot (for backup), compact. ploop is OK.
We do not receive report about loss of files.

simfs inside OpenVZ 7 does not support 2nd level quota.
If guest is CentOS 5, ploop does not support 2nd level quota too in OpenVZ 7 host.
Re: Is ploop stable/Any progress on quotas for simfs [message #53591 is a reply to message #53590] Wed, 23 October 2019 19:41 Go to previous messageGo to next message
seanfulton is currently offline  seanfulton
Messages: 102
Registered: May 2007
Senior Member
From: *mobile.att.net
This is very helpful, thank you. I have not been able to get SIMFS containers to have a container quota, I thought that was a first-level quota. It says it's supported, but when I create a VE in SIMFS and enter it, df shows the whole filesystem, not just the little slice (like it used to in OpenVZ 6). Is that normal?
Re: Is ploop stable/Any progress on quotas for simfs [message #53593 is a reply to message #53588] Sun, 17 November 2019 19:07 Go to previous messageGo to next message
websavers is currently offline  websavers
Messages: 30
Registered: March 2018
Location: Halifax, NS
Member
From: *dhcp-dynamic.fibreop.ns.bellaliant.net
We've also been using OpenVZ 7 with ploop (transferred most containers from OpenVZ6 SIMFS) for about 2 years now. We were a bit hesitant to use ploop because of those past reports on these forums about recovery and such, however there hasn't yet been a single data consistency problem that the virtuozzo subsystem hasn't auto-repaired for us upon boot of the container. Granted we use RAID 5 and have replaced multiple disks with full parity recovery by the RAID controller and not a single problem with booting containers yet. Fingers' crossed that remains true.

Upsides: because ploop containers are singular image files on the node, migrating containers has never been faster (full network bandwidth), which is a huge upside. Quota works great within the containers as well.

The biggest downsides of ploop over SIMFS are:

1. BACKUPS (A) If you want quick restore from backup capability, your backup script needs to snapshot, (to create a disk not currently locked) and you need to sacrifice incremental backups and compression, thus backups take up a huge amount of space. (B) If you want file-by-file compressable, dedupable, incremental backups (like using borg backup) that can be used to restore an entire container / node then you need to ensure that your restore script acommodates for container (and ploop) creation, mount it, and then restore the data (This is preferred by far if you ask me, for backup storage costs alone, but takes much more work to implement).
2. There's a fair amount of storage overhead used by ploop, even with its nightly compact system running. On a node with 1.7TB total usable storage, where 90% of it is used by around 20 ploop containers, about 10% of that 90% is overhead -- that makes for around 150GB- 200GB of wasted space. I've analyzed a number of different nodes and they all have similar overhead. I don't expect zero overhead from such a system, but I would definitely like to see that down to less than 5%.

The backup thing isn't *that* big of a deal, but it's definitely a bit more involved than SIMFS where you simply create the container and pop your files in place.
Re: Is ploop stable/Any progress on quotas for simfs [message #53594 is a reply to message #53588] Mon, 18 November 2019 02:30 Go to previous messageGo to next message
ccto is currently offline  ccto
Messages: 56
Registered: October 2005
Member
From: 180.92.180*
1. You may mount the ploop snapshot to some mountpount (e.g.) /mnt, and make the incremental file-based backup of that mountpoint. Then, you can restore it file by file.

2. Yes, from our experience, ploop contains overhead (yes, around 10%).
There is a pcompact tools, which somehow compact the ploop file automatically upon certain threshold.

Comparing to other, like KVM qcow2, there are also some storage overhead too.

From my personal experience, if you have a number of containers, each container contains a number of files, ploop performs faster than simfs over time.
Re: Is ploop stable/Any progress on quotas for simfs [message #53595 is a reply to message #53594] Mon, 18 November 2019 14:05 Go to previous message
websavers is currently offline  websavers
Messages: 30
Registered: March 2018
Location: Halifax, NS
Member
From: *dhcp-dynamic.fibreop.ns.bellaliant.net
ccto wrote on Sun, 17 November 2019 22:30
1. You may mount the ploop snapshot to some mountpount (e.g.) /mnt, and make the incremental file-based backup of that mountpoint. Then, you can restore it file by file.


Indeed! That's what we do. Just pointing out that it's more involved than SIMFS

ccto wrote on Sun, 17 November 2019 22:30
Comparing to other, like KVM qcow2, there are also some storage overhead too.


For sure, but this is a comparison with SIMFS -- just making it clear what kinds of differences can be expected. I think the benefits outweigh the downsides, but that might not be the case for everyone.

ccto wrote on Sun, 17 November 2019 22:30
From my personal experience, if you have a number of containers, each container contains a number of files, ploop performs faster than simfs over time.


That may be the case; I haven't done a direct comparison on the same hardware to know for sure. One thing we can be sure of is that it's definitely more performant migrating ploop containers as it doesn't need to xfer file by file.
Previous Topic: How to disable libvirtd
Next Topic: Bug reports should go to bugs.openvz.org
Goto Forum:
  


Current Time: Wed Nov 20 22:00:42 GMT 2019