OpenVZ Forum: Devel » [RFC][PATCH] UBC: user resource beancounters

Home » Mailing lists » Devel » [RFC][PATCH] UBC: user resource beancounters

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: [PATCH 4/7] UBC: syscalls (user interface) [message #5357 is a reply to message #5317]

Fri, 18 August 2006 08:08

Andrey Savochkin
Messages: 47
Registered: December 2005

Member

Hi,

On Thu, Aug 17, 2006 at 08:40:33AM -0700, Andrew Morton wrote:
> On Thu, 17 Aug 2006 16:13:30 +0400
> Kirill Korotaev <dev@sw.ru> wrote:
>
> > > I was more thinking about (for example) user land physical memory limit
> > > for that bean counter. If the limits are going down, then the system
> > > call should try to flush out page cache pages or swap out anonymous
> > > memory. But you are right that it won't be possible in all cases, like
> > > for in kernel memory limits.
> > Such kind of memory management is less efficient than the one
> > making decisions based on global shortages and global LRU alogrithm.
>
> I also was quite surprised that openvz appears to have no way of
> constraining a container's memory usage. "I want to run this bunch of
> processes in a 4.5GB container".

I'd like to share my view on the subject of memory usage limiting.

The task of limiting a container to 4.5GB of memory bottles down to the
question: what to do when the container starts to use more than assigned
4.5GB of memory?

At this moment there are only 3 viable alternatives.

A) Have separate memory management for each container,
with separate buddy allocator, lru lists, page replacement mechanism.
That implies a considerable overhead, and the main challenge there
is sharing of pages between these separate memory managers.

B) Return errors on extension of mappings, but not on page faults, where
memory is actually consumed.
In this case it makes sense to take into account not only the size of used
memory, but the size of created mappings as well.
This is approximately what "privvmpages" accounting/limiting provides in
UBC.

C) Rely on OOM killer.
This is a fall-back method in UBC, for the case "privvmpages" limits
still leave the possibility to overload the system.

It would be nice, indeed, to invent something new.
The ideal mechanism would
- slow down the container over-using memory, to signal the user that
he is over his limits,
- at the same time this slowdown shouldn't lead to the increase of memory
usage: for example, a simple slowdown of apache web server would lead
to the growth of the number of serving children and consumption of more
memory while showing worse performance,
- and, at the same time, it shouldn't penalize the rest of the system from
the performance point of view...
May be this can be achieved via carefully tuned swapout mechanism together
with disk bandwidth management capable of tracking asynchronous write
requests, may be something else is required.
It's really a big challenge.

Meanwhile, I guess we can only make small steps in improving Linux resource
management features for this moment.

Best regards

Andrey

Report message to a moderator

[Message index]

		[RFC][PATCH] UBC: user resource beancounters By: dev on Wed, 16 August 2006 15:23
		[RFC][PATCH 1/7] UBC: kconfig By: dev on Wed, 16 August 2006 15:34
		Re: [ckrm-tech] [RFC][PATCH 1/7] UBC: kconfig By: Chandra Seetharaman on Fri, 18 August 2006 19:57
		Re: [RFC][PATCH 1/7] UBC: kconfig By: Adrian Bunk on Fri, 18 August 2006 21:14
		Re: [RFC][PATCH 1/7] UBC: kconfig By: Pavel Machek on Fri, 25 August 2006 15:12
		[RFC][PATCH 2/7] UBC: core (structures, API) By: dev on Wed, 16 August 2006 15:35
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: Alan Cox on Wed, 16 August 2006 16:38
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: dev on Thu, 17 August 2006 11:40
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: Andrew Morton on Wed, 16 August 2006 18:18
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: dev on Thu, 17 August 2006 11:52
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: Greg KH on Wed, 16 August 2006 17:15
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: dev on Thu, 17 August 2006 11:43
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: Greg KH on Thu, 17 August 2006 12:14
		Re: [ckrm-tech] [RFC][PATCH 2/7] UBC: core (structures, API) By: Dave Hansen on Thu, 17 August 2006 14:32
		Re: [ckrm-tech] [RFC][PATCH 2/7] UBC: core (structures, API) By: dev on Fri, 18 August 2006 12:34
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: Rohit Seth on Wed, 16 August 2006 18:11
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: dev on Thu, 17 August 2006 11:52
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: Rohit Seth on Thu, 17 August 2006 16:55
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: dev on Fri, 18 August 2006 11:13
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: Rohit Seth on Fri, 18 August 2006 17:51
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: Andrew Morton on Fri, 18 August 2006 05:31
		Re: [PATCH 2/7] UBC: core (structures, API) By: Andrey Savochkin on Fri, 18 August 2006 07:35
		Re: [ckrm-tech] [PATCH 2/7] UBC: core (structures, API) By: Matt Helsley on Fri, 18 August 2006 08:26
		Re: [ckrm-tech] [PATCH 2/7] UBC: core (structures, API) By: dev on Fri, 18 August 2006 11:50
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: Alan Cox on Fri, 18 August 2006 15:39
		Re: [ckrm-tech] [RFC][PATCH 2/7] UBC: core (structures, API) By: Srivatsa Vaddagiri on Thu, 17 August 2006 11:09
		Re: [ckrm-tech] [RFC][PATCH 2/7] UBC: core (structures, API) By: dev on Thu, 17 August 2006 14:00
		Re: [ckrm-tech] [RFC][PATCH 2/7] UBC: core (structures, API) By: Chandra Seetharaman on Thu, 17 August 2006 18:59
		Re: [ckrm-tech] [RFC][PATCH 2/7] UBC: core (structures, API) By: Matt Helsley on Fri, 18 August 2006 01:58
		Re: [ckrm-tech] [RFC][PATCH 2/7] UBC: core (structures, API) By: Balbir Singh on Sun, 20 August 2006 05:01
		Re: [ckrm-tech] [RFC][PATCH 2/7] UBC: core (structures, API) By: Balbir Singh on Sun, 20 August 2006 04:58
		[RFC][PATCH 3/7] UBC: ub context and inheritance By: dev on Wed, 16 August 2006 15:36
		Re: [RFC][PATCH 3/7] UBC: ub context and inheritance By: Alan Cox on Wed, 16 August 2006 16:31
		Re: [ckrm-tech] [RFC][PATCH 3/7] UBC: ub context and inheritance By: Srivatsa Vaddagiri on Thu, 17 August 2006 11:09
		Re: Re: [ckrm-tech] [RFC][PATCH 3/7] UBC: ub context and inheritance By: xemul on Thu, 17 August 2006 13:21
		Re: [ckrm-tech] [RFC][PATCH 3/7] UBC: ub context and inheritance By: Matt Helsley on Fri, 18 August 2006 02:42
		Re: [ckrm-tech] [RFC][PATCH 3/7] UBC: ub context and inheritance By: dev on Fri, 18 August 2006 09:21
		Re: [ckrm-tech] [RFC][PATCH 3/7] UBC: ub context and inheritance By: Matt Helsley on Sat, 19 August 2006 02:19
		Re: [ckrm-tech] [RFC][PATCH 3/7] UBC: ub context and inheritance By: Chandra Seetharaman on Fri, 18 August 2006 20:03
		Re: [ckrm-tech] [RFC][PATCH 3/7] UBC: ub context and inheritance By: dev on Mon, 21 August 2006 10:30
		Re: [ckrm-tech] [RFC][PATCH 3/7] UBC: ub context and inheritance By: Chandra Seetharaman on Mon, 21 August 2006 20:48
		[RFC][PATCH 4/7] UBC: syscalls (user interface) By: dev on Wed, 16 August 2006 15:37
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Alan Cox on Wed, 16 August 2006 16:32
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Alan Cox on Wed, 16 August 2006 18:44
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Rohit Seth on Wed, 16 August 2006 19:22
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: dev on Thu, 17 August 2006 12:11
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Andrew Morton on Thu, 17 August 2006 15:40
		Re: [PATCH 4/7] UBC: syscalls (user interface) By: Andrey Savochkin on Fri, 18 August 2006 08:08
		Re: [ckrm-tech] [PATCH 4/7] UBC: syscalls (user interface) By: Dave Hansen on Fri, 18 August 2006 14:45
		Re: [ckrm-tech] [PATCH 4/7] UBC: syscalls (user interface) By: Magnus Damm on Mon, 21 August 2006 02:47
		Re: [ckrm-tech] [PATCH 4/7] UBC: syscalls (user interface) By: Rohit Seth on Tue, 22 August 2006 01:16
		Re: [ckrm-tech] [PATCH 4/7] UBC: syscalls (user interface) By: Magnus Damm on Tue, 22 August 2006 03:58
		Re: [ckrm-tech] [PATCH 4/7] UBC: syscalls (user interface) By: Chandra Seetharaman on Tue, 22 August 2006 18:34
		Re: [ckrm-tech] [PATCH 4/7] UBC: syscalls (user interface) By: Rohit Seth on Thu, 24 August 2006 01:20
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: dev on Fri, 18 August 2006 11:03
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Rohit Seth on Thu, 17 August 2006 17:08
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Greg KH on Wed, 16 August 2006 17:17
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: dev on Thu, 17 August 2006 12:00
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Rohit Seth on Wed, 16 August 2006 18:17
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: dev on Thu, 17 August 2006 12:03
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Rohit Seth on Thu, 17 August 2006 17:05
		Re: [ckrm-tech] [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Srivatsa Vaddagiri on Thu, 17 August 2006 11:09
		Re: [ckrm-tech] [RFC][PATCH 4/7] UBC: syscalls (user interface) By: dev on Thu, 17 August 2006 14:03
		Re: [ckrm-tech] [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Srivatsa Vaddagiri on Thu, 17 August 2006 16:19
		Re: [ckrm-tech] [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Matt Helsley on Fri, 18 August 2006 02:31
		Re: [ckrm-tech] [RFC][PATCH 4/7] UBC: syscalls (user interface) By: dev on Fri, 18 August 2006 11:43
		Re: [ckrm-tech] [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Matt Helsley on Sat, 19 August 2006 02:43
		Re: [ckrm-tech] [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Chandra Seetharaman on Fri, 18 August 2006 20:13
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Arnd Bergmann on Fri, 18 August 2006 11:40
		[RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Wed, 16 August 2006 15:39
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Alan Cox on Wed, 16 August 2006 16:35
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Thu, 17 August 2006 13:45
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Dave Hansen on Wed, 16 August 2006 18:47
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Rohit Seth on Wed, 16 August 2006 19:15
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Alan Cox on Thu, 17 August 2006 00:02
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Rohit Seth on Thu, 17 August 2006 16:36
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Fri, 18 August 2006 08:43
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Thu, 17 August 2006 13:33
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Rohit Seth on Thu, 17 August 2006 17:13
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Fri, 18 August 2006 08:47
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Thu, 17 August 2006 13:29
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Dave Hansen on Thu, 17 August 2006 14:36
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Fri, 18 August 2006 08:12
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Dave Hansen on Fri, 18 August 2006 14:43
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Mon, 21 August 2006 08:56
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Rohit Seth on Wed, 16 August 2006 18:24
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Thu, 17 August 2006 13:25
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Dave Hansen on Thu, 17 August 2006 14:38
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Fri, 18 August 2006 09:29
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Dave Hansen on Fri, 18 August 2006 14:58
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Mon, 21 August 2006 10:38
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Dave Hansen on Mon, 21 August 2006 15:10
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Dave Hansen on Fri, 18 August 2006 15:06
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Mon, 21 August 2006 12:36
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Rohit Seth on Thu, 17 August 2006 17:02
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Fri, 18 August 2006 09:36
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Rohit Seth on Fri, 18 August 2006 16:55
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Mon, 21 August 2006 10:41
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Rohit Seth on Tue, 22 August 2006 01:23
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Chandra Seetharaman on Fri, 18 August 2006 20:26
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Mon, 21 August 2006 10:48
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Chandra Seetharaman on Mon, 21 August 2006 20:55
		[RFC][PATCH 6/7] UBC: kernel memory acconting (mark objects) By: dev on Wed, 16 August 2006 15:40
		Re: [RFC][PATCH 6/7] UBC: kernel memory acconting (mark objects) By: Alan Cox on Wed, 16 August 2006 16:36
		[RFC][PATCH 7/7] UBC: proc interface By: dev on Wed, 16 August 2006 15:42
		Re: [RFC][PATCH 7/7] UBC: proc interface By: Greg KH on Wed, 16 August 2006 17:13
		Re: [RFC][PATCH 7/7] UBC: proc interface By: dev on Thu, 17 August 2006 13:41
		Re: [RFC][PATCH 7/7] UBC: proc interface By: Greg KH on Thu, 17 August 2006 15:40
		Re: Re: [RFC][PATCH 7/7] UBC: proc interface By: kir on Thu, 17 August 2006 16:12
		Re: [RFC][PATCH] UBC: user resource beancounters By: Alan Cox on Wed, 16 August 2006 19:06
		Re: [RFC][PATCH] UBC: user resource beancounters By: Rohit Seth on Wed, 16 August 2006 18:53
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Thu, 17 August 2006 00:15
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Srivatsa Vaddagiri on Thu, 17 August 2006 11:02
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: dev on Thu, 17 August 2006 13:53
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Thu, 17 August 2006 19:55
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Fri, 18 August 2006 19:39
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: dev on Mon, 21 August 2006 13:21
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Mon, 21 August 2006 21:45
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Alan Cox on Mon, 21 August 2006 22:01
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Mon, 21 August 2006 22:44
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Rohit Seth on Tue, 22 August 2006 01:45
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Alan Cox on Tue, 22 August 2006 09:42
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Arjan van de Ven on Tue, 22 August 2006 09:57
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Alan Cox on Tue, 22 August 2006 10:54
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Rohit Seth on Thu, 24 August 2006 01:31
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Tue, 22 August 2006 18:55
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Rohit Seth on Thu, 24 August 2006 01:44
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Thu, 24 August 2006 02:04
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Alan Cox on Thu, 24 August 2006 10:49
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Thu, 24 August 2006 23:48
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Kyle Moffett on Thu, 24 August 2006 23:55
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Fri, 25 August 2006 18:21
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Alan Cox on Fri, 25 August 2006 20:25
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Fri, 25 August 2006 21:37
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Alan Cox on Fri, 25 August 2006 22:30
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Fri, 25 August 2006 22:59
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Rohit Seth on Thu, 24 August 2006 17:27
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Thu, 24 August 2006 23:52
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: dev on Fri, 25 August 2006 11:10
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Fri, 25 August 2006 18:47
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Alan Cox on Fri, 25 August 2006 20:32
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Fri, 25 August 2006 22:23
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Alan Cox on Fri, 25 August 2006 22:51
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Fri, 25 August 2006 23:00

Previous Topic:	[PATCH] vzlist: Fix "cast from pointer to integer of different size" warnings
Next Topic:	[RFC][PATCH 1/2] add user namespace [try #2]

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Tue Nov 12 19:45:15 GMT 2024

Total time taken to generate the page: 0.03383 seconds