OpenVZ Forum: Devel » [RFC][PATCH] UBC: user resource beancounters

Home » Mailing lists » Devel » [RFC][PATCH] UBC: user resource beancounters

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

[RFC][PATCH] UBC: user resource beancounters [message #5192]

Wed, 16 August 2006 15:23

dev
Messages: 1693
Registered: September 2005
Location: Moscow

Senior Member

The following patch set presents base of
User Resource Beancounters (UBC).
UBC allows to account and control consumption
of kernel resources used by group of processes.

The full UBC patch set allows to control:
- kernel memory. All the kernel objects allocatable
on user demand should be accounted and limited
for DoS protection.
E.g. page tables, task structs, vmas etc.

- virtual memory pages. UBC allows to
limit a container to some amount of memory and
introduces 2-level OOM killer taking into account
container's consumption.
pages shared between containers are correctly
charged as fractions (tunable).

- network buffers. These includes TCP/IP rcv/snd
buffers, dgram snd buffers, unix, netlinks and
other buffers.

- minor resources accounted/limited by number:
tasks, files, flocks, ptys, siginfo, pinned dcache
mem, sockets, iptentries (for containers with
virtualized networking)

As the first step we want to propose for discussion
the most complicated parts of resource management:
kernel memory and virtual memory.
The patch set to be sent provides core for UBC and
management of kernel memory only. Virtual memory
management will be sent in a couple of days.

The patches in these series are:
diff-ubc-kconfig.patch:
Adds kernel/ub/Kconfig file with UBC options and
includes it into arch Kconfigs

diff-ubc-core.patch:
Contains core functionality and interfaces of UBC:
find/create beancounter, initialization,
charge/uncharge of resource, core objects' declarations.

diff-ubc-task.patch:
Contains code responsible for setting UB on task,
it's inheriting and setting host context in interrupts.

Task contains three beancounters:
1. exec_ub - current context. all resources are charged
to this beancounter.
2. task_ub - beancounter to which task_struct is charged
itself.
3. fork_sub - beancounter which is inherited by
task's children on fork

diff-ubc-syscalls.patch:
Patch adds system calls for UB management:
1. sys_getluid - get current UB id
2. sys_setluid - changes exec_ and fork_ UBs on current
3. sys_setublimit - set limits for resources consumtions

diff-ubc-kmem-core.patch:
Introduces UB_KMEMSIZE resource which accounts kernel
objects allocated by task's request.

Objects are accounted via struct page and slab objects.
For the latter ones each slab contains a set of pointers
corresponding object is charged to.

Allocation charge rules:
1. Pages - if allocation is performed with __GFP_UBC flag - page
is charged to current's exec_ub.
2. Slabs - kmem_cache may be created with SLAB_UBC flag - in this
case each allocation is charged. Caches used by kmalloc are
created with SLAB_UBC | SLAB_UBC_NOCHARGE flags. In this case
only __GFP_UBC allocations are charged.

diff-ubc-kmem-charge.patch:
Adds SLAB_UBC and __GFP_UBC flags in appropriate places
to cause charging/limiting of specified resources.

diff-ubc-proc.patch:
Adds two proc entries user_beancounters and user_beancounters_sub
allowing to see current state (usage/limits/fails for each UB).
Implemented via seq files.

Patch set is applicable to 2.6.18-rc4-mm1

Thanks,
Kirill

Report message to a moderator

[Message index]

		[RFC][PATCH] UBC: user resource beancounters By: dev on Wed, 16 August 2006 15:23
		[RFC][PATCH 1/7] UBC: kconfig By: dev on Wed, 16 August 2006 15:34
		Re: [ckrm-tech] [RFC][PATCH 1/7] UBC: kconfig By: Chandra Seetharaman on Fri, 18 August 2006 19:57
		Re: [RFC][PATCH 1/7] UBC: kconfig By: Adrian Bunk on Fri, 18 August 2006 21:14
		Re: [RFC][PATCH 1/7] UBC: kconfig By: Pavel Machek on Fri, 25 August 2006 15:12
		[RFC][PATCH 2/7] UBC: core (structures, API) By: dev on Wed, 16 August 2006 15:35
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: Alan Cox on Wed, 16 August 2006 16:38
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: dev on Thu, 17 August 2006 11:40
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: Andrew Morton on Wed, 16 August 2006 18:18
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: dev on Thu, 17 August 2006 11:52
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: Greg KH on Wed, 16 August 2006 17:15
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: dev on Thu, 17 August 2006 11:43
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: Greg KH on Thu, 17 August 2006 12:14
		Re: [ckrm-tech] [RFC][PATCH 2/7] UBC: core (structures, API) By: Dave Hansen on Thu, 17 August 2006 14:32
		Re: [ckrm-tech] [RFC][PATCH 2/7] UBC: core (structures, API) By: dev on Fri, 18 August 2006 12:34
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: Rohit Seth on Wed, 16 August 2006 18:11
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: dev on Thu, 17 August 2006 11:52
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: Rohit Seth on Thu, 17 August 2006 16:55
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: dev on Fri, 18 August 2006 11:13
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: Rohit Seth on Fri, 18 August 2006 17:51
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: Andrew Morton on Fri, 18 August 2006 05:31
		Re: [PATCH 2/7] UBC: core (structures, API) By: Andrey Savochkin on Fri, 18 August 2006 07:35
		Re: [ckrm-tech] [PATCH 2/7] UBC: core (structures, API) By: Matt Helsley on Fri, 18 August 2006 08:26
		Re: [ckrm-tech] [PATCH 2/7] UBC: core (structures, API) By: dev on Fri, 18 August 2006 11:50
		Re: [RFC][PATCH 2/7] UBC: core (structures, API) By: Alan Cox on Fri, 18 August 2006 15:39
		Re: [ckrm-tech] [RFC][PATCH 2/7] UBC: core (structures, API) By: Srivatsa Vaddagiri on Thu, 17 August 2006 11:09
		Re: [ckrm-tech] [RFC][PATCH 2/7] UBC: core (structures, API) By: dev on Thu, 17 August 2006 14:00
		Re: [ckrm-tech] [RFC][PATCH 2/7] UBC: core (structures, API) By: Chandra Seetharaman on Thu, 17 August 2006 18:59
		Re: [ckrm-tech] [RFC][PATCH 2/7] UBC: core (structures, API) By: Matt Helsley on Fri, 18 August 2006 01:58
		Re: [ckrm-tech] [RFC][PATCH 2/7] UBC: core (structures, API) By: Balbir Singh on Sun, 20 August 2006 05:01
		Re: [ckrm-tech] [RFC][PATCH 2/7] UBC: core (structures, API) By: Balbir Singh on Sun, 20 August 2006 04:58
		[RFC][PATCH 3/7] UBC: ub context and inheritance By: dev on Wed, 16 August 2006 15:36
		Re: [RFC][PATCH 3/7] UBC: ub context and inheritance By: Alan Cox on Wed, 16 August 2006 16:31
		Re: [ckrm-tech] [RFC][PATCH 3/7] UBC: ub context and inheritance By: Srivatsa Vaddagiri on Thu, 17 August 2006 11:09
		Re: Re: [ckrm-tech] [RFC][PATCH 3/7] UBC: ub context and inheritance By: xemul on Thu, 17 August 2006 13:21
		Re: [ckrm-tech] [RFC][PATCH 3/7] UBC: ub context and inheritance By: Matt Helsley on Fri, 18 August 2006 02:42
		Re: [ckrm-tech] [RFC][PATCH 3/7] UBC: ub context and inheritance By: dev on Fri, 18 August 2006 09:21
		Re: [ckrm-tech] [RFC][PATCH 3/7] UBC: ub context and inheritance By: Matt Helsley on Sat, 19 August 2006 02:19
		Re: [ckrm-tech] [RFC][PATCH 3/7] UBC: ub context and inheritance By: Chandra Seetharaman on Fri, 18 August 2006 20:03
		Re: [ckrm-tech] [RFC][PATCH 3/7] UBC: ub context and inheritance By: dev on Mon, 21 August 2006 10:30
		Re: [ckrm-tech] [RFC][PATCH 3/7] UBC: ub context and inheritance By: Chandra Seetharaman on Mon, 21 August 2006 20:48
		[RFC][PATCH 4/7] UBC: syscalls (user interface) By: dev on Wed, 16 August 2006 15:37
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Alan Cox on Wed, 16 August 2006 16:32
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Alan Cox on Wed, 16 August 2006 18:44
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Rohit Seth on Wed, 16 August 2006 19:22
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: dev on Thu, 17 August 2006 12:11
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Andrew Morton on Thu, 17 August 2006 15:40
		Re: [PATCH 4/7] UBC: syscalls (user interface) By: Andrey Savochkin on Fri, 18 August 2006 08:08
		Re: [ckrm-tech] [PATCH 4/7] UBC: syscalls (user interface) By: Dave Hansen on Fri, 18 August 2006 14:45
		Re: [ckrm-tech] [PATCH 4/7] UBC: syscalls (user interface) By: Magnus Damm on Mon, 21 August 2006 02:47
		Re: [ckrm-tech] [PATCH 4/7] UBC: syscalls (user interface) By: Rohit Seth on Tue, 22 August 2006 01:16
		Re: [ckrm-tech] [PATCH 4/7] UBC: syscalls (user interface) By: Magnus Damm on Tue, 22 August 2006 03:58
		Re: [ckrm-tech] [PATCH 4/7] UBC: syscalls (user interface) By: Chandra Seetharaman on Tue, 22 August 2006 18:34
		Re: [ckrm-tech] [PATCH 4/7] UBC: syscalls (user interface) By: Rohit Seth on Thu, 24 August 2006 01:20
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: dev on Fri, 18 August 2006 11:03
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Rohit Seth on Thu, 17 August 2006 17:08
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Greg KH on Wed, 16 August 2006 17:17
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: dev on Thu, 17 August 2006 12:00
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Rohit Seth on Wed, 16 August 2006 18:17
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: dev on Thu, 17 August 2006 12:03
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Rohit Seth on Thu, 17 August 2006 17:05
		Re: [ckrm-tech] [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Srivatsa Vaddagiri on Thu, 17 August 2006 11:09
		Re: [ckrm-tech] [RFC][PATCH 4/7] UBC: syscalls (user interface) By: dev on Thu, 17 August 2006 14:03
		Re: [ckrm-tech] [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Srivatsa Vaddagiri on Thu, 17 August 2006 16:19
		Re: [ckrm-tech] [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Matt Helsley on Fri, 18 August 2006 02:31
		Re: [ckrm-tech] [RFC][PATCH 4/7] UBC: syscalls (user interface) By: dev on Fri, 18 August 2006 11:43
		Re: [ckrm-tech] [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Matt Helsley on Sat, 19 August 2006 02:43
		Re: [ckrm-tech] [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Chandra Seetharaman on Fri, 18 August 2006 20:13
		Re: [RFC][PATCH 4/7] UBC: syscalls (user interface) By: Arnd Bergmann on Fri, 18 August 2006 11:40
		[RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Wed, 16 August 2006 15:39
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Alan Cox on Wed, 16 August 2006 16:35
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Thu, 17 August 2006 13:45
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Dave Hansen on Wed, 16 August 2006 18:47
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Rohit Seth on Wed, 16 August 2006 19:15
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Alan Cox on Thu, 17 August 2006 00:02
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Rohit Seth on Thu, 17 August 2006 16:36
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Fri, 18 August 2006 08:43
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Thu, 17 August 2006 13:33
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Rohit Seth on Thu, 17 August 2006 17:13
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Fri, 18 August 2006 08:47
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Thu, 17 August 2006 13:29
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Dave Hansen on Thu, 17 August 2006 14:36
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Fri, 18 August 2006 08:12
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Dave Hansen on Fri, 18 August 2006 14:43
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Mon, 21 August 2006 08:56
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Rohit Seth on Wed, 16 August 2006 18:24
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Thu, 17 August 2006 13:25
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Dave Hansen on Thu, 17 August 2006 14:38
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Fri, 18 August 2006 09:29
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Dave Hansen on Fri, 18 August 2006 14:58
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Mon, 21 August 2006 10:38
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Dave Hansen on Mon, 21 August 2006 15:10
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Dave Hansen on Fri, 18 August 2006 15:06
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Mon, 21 August 2006 12:36
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Rohit Seth on Thu, 17 August 2006 17:02
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Fri, 18 August 2006 09:36
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Rohit Seth on Fri, 18 August 2006 16:55
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Mon, 21 August 2006 10:41
		Re: [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Rohit Seth on Tue, 22 August 2006 01:23
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Chandra Seetharaman on Fri, 18 August 2006 20:26
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: dev on Mon, 21 August 2006 10:48
		Re: [ckrm-tech] [RFC][PATCH 5/7] UBC: kernel memory accounting (core) By: Chandra Seetharaman on Mon, 21 August 2006 20:55
		[RFC][PATCH 6/7] UBC: kernel memory acconting (mark objects) By: dev on Wed, 16 August 2006 15:40
		Re: [RFC][PATCH 6/7] UBC: kernel memory acconting (mark objects) By: Alan Cox on Wed, 16 August 2006 16:36
		[RFC][PATCH 7/7] UBC: proc interface By: dev on Wed, 16 August 2006 15:42
		Re: [RFC][PATCH 7/7] UBC: proc interface By: Greg KH on Wed, 16 August 2006 17:13
		Re: [RFC][PATCH 7/7] UBC: proc interface By: dev on Thu, 17 August 2006 13:41
		Re: [RFC][PATCH 7/7] UBC: proc interface By: Greg KH on Thu, 17 August 2006 15:40
		Re: Re: [RFC][PATCH 7/7] UBC: proc interface By: kir on Thu, 17 August 2006 16:12
		Re: [RFC][PATCH] UBC: user resource beancounters By: Alan Cox on Wed, 16 August 2006 19:06
		Re: [RFC][PATCH] UBC: user resource beancounters By: Rohit Seth on Wed, 16 August 2006 18:53
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Thu, 17 August 2006 00:15
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Srivatsa Vaddagiri on Thu, 17 August 2006 11:02
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: dev on Thu, 17 August 2006 13:53
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Thu, 17 August 2006 19:55
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Fri, 18 August 2006 19:39
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: dev on Mon, 21 August 2006 13:21
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Mon, 21 August 2006 21:45
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Alan Cox on Mon, 21 August 2006 22:01
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Mon, 21 August 2006 22:44
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Rohit Seth on Tue, 22 August 2006 01:45
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Alan Cox on Tue, 22 August 2006 09:42
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Arjan van de Ven on Tue, 22 August 2006 09:57
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Alan Cox on Tue, 22 August 2006 10:54
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Rohit Seth on Thu, 24 August 2006 01:31
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Tue, 22 August 2006 18:55
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Rohit Seth on Thu, 24 August 2006 01:44
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Thu, 24 August 2006 02:04
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Alan Cox on Thu, 24 August 2006 10:49
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Thu, 24 August 2006 23:48
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Kyle Moffett on Thu, 24 August 2006 23:55
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Fri, 25 August 2006 18:21
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Alan Cox on Fri, 25 August 2006 20:25
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Fri, 25 August 2006 21:37
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Alan Cox on Fri, 25 August 2006 22:30
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Fri, 25 August 2006 22:59
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Rohit Seth on Thu, 24 August 2006 17:27
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Thu, 24 August 2006 23:52
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: dev on Fri, 25 August 2006 11:10
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Fri, 25 August 2006 18:47
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Alan Cox on Fri, 25 August 2006 20:32
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Fri, 25 August 2006 22:23
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Alan Cox on Fri, 25 August 2006 22:51
		Re: [ckrm-tech] [RFC][PATCH] UBC: user resource beancounters By: Chandra Seetharaman on Fri, 25 August 2006 23:00

Previous Topic:	[PATCH] vzlist: Fix "cast from pointer to integer of different size" warnings
Next Topic:	[RFC][PATCH 1/2] add user namespace [try #2]

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Sat Nov 09 01:27:30 GMT 2024

Total time taken to generate the page: 0.05137 seconds