OpenVZ Forum: Devel » BC: resource beancounters (v6) (with userpages reclamation + configfs)

Home » Mailing lists » Devel » BC: resource beancounters (v6) (with userpages reclamation + configfs)

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

BC: resource beancounters (v6) (with userpages reclamation + configfs) [message #8159]

Thu, 09 November 2006 16:42

dev
Messages: 1693
Registered: September 2005
Location: Moscow

Senior Member

MAJOR CHANGES in v6 (see details below):
- configfs interface instead of syscalls (as wanted by CKRM people...)
- added numfiles resource accounting
- added numtasks resource accounting

numfiles and numtasks controllers demonstrate how
clean and simple BC interface is.

Patch set is applicable to 2.6.19-rc5-mm1

-----------------------------------------------------

Resource BeanCounters (BC).

BC allows to account and control consumption
of kernel resources used by *group* of processes
(users, containers, ...).

Draft BC description on OpenVZ wiki can be found at
http://wiki.openvz.org/UBC_parameters

The full BC patch set allows to control:
- kernel memory. All the kernel objects allocatable
on user demand and not reclaimable should be accounted and
limited for DoS protection.
e.g. page tables, task structs, vmas etc.

- virtual memory pages. BCs allow to
limit a container to some amount of memory and
introduces 2-level OOM killer taking into account
container's consumption.
pages shared between containers are correctly
charged as fractions (tunable).

- network buffers. These includes TCP/IP rcv/snd
buffers, dgram snd buffers, unix, netlinks and
other buffers.

- minor resources accounted/limited by number:
tasks, files, flocks, ptys, siginfo, pinned dcache
mem, sockets, iptentries (for containers with
virtualized networking)

Summary of changes from v5 patch set:
* configfs interface instead of syscalls (as wanted by CKRM people)
* added numfiles resource accounting
* added numtasks resource accounting
* introduced dummy_resource to handle case when
no resource registered
* calls to rss accounting are integrated to rmap calls

Summary of changes from v4 patch set:
* changed set of resources - kmemsize, privvmpages, physpages
* added event hooks for resources (init, limit hit etc)
* added user pages reclamation (bc_try_to_free_pages)
* removed pages sharing accounting - charge to first user
* task now carries only one BC pointer, simplified
* make set_bcid syscall move arbitrary task into BC
* resources are not recharged when task moves
* each vm_area_struct carries a BC pointer

Summary of changes from v3 patch set:

* Added basic user pages accounting (lockedpages/privvmpages)
* spell in Kconfig
* Makefile reworked
* EXPORT_SYMBOL_GPL
* union w/o name in struct page
* bc_task_charge is void now
* adjust minheld/maxheld splitted

Summary of changes from v2 patch set:

* introduced atomic_dec_and_lock_irqsave()
* bc_adjust_held_minmax comment
* added __must_check for bc_*charge* funcs
* use hash_long() instead of own one
* bc/Kconfig is sourced from init/Kconfig now
* introduced bcid_t type with comment from Alan Cox
* check for barrier <= limit in sys_set_bclimit()
* removed (bc == NULL) checks
* replaced memcpy in beancounter_findcrate with assignment
* moved check 'if (mask & BC_ALLOC)' out of the lock
* removed unnecessary memset()

Summary of changes from v1 patch set:

* CONFIG_BEANCOUNTERS is 'n' by default
* fixed Kconfig includes in arches
* removed hierarchical beancounters to simplify first patchset
* removed unused 'private' pointer
* removed unused EXPORTS
* MAXVALUE redeclared as LONG_MAX
* beancounter_findcreate clarification
* renamed UBC -> BC, ub -> bc etc.
* moved BC inheritance into copy_process
* introduced reset_exec_bc() with proposed BUG_ON
* removed task_bc beancounter (not used yet, for numproc)
* fixed syscalls for sparc
* added sys_get_bcstat(): return info that was in /proc
* cond_syscall instead of #ifdefs

Many thanks to Oleg Nesterov, Alan Cox, Matt Helsley and others
for patch review and comments.

Thanks,
Kirill

Report message to a moderator

[Message index]

		BC: resource beancounters (v6) (with userpages reclamation + configfs) By: dev on Thu, 09 November 2006 16:42
		[PATCH 1/13] BC: atomic_dec_and_lock_irqsave() helper By: dev on Thu, 09 November 2006 16:47
		Re: [PATCH 1/13] BC: atomic_dec_and_lock_irqsave() helper By: Cedric Le Goater on Fri, 10 November 2006 15:19
		Re: [PATCH 1/13] BC: atomic_dec_and_lock_irqsave() helper By: dev on Fri, 10 November 2006 16:40
		[PATCH 2/13] BC: Kconfig and Makefile By: dev on Thu, 09 November 2006 16:47
		[PATCH 3/13] BC: beancounters core and API By: dev on Thu, 09 November 2006 16:49
		[PATCH 4/13] BC: context handling By: dev on Thu, 09 November 2006 16:51
		Re: [ckrm-tech] [PATCH 4/13] BC: context handling By: Paul Menage on Thu, 23 November 2006 07:48
		Re: [ckrm-tech] [PATCH 4/13] BC: context handling By: Pavel Emelianov on Thu, 23 November 2006 08:35
		Re: [ckrm-tech] [PATCH 4/13] BC: context handling By: Paul Menage on Thu, 23 November 2006 08:53
		Re: [ckrm-tech] [PATCH 4/13] BC: context handling By: Pavel Emelianov on Thu, 23 November 2006 09:20
		Re: [ckrm-tech] [PATCH 4/13] BC: context handling By: Paul Menage on Thu, 23 November 2006 09:31
		Re: [ckrm-tech] [PATCH 4/13] BC: context handling By: Pavel Emelianov on Thu, 23 November 2006 09:56
		Re: [ckrm-tech] [PATCH 4/13] BC: context handling By: Paul Menage on Thu, 23 November 2006 10:18
		Re: [ckrm-tech] [PATCH 4/13] BC: context handling By: Pavel Emelianov on Thu, 23 November 2006 10:45
		Re: [ckrm-tech] [PATCH 4/13] BC: context handling By: Pavel Emelianov on Fri, 24 November 2006 10:10
		Re: [ckrm-tech] [PATCH 4/13] BC: context handling By: Paul Menage on Sat, 25 November 2006 00:09
		Re: [ckrm-tech] [PATCH 4/13] BC: context handling By: Pavel Emelianov on Mon, 27 November 2006 08:27
		[PATCH 5/13] BC: configfs interface By: dev on Thu, 09 November 2006 16:52
		[PATCH 6/13] BC: kmemsize accounting (core) By: dev on Thu, 09 November 2006 16:53
		Re: [PATCH 6/13] BC: kmemsize accounting (core) By: Paul Jackson on Thu, 09 November 2006 19:05
		Re: [PATCH 6/13] BC: kmemsize accounting (core) By: Pekka Enberg on Fri, 10 November 2006 22:50
		Re: [PATCH 6/13] BC: kmemsize accounting (core) By: Pekka Enberg on Fri, 10 November 2006 22:46
		Re: [PATCH 6/13] BC: kmemsize accounting (core) By: Pavel Emelianov on Mon, 13 November 2006 12:13
		Re: [PATCH 6/13] BC: kmemsize accounting (core) By: Pavel Machek on Sat, 11 November 2006 05:50
		[PATCH 7/13] BC: kmemsize accounting (hooks) By: dev on Thu, 09 November 2006 16:54
		[PATCH 8/13] BC: privvmpages accounting (core) By: dev on Thu, 09 November 2006 16:56
		[PATCH 9/13] BC: privvmpages accounting (hooks) By: dev on Thu, 09 November 2006 16:57
		[PATCH 10/13] BC: physpages accounting (core) By: dev on Thu, 09 November 2006 16:59
		[PATCH 11/13] BC: physpages accounting (hooks) By: dev on Thu, 09 November 2006 17:01
		[PATCH 12/13] BC: numtasks accounting By: dev on Thu, 09 November 2006 17:02
		[PATCH 13/13] BC: numfiles accounting By: dev on Thu, 09 November 2006 17:03
		Re: BC: resource beancounters (v6) (with userpages reclamation + configfs) By: Herbert Poetzl on Sun, 19 November 2006 19:41

Previous Topic:	Re: Re: [RFC] [PATCH 0/4] uid_ns: introduction
Next Topic:	[PATCH] ext3: small fix for previous retries patch in ext3_prepare_write()

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Sun Sep 07 22:16:04 GMT 2025

Total time taken to generate the page: 0.18963 seconds