OpenVZ Forum: Devel » [PATCH v3 04/13] kmem accounting basic infrastructure

Home » Mailing lists » Devel » [PATCH v3 04/13] kmem accounting basic infrastructure

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: [PATCH v3 04/13] kmem accounting basic infrastructure [message #48152 is a reply to message #48138]

Mon, 01 October 2012 08:36

Glauber Costa
Messages: 916
Registered: October 2011

Senior Member

On 09/30/2012 11:57 AM, Tejun Heo wrote:
> Hello, Glauber.
>
> On Thu, Sep 27, 2012 at 10:45:01PM +0400, Glauber Costa wrote:
>>> Can you please give other examples of cases where this type of issue
>>> exists (plenty of shared kernel data structure which is inherent to
>>> the workload at hand)? Until now, this has been the only example for
>>> this type of issues.
>>
>> Yes. the namespace related caches (*), all kinds of sockets and network
>> structures, other file system structures like file struct, vm areas, and
>> pretty much everything a full container does.
>>
>> (*) we run full userspace, so we have namespaces + cgroups combination.
>
> This is probably me being dumb but wouldn't resources used by full
> namespaces be mostly independent? Which parts get shared? Also, if
> you do full namespace, isn't it more likely that you would want fuller
> resource isolation too?
>

Not necessarily. Namespaces are pretty flexible. If you are using the
network namespace, for instance, you can create interfaces, routes,
addresses, etc. But because this deals with the network only, there is
nothing unreasonable in saying that your webserver and database lives in
the same network (which is a different network namespace), but are
entitled to different memory limits - which is cgroups realm. With
application-only containers being championed these days by multiple
users, I would expect this situation to become non-negligible.

The full container scenario, of course, is very different. Most of the
accesses tends to be local.

I will second what Michal said, since I believe this is also very
important: User memory is completely at the control of the application,
while kernel memory is not, and never will. It is perfectly fine to
imagine applications that want its memory to be limited by a very
predictable amount, and there are no reasons to believe that those
cannot live in the same box as full containers - the biggest example of
kmem interested folks. It could be, for instance, that a management tool
for containers lives in there, and that application wants to be umem
limited but not kmem limited. (If it goes touching files and data inside
each container, for instance, it is obviously not local)

>>>> Mel suggestion of not allowing this to happen once the cgroup has tasks
>>>> takes care of this, and is something I thought of myself.
>>>
>>> You mean Michal's? It should also disallow switching if there are
>>> children cgroups, right?
>>
>> No, I meant Mel, quoting this:
>>
>> "Further I would expect that an administrator would be aware of these
>> limitations and set kmem_accounting at cgroup creation time before any
>> processes start. Maybe that should be enforced but it's not a
>> fundamental problem."
>>
>> But I guess it is pretty much the same thing Michal proposes, in essence.
>>
>> Or IOW, if your concern is with the fact that charges may have happened
>> in the past before this is enabled, we can make sure this cannot happen
>> by disallowing the limit to be set if currently unset (value changes are
>> obviously fine) if you have children or any tasks already in the group.
>
> Yeah, please do that.
>

I did already, patches soon! =)

Report message to a moderator

[Message index]

		[PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Tue, 18 September 2012 14:04
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Fri, 21 September 2012 16:34
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Mon, 24 September 2012 08:09
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Michal Hocko on Wed, 26 September 2012 14:03
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Wed, 26 September 2012 14:33
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Michal Hocko on Wed, 26 September 2012 16:01
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Wed, 26 September 2012 17:34
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Wed, 26 September 2012 16:36
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Wed, 26 September 2012 17:36
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Wed, 26 September 2012 17:44
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Wed, 26 September 2012 17:53
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Wed, 26 September 2012 18:01
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Wed, 26 September 2012 18:56
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Wed, 26 September 2012 19:34
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Wed, 26 September 2012 19:46
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Wed, 26 September 2012 19:56
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Wed, 26 September 2012 20:02
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Wed, 26 September 2012 20:16
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Wed, 26 September 2012 21:24
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Wed, 26 September 2012 22:10
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Wed, 26 September 2012 22:29
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Wed, 26 September 2012 22:42
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Wed, 26 September 2012 22:54
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Wed, 26 September 2012 23:08
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Wed, 26 September 2012 23:20
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Wed, 26 September 2012 23:33
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Michal Hocko on Thu, 27 September 2012 12:15
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Thu, 27 September 2012 12:20
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Michal Hocko on Thu, 27 September 2012 12:40
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Thu, 27 September 2012 12:40
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Michal Hocko on Thu, 27 September 2012 12:54
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Mel Gorman on Thu, 27 September 2012 14:28
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Thu, 27 September 2012 14:49
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Thu, 27 September 2012 14:57
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Thu, 27 September 2012 17:46
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Michal Hocko on Thu, 27 September 2012 17:56
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Thu, 27 September 2012 18:45
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Sun, 30 September 2012 07:57
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Sun, 30 September 2012 08:02
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: James Bottomley on Sun, 30 September 2012 08:56
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Sun, 30 September 2012 10:37
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: James Bottomley on Sun, 30 September 2012 11:25
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Mon, 01 October 2012 00:57
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Mon, 01 October 2012 08:43
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Mon, 01 October 2012 08:46
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Wed, 03 October 2012 22:59
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Mon, 01 October 2012 08:36
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Michal Hocko on Thu, 27 September 2012 12:08
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Thu, 27 September 2012 12:11
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Thu, 27 September 2012 14:33
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Mel Gorman on Thu, 27 September 2012 14:43
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Thu, 27 September 2012 14:58
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Thu, 27 September 2012 18:30
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Sun, 30 September 2012 08:23
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Mon, 01 October 2012 08:45
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Wed, 03 October 2012 22:54
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Thu, 04 October 2012 11:55
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Sat, 06 October 2012 02:19
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Michal Hocko on Thu, 27 September 2012 15:09
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Sun, 30 September 2012 08:47
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Michal Hocko on Mon, 01 October 2012 09:27
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Tejun Heo on Wed, 03 October 2012 22:43
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Michal Hocko on Fri, 05 October 2012 13:47
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Johannes Weiner on Wed, 26 September 2012 22:11
		Re: [PATCH v3 04/13] kmem accounting basic infrastructure By: Glauber Costa on Wed, 26 September 2012 22:45

Previous Topic:	[PATCH v3 00/16] slab accounting for memcg
Next Topic:	[RFC PATCH 0/5] net: socket bind to file descriptor introduced

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Mon Sep 01 17:57:26 GMT 2025

Total time taken to generate the page: 0.09408 seconds