Rik van Riel e8a03feb54 rmap: add exclusively owned pages to the newest anon_vma ... The recent anon_vma fixes cause many anonymous pages to end up in the parent process anon_vma, even when the page is exclusively owned by the current process. Adding exclusively owned anonymous pages to the top anon_vma reduces rmap scanning overhead, especially in workloads with forking servers. This patch adds a parameter to __page_set_anon_rmap that can be used to indicate whether or not the added page is exclusively owned by the current process. Pages added through page_add_new_anon_rmap are exclusively owned by the current process, and can be added to the top anon_vma. Pages added through page_add_anon_rmap can be either shared or exclusively owned, so we do the conservative thing and add it to the oldest anon_vma. A next step would be to add the exclusive parameter to page_add_anon_rmap, to be used from functions where we do know for sure whether a page is exclusively owned. Signed-off-by: Rik van Riel <riel@redhat.com> Reviewed-by: Johannes Weiner <hannes@cmpxchg.org> Lightly-tested-by: Borislav Petkov <bp@alien8.de> Reviewed-by: Minchan Kim <minchan.kim@gmail.com> [ Edited to look nicer - Linus ] Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>		2010-04-19 16:28:20 -07:00
..
Kconfig	…
Kconfig.debug	…
Makefile	percpu: don't implicitly include slab.h from percpu.h	2010-03-30 22:02:32 +09:00
backing-dev.c	backing-dev: Handle class_create() failure	2010-04-02 09:46:55 +02:00
bootmem.c	Merge branch 'x86-fixes-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/x86/linux-2.6-tip	2010-04-07 11:02:23 -07:00
bounce.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
debug-pagealloc.c	…
dmapool.c	…
fadvise.c	…
failslab.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
filemap.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
filemap_xip.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
fremap.c	…
highmem.c	…
hugetlb.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
hwpoison-inject.c	…
init-mm.c	…
internal.h	…
kmemcheck.c	kmemcheck: Fix build errors due to missing slab.h	2010-03-30 22:02:32 +09:00
kmemleak-test.c	…
kmemleak.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
ksm.c	mm/ksm.c is doing an unneeded _notify in write_protect_page.	2010-03-24 16:31:20 -07:00
maccess.c	…
madvise.c	…
memcontrol.c	memcg: fix race in file_mapped accounting	2010-04-07 08:38:05 -07:00
memory-failure.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
memory.c	mm: avoid null-pointer deref in sync_mm_rss()	2010-04-07 08:38:02 -07:00
memory_hotplug.c	…
mempolicy.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
mempool.c	…
migrate.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
mincore.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
mlock.c	…
mm_init.c	…
mmap.c	vma_adjust: fix the copying of anon_vma chains	2010-04-12 17:54:11 -07:00
mmu_context.c	exit: fix oops in sync_mm_rss	2010-03-24 16:31:21 -07:00
mmu_notifier.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
mmzone.c	…
mprotect.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
mremap.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
msync.c	…
nommu.c	NOMMU: Fix __get_user_pages() to pin last page on offset buffers	2010-03-25 14:13:27 -07:00
oom_kill.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
page-writeback.c	…
page_alloc.c	…
page_cgroup.c	memcg: avoid use cmpxchg in swap cgroup maintainance	2010-03-17 18:43:47 -07:00
page_io.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
page_isolation.c	…
pagewalk.c	pagemap: fix pfn calculation for hugepage	2010-04-07 08:38:04 -07:00
percpu.c	percpu, module: implement and use is_kernel/module_percpu_address()	2010-03-29 23:07:12 +09:00
percpu_up.c	percpu: don't implicitly include slab.h from percpu.h	2010-03-30 22:02:32 +09:00
prio_tree.c	…
quicklist.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
readahead.c	readahead: fix NULL filp dereference	2010-04-07 08:38:03 -07:00
rmap.c	rmap: add exclusively owned pages to the newest anon_vma	2010-04-19 16:28:20 -07:00
shmem.c	…
slab.c	slab: Generify kernel pointer validation	2010-04-09 10:09:50 -07:00
slob.c	…
slub.c	slub: Fix kmem_ptr_validate() for non-kernel pointers	2010-04-09 10:09:50 -07:00
sparse-vmemmap.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
sparse.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
swap.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
swap_state.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
swapfile.c	memcg: move charges of anonymous swap	2010-03-12 15:52:36 -08:00
thrash.c	…
truncate.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00
util.c	slab: Generify kernel pointer validation	2010-04-09 10:09:50 -07:00
vmalloc.c	…
vmscan.c	mm: revert "vmscan: get_scan_ratio() cleanup"	2010-04-07 08:38:03 -07:00
vmstat.c	include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h	2010-03-30 22:02:32 +09:00