Ard Biesheuvel 825c43f50e kmap_local: don't assume kmap PTEs are linear arrays in memory ... The kmap_local conversion broke the ARM architecture, because the new code assumes that all PTEs used for creating kmaps form a linear array in memory, and uses array indexing to look up the kmap PTE belonging to a certain kmap index. On ARM, this cannot work, not only because the PTE pages may be non-adjacent in memory, but also because ARM/!LPAE interleaves hardware entries and extended entries (carrying software-only bits) in a way that is not compatible with array indexing. Fortunately, this only seems to affect configurations with more than 8 CPUs, due to the way the per-CPU kmap slots are organized in memory. Work around this by permitting an architecture to set a Kconfig symbol that signifies that the kmap PTEs do not form a lineary array in memory, and so the only way to locate the appropriate one is to walk the page tables. Link: https://lore.kernel.org/linux-arm-kernel/20211026131249.3731275-1-ardb@kernel.org/ Link: https://lkml.kernel.org/r/20211116094737.7391-1-ardb@kernel.org Fixes: 2a15ba82fa ("ARM: highmem: Switch to generic kmap atomic") Signed-off-by: Ard Biesheuvel <ardb@kernel.org> Reported-by: Quanyang Wang <quanyang.wang@windriver.com> Reviewed-by: Linus Walleij <linus.walleij@linaro.org> Acked-by: Russell King (Oracle) <rmk+kernel@armlinux.org.uk> Cc: Thomas Gleixner <tglx@linutronix.de> Cc: <stable@vger.kernel.org> Signed-off-by: Andrew Morton <akpm@linux-foundation.org> Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>		2021-11-20 10:35:54 -08:00
..
damon	mm/damon/dbgfs: fix missed use of damon_dbgfs_lock	2021-11-20 10:35:54 -08:00
kasan	kasan: add kasan mode messages when kasan init	2021-11-11 09:34:35 -08:00
kfence	kfence: always use static branches to guard kfence_alloc()	2021-11-06 13:30:43 -07:00
Kconfig	kmap_local: don't assume kmap PTEs are linear arrays in memory	2021-11-20 10:35:54 -08:00
Kconfig.debug	…
Makefile	mm/util: Add folio_mapping() and folio_file_mapping()	2021-09-27 09:27:30 -04:00
backing-dev.c	Merge branch 'akpm' (patches from Andrew)	2021-11-06 14:08:17 -07:00
balloon_compaction.c	…
bootmem_info.c	mm/bootmem_info.c: mark __init on register_page_bootmem_info_section	2021-09-03 09:58:14 -07:00
cleancache.c	…
cma.c	memblock: rename memblock_free to memblock_phys_free	2021-11-06 13:30:41 -07:00
cma.h	…
cma_debug.c	…
cma_sysfs.c	…
compaction.c	Merge branch 'akpm' (patches from Andrew)	2021-11-06 14:08:17 -07:00
debug.c	Merge branch 'akpm' (patches from Andrew)	2021-11-06 14:08:17 -07:00
debug_page_ref.c	…
debug_vm_pgtable.c	mm: debug_vm_pgtable: don't use __P000 directly	2021-11-06 13:30:33 -07:00
dmapool.c	…
early_ioremap.c	mm/early_ioremap.c: remove redundant early_ioremap_shutdown()	2021-09-08 11:50:24 -07:00
fadvise.c	…
failslab.c	…
filemap.c	Merge branch 'akpm' (patches from Andrew)	2021-11-09 10:11:53 -08:00
folio-compat.c	mm/filemap: Add FGP_STABLE	2021-10-18 07:49:41 -04:00
frontswap.c	…
gup.c	Merge branch 'akpm' (patches from Andrew)	2021-11-06 14:08:17 -07:00
gup_test.c	…
gup_test.h	…
highmem.c	kmap_local: don't assume kmap PTEs are linear arrays in memory	2021-11-20 10:35:54 -08:00
hmm.c	mm/hmm: bypass devmap pte when all pfn requested flags are fulfilled	2021-09-08 18:45:52 -07:00
huge_memory.c	Memory folios	2021-11-01 08:47:59 -07:00
hugetlb.c	hugetlb, userfaultfd: fix reservation restore on userfaultfd error	2021-11-20 10:35:54 -08:00
hugetlb_cgroup.c	hugetlb_cgroup: remove unused hugetlb_cgroup_from_counter macro	2021-11-06 13:30:39 -07:00
hugetlb_vmemmap.c	…
hugetlb_vmemmap.h	…
hwpoison-inject.c	mm: hwpoison: don't drop slab caches for offlining non-LRU page	2021-09-03 09:58:15 -07:00
init-mm.c	…
internal.h	Merge branch 'akpm' (patches from Andrew)	2021-11-06 14:08:17 -07:00
interval_tree.c	…
io-mapping.c	…
ioremap.c	mm: move ioremap_page_range to vmalloc.c	2021-09-08 11:50:24 -07:00
khugepaged.c	Merge branch 'akpm' (patches from Andrew)	2021-11-06 14:08:17 -07:00
kmemleak.c	mm/kmemleak: allow __GFP_NOLOCKDEP passed to kmemleak's gfp	2021-09-08 18:45:53 -07:00
ksm.c	mm/migrate: Add folio_migrate_flags()	2021-10-18 07:49:39 -04:00
list_lru.c	mm: list_lru: only add memcg-aware lrus to the global lru list	2021-11-06 13:30:35 -07:00
maccess.c	…
madvise.c	mm: use pidfd_get_task()	2021-10-14 13:29:22 +02:00
mapping_dirty_helpers.c	…
memblock.c	arm64 fixes for -rc1	2021-11-10 11:29:30 -08:00
memcontrol.c	mm: unexport {,un}lock_page_memcg	2021-11-11 09:34:35 -08:00
memfd.c	mm,hugetlb: remove mlock ulimit for SHM_HUGETLB	2021-11-09 10:02:48 -08:00
memory-failure.c	Revert "mm: shmem: don't truncate page if memory failure happens"	2021-11-13 12:03:03 -08:00
memory.c	Merge branch 'akpm' (patches from Andrew)	2021-11-06 14:08:17 -07:00
memory_hotplug.c	mm/memory_hotplug: indicate MEMBLOCK_DRIVER_MANAGED with IORESOURCE_SYSRAM_DRIVER_MANAGED	2021-11-06 13:30:42 -07:00
mempolicy.c	Merge branch 'akpm' (patches from Andrew)	2021-11-06 14:08:17 -07:00
mempool.c	mm: remove spurious blkdev.h includes	2021-10-18 06:17:01 -06:00
memremap.c	mm/memcg: Convert mem_cgroup_uncharge() to take a folio	2021-09-27 09:27:31 -04:00
memtest.c	…
migrate.c	mm/migrate.c: remove MIGRATE_PFN_LOCKED	2021-11-11 09:34:35 -08:00
mincore.c	…
mlock.c	mm/memcg: Add folio_lruvec_relock_irq() and folio_lruvec_relock_irqsave()	2021-09-27 09:27:31 -04:00
mm_init.c	…
mmap.c	mm,hugetlb: remove mlock ulimit for SHM_HUGETLB	2021-11-09 10:02:48 -08:00
mmap_lock.c	…
mmu_gather.c	…
mmu_notifier.c	…
mmzone.c	…
mprotect.c	mm/mprotect.c: avoid repeated assignment in do_mprotect_pkey()	2021-11-06 13:30:36 -07:00
mremap.c	mm, hugepages: add mremap() support for hugepage backed vma	2021-11-06 13:30:39 -07:00
msync.c	…
nommu.c	Merge branch 'akpm' (patches from Andrew)	2021-11-06 14:08:17 -07:00
oom_kill.c	pidfd.v5.16	2021-11-10 16:02:08 -08:00
page-writeback.c	folio: Add a function to get the host inode for a folio	2021-11-10 21:16:52 +00:00
page_alloc.c	Merge branch 'akpm' (patches from Andrew)	2021-11-06 14:08:17 -07:00
page_counter.c	…
page_ext.c	mm/page_ext.c: fix a comment	2021-11-06 13:30:34 -07:00
page_idle.c	mm/idle_page_tracking: make PG_idle reusable	2021-09-08 11:50:24 -07:00
page_io.c	for-5.16/block-2021-10-29	2021-11-01 09:19:50 -07:00
page_isolation.c	mm/page_isolation: guard against possible putback unisolated page	2021-11-06 13:30:40 -07:00
page_owner.c	mm/page_owner.c: modify the type of argument "order" in some functions	2021-11-11 09:34:35 -08:00
page_poison.c	…
page_reporting.c	…
page_reporting.h	…
page_vma_mapped.c	…
pagewalk.c	…
percpu-internal.h	…
percpu-km.c	…
percpu-stats.c	…
percpu-vm.c	…
percpu.c	memblock: use memblock_free for freeing virtual pointers	2021-11-06 13:30:41 -07:00
pgalloc-track.h	…
pgtable-generic.c	…
process_vm_access.c	…
ptdump.c	…
readahead.c	Merge branch 'akpm' (patches from Andrew)	2021-11-06 14:08:17 -07:00
rmap.c	Merge branch 'akpm' (patches from Andrew)	2021-11-06 14:08:17 -07:00
rodata_test.c	…
secretmem.c	mm/secretmem: avoid letting secretmem_users drop to zero	2021-10-28 17:18:55 -07:00
shmem.c	Revert "mm: shmem: don't truncate page if memory failure happens"	2021-11-13 12:03:03 -08:00
shuffle.c	…
shuffle.h	…
slab.c	mm: emit the "free" trace report before freeing memory in kmem_cache_free()	2021-11-20 10:35:54 -08:00
slab.h	mm: kmemleak: slob: respect SLAB_NOLEAKTRACE flag	2021-11-20 10:35:54 -08:00
slab_common.c	mm: remove HARDENED_USERCOPY_FALLBACK	2021-11-06 13:30:43 -07:00
slob.c	mm: emit the "free" trace report before freeing memory in kmem_cache_free()	2021-11-20 10:35:54 -08:00
slub.c	mm: emit the "free" trace report before freeing memory in kmem_cache_free()	2021-11-20 10:35:54 -08:00
sparse-vmemmap.c	mm: remove redundant smp_wmb()	2021-11-06 13:30:36 -07:00
sparse.c	memblock: use memblock_free for freeing virtual pointers	2021-11-06 13:30:41 -07:00
swap.c	mm/swap.c:put_pages_list(): reinitialise the page list	2021-11-20 10:35:54 -08:00
swap_cgroup.c	…
swap_slots.c	…
swap_state.c	mm/workingset: Convert workingset_refault() to take a folio	2021-10-18 07:49:40 -04:00
swapfile.c	Merge branch 'akpm' (patches from Andrew)	2021-11-06 14:08:17 -07:00
truncate.c	vfs: keep inodes with page cache off the inode shrinker LRU	2021-11-09 10:02:48 -08:00
usercopy.c	…
userfaultfd.c	Revert "mm: shmem: don't truncate page if memory failure happens"	2021-11-13 12:03:03 -08:00
util.c	mm/migrate: Add folio_migrate_copy()	2021-10-18 07:49:39 -04:00
vmacache.c	…
vmalloc.c	mm/vmalloc: introduce alloc_pages_bulk_array_mempolicy to accelerate memory allocation	2021-11-06 13:30:37 -07:00
vmpressure.c	mm/vmpressure: fix data-race with memcg->socket_pressure	2021-11-06 13:30:40 -07:00
vmscan.c	Merge branch 'akpm' (patches from Andrew)	2021-11-09 10:11:53 -08:00
vmstat.c	mm: vmstat.c: make extfrag_index show more pretty	2021-11-06 13:30:42 -07:00
workingset.c	Merge branch 'akpm' (patches from Andrew)	2021-11-09 10:11:53 -08:00
z3fold.c	…
zbud.c	…
zpool.c	…
zsmalloc.c	mm/zsmalloc.c: close race window between zs_pool_dec_isolated() and zs_unregister_migration()	2021-11-06 13:30:43 -07:00
zswap.c	…