Yu Zhao a52dcec56c mm/mglru: fix PTE-mapped large folios ... Count the accessed bits from PTEs mapping the same large folio as one access rather than multiple accesses. The last patch changed how folios accessed through page tables are promoted: rather than getting promoted after the accessed bit is cleared for the first time, a folio only gets promoted thereafter. Counting the accessed bits from the same large folio as multiple accesses can cause that folio to be promoted prematurely, which in turn can cause overprotection of single-use large folios. This patch reduced the sys time of the kernel compilation by 95% CI [2, 5]% on Altra M128-30 with 3GB DRAM, 12GB zram, 16KB THPs and -j32. Link: https://lkml.kernel.org/r/20241231043538.4075764-8-yuzhao@google.com Signed-off-by: Yu Zhao <yuzhao@google.com> Reported-by: Barry Song <v-songbaohua@oppo.com> Tested-by: Kalesh Singh <kaleshsingh@google.com> Cc: Bharata B Rao <bharata@amd.com> Cc: David Stevens <stevensd@chromium.org> Cc: Kairui Song <kasong@tencent.com> Signed-off-by: Andrew Morton <akpm@linux-foundation.org>		2025-01-25 20:22:39 -08:00
..
damon	mm/damon/sysfs-schemes: add a file for setting damos_filter->allow	2025-01-25 20:22:32 -08:00
kasan	mm:kasan: fix sparse warnings: Should it be static?	2025-01-13 22:40:42 -08:00
kfence	mm/kfence: add a new kunit test test_use_after_free_read_nofault()	2024-11-14 22:49:19 -08:00
kmsan	mm/memblock: add memblock_alloc_or_panic interface	2025-01-25 20:22:38 -08:00
backing-dev.c
balloon_compaction.c
bootmem_info.c	bootmem: stop using page->index	2024-11-07 14:38:07 -08:00
cma_debug.c
cma_sysfs.c
cma.c	cma: enforce non-zero pageblock_order during cma_init_reserved_mem()	2024-11-14 22:49:19 -08:00
cma.h	mm: change type of cma_area_count to unsigned int	2025-01-13 22:40:35 -08:00
compaction.c	mm/page_alloc: move set_page_refcounted() to callers of post_alloc_hook()	2025-01-13 22:40:31 -08:00
debug_page_alloc.c
debug_page_ref.c
debug_vm_pgtable.c
debug.c	mm/debug: introduce VM_WARN_ON_VMG() to dump VMA merge state	2025-01-25 20:22:23 -08:00
dmapool_test.c
dmapool.c
early_ioremap.c	mm/early_ioremap: add null pointer checks to prevent NULL-pointer dereference	2025-01-13 22:40:59 -08:00
execmem.c	alloc_tag: populate memory for module tags as needed	2024-11-07 14:25:16 -08:00
fadvise.c	fdget(), trivial conversions	2024-11-03 01:28:06 -05:00
fail_page_alloc.c
failslab.c
filemap.c	filemap: remove unused folio_add_wait_queue	2025-01-13 22:40:38 -08:00
folio-compat.c	mm/writeback: add folio_mark_dirty_lock()	2024-11-05 11:14:32 +01:00
gup_test.c
gup_test.h
gup.c	mm/hugetlb: support FOLL_FORCE|FOLL_WRITE	2025-01-13 22:40:51 -08:00
highmem.c
hmm.c
huge_memory.c	mm/huge_memory.c: rename shadowed local	2025-01-25 20:22:18 -08:00
hugetlb_cgroup.c	mm/hugetlb_cgroup: avoid useless return in void function	2025-01-13 22:40:34 -08:00
hugetlb_vmemmap.c
hugetlb_vmemmap.h
hugetlb.c	mm/hugetlb: unify restore reserve accounting for new allocations	2025-01-25 20:22:31 -08:00
hwpoison-inject.c
init-mm.c	mm: convert mm_lock_seq to a proper seqcount	2025-01-13 22:40:50 -08:00
internal.h	mseal: remove can_do_mseal()	2025-01-13 22:40:51 -08:00
interval_tree.c
io-mapping.c
ioremap.c
Kconfig	mm: add build-time option for hotplug memory default online type	2025-01-25 20:22:21 -08:00
Kconfig.debug
khugepaged.c	mm: khugepaged: recheck pmd state in retract_page_tables()	2025-01-13 22:40:46 -08:00
kmemleak.c	mm/kmemleak: fix percpu memory leak detection failure	2025-01-12 19:03:34 -08:00
ksm.c	- The series "zram: optimal post-processing target selection" from	2024-11-23 09:58:07 -08:00
list_lru.c	mm/list_lru: fix false warning of negative counter	2024-12-30 17:59:10 -08:00
maccess.c	kasan: migrate copy_user_test to kunit	2024-11-11 00:26:44 -08:00
madvise.c	mm: pgtable: reclaim empty PTE page in madvise(MADV_DONTNEED)	2025-01-13 22:40:48 -08:00
Makefile	mm: pgtable: reclaim empty PTE page in madvise(MADV_DONTNEED)	2025-01-13 22:40:48 -08:00
mapping_dirty_helpers.c
memblock.c	mm/memblock: add memblock_alloc_or_panic interface	2025-01-25 20:22:38 -08:00
memcontrol-v1.c	mm: remove the non-useful else after a break in a if statement	2025-01-13 22:40:40 -08:00
memcontrol-v1.h	mm: memcg: declare do_memsw_account inline	2024-12-05 19:54:46 -08:00
memcontrol.c	memcg: fix soft lockup in the OOM process	2025-01-25 20:22:35 -08:00
memfd.c	mm: perform all memfd seal checks in a single place	2025-01-13 22:40:51 -08:00
memory_hotplug.c	mm: add build-time option for hotplug memory default online type	2025-01-25 20:22:21 -08:00
memory-failure.c	mm/memory-failure: replace sprintf() with sysfs_emit()	2024-11-11 00:26:46 -08:00
memory-tiers.c
memory.c	mm: pgtable: introduce pagetable_dtor()	2025-01-25 20:22:22 -08:00
mempolicy.c	mm: alloc_pages_bulk: rename API	2025-01-25 20:22:31 -08:00
mempool.c
memremap.c
memtest.c
migrate_device.c
migrate.c	mm/migrate: remove slab checks in isolate_movable_page()	2025-01-13 22:40:58 -08:00
mincore.c
mlock.c	mm/mlock: set the correct prev on failure	2024-11-07 14:14:58 -08:00
mm_init.c	mm/memmap: prevent double scanning of memmap by kmemleak	2025-01-25 20:22:30 -08:00
mm_slot.h
mmap_lock.c	mm: mmap_lock: optimize mmap_lock tracepoints	2025-01-13 22:40:34 -08:00
mmap.c	mm: make mmap_region() internal	2025-01-25 20:22:38 -08:00
mmu_gather.c	mm: pgtable: move __tlb_remove_table_one() in x86 to generic file	2025-01-25 20:22:23 -08:00
mmu_notifier.c
mmzone.c
mprotect.c	mm: add PTE_MARKER_GUARD PTE marker	2024-11-11 00:26:44 -08:00
mremap.c	mm: clear uffd-wp PTE/PMD state on mremap()	2025-01-12 19:03:37 -08:00
mseal.c	mseal: remove can_do_mseal()	2025-01-13 22:40:51 -08:00
msync.c
nommu.c	nommu: pass NULL argument to vma_iter_prealloc()	2024-11-11 17:20:23 -08:00
numa_emulation.c	mm/fake-numa: allow later numa node hotplug	2025-01-25 20:22:29 -08:00
numa_memblks.c	mm/fake-numa: allow later numa node hotplug	2025-01-25 20:22:29 -08:00
numa.c	mm/memblock: add memblock_alloc_or_panic interface	2025-01-25 20:22:38 -08:00
oom_kill.c	memcg: fix soft lockup in the OOM process	2025-01-25 20:22:35 -08:00
page_alloc.c	mm: alloc_pages_bulk_noprof: drop page_list argument	2025-01-25 20:22:31 -08:00
page_counter.c
page_ext.c
page_frag_cache.c	mm/page_alloc: export free_frozen_pages() instead of free_unref_page()	2025-01-13 22:40:31 -08:00
page_idle.c	mm/page_idle: constify 'struct bin_attribute'	2025-01-25 20:22:19 -08:00
page_io.c	mm, swap: clean up device availability check	2025-01-25 20:22:36 -08:00
page_isolation.c	mm/page_isolation: don't pass gfp flags to start_isolate_page_range()	2025-01-13 22:40:44 -08:00
page_owner.c
page_poison.c
page_reporting.c
page_reporting.h
page_table_check.c
page_vma_mapped.c	mm: mass constification of folio/page pointers	2024-11-07 14:38:07 -08:00
page-writeback.c	mm: fix div by zero in bdi_ratio_from_pages	2025-01-12 19:03:36 -08:00
pagewalk.c	mm: pagewalk: add the ability to install PTEs	2024-11-11 00:26:44 -08:00
percpu-internal.h
percpu-km.c
percpu-stats.c
percpu-vm.c
percpu.c	mm/memblock: add memblock_alloc_or_panic interface	2025-01-25 20:22:38 -08:00
pgalloc-track.h
pgtable-generic.c	mm: add RCU annotation to pte_offset_map(_lock)	2024-12-18 19:04:43 -08:00
process_vm_access.c	mm: refactor mm_access() to not return NULL	2024-11-05 16:56:23 -08:00
pt_reclaim.c	mm: pgtable: reclaim empty PTE page in madvise(MADV_DONTNEED)	2025-01-13 22:40:48 -08:00
ptdump.c
readahead.c	readahead: properly shorten readahead when falling back to do_page_cache_ra()	2025-01-13 22:40:45 -08:00
rmap.c	mm: mass constification of folio/page pointers	2024-11-07 14:38:07 -08:00
rodata_test.c	mm/rodata_test: verify test data is unchanged, rather than non-zero	2025-01-13 22:40:38 -08:00
secretmem.c	secretmem: disable memfd_secret() if arch cannot set direct map	2024-10-09 12:47:19 -07:00
shmem_quota.c
shmem.c	mm: shmem: skip swapcache for swapin of synchronous swap device	2025-01-25 20:22:30 -08:00
show_mem.c	mm/show_mem: use str_yes_no() helper in show_free_areas()	2024-11-07 14:38:08 -08:00
shrinker_debug.c
shrinker.c	mm: shrinker: avoid memleak in alloc_shrinker_info	2024-10-31 20:27:04 -07:00
shuffle.c
shuffle.h
slab_common.c	slab updates for 6.13	2024-11-25 16:51:24 -08:00
slab.h	mm/slub: Avoid list corruption when removing a slab from the full list	2024-11-16 21:19:39 +01:00
slub.c	mm/migrate: remove slab checks in isolate_movable_page()	2025-01-13 22:40:58 -08:00
sparse-vmemmap.c	mm/memmap: prevent double scanning of memmap by kmemleak	2025-01-25 20:22:30 -08:00
sparse.c	mm/memblock: add memblock_alloc_or_panic interface	2025-01-25 20:22:38 -08:00
swap_cgroup.c	mm/swap_cgroup: decouple swap cgroup recording and clearing	2025-01-25 20:22:19 -08:00
swap_slots.c	mm, swap_slots: remove slot cache for freeing path	2025-01-25 20:22:37 -08:00
swap_state.c	mm: remove unnecessary calls to lru_add_drain	2025-01-25 20:22:21 -08:00
swap.c	mm/mglru: rework workingset protection	2025-01-25 20:22:39 -08:00
swap.h
swapfile.c	mm, swap_slots: remove slot cache for freeing path	2025-01-25 20:22:37 -08:00
truncate.c	- The series "zram: optimal post-processing target selection" from	2024-11-23 09:58:07 -08:00
usercopy.c
userfaultfd.c	mm: userfaultfd: recheck dst_pmd entry in move_pages_pte()	2025-01-13 22:40:46 -08:00
util.c	mm: add comments to do_mmap(), mmap_region() and vm_mmap()	2025-01-13 22:40:59 -08:00
vma_internal.h	mm/vma: move brk() internals to mm/vma.c	2025-01-13 22:40:42 -08:00
vma.c	mm: make mmap_region() internal	2025-01-25 20:22:38 -08:00
vma.h	mm: make mmap_region() internal	2025-01-25 20:22:38 -08:00
vmalloc.c	mm: alloc_pages_bulk: rename API	2025-01-25 20:22:31 -08:00
vmpressure.c
vmscan.c	mm/mglru: fix PTE-mapped large folios	2025-01-25 20:22:39 -08:00
vmstat.c	vmstat: disable vmstat_work on vmstat_cpu_down_prep()	2025-01-12 19:03:38 -08:00
workingset.c	mm/mglru: rework workingset protection	2025-01-25 20:22:39 -08:00
z3fold.c
zbud.c
zpdesc.h	mm/zsmalloc: introduce __zpdesc_clear/set_zsmalloc()	2025-01-25 20:22:35 -08:00
zpool.c
zsmalloc.c	mm/zsmalloc: introduce __zpdesc_clear/set_zsmalloc()	2025-01-25 20:22:35 -08:00
zswap.c	mm/zswap: add LRU_STOP to comment about dropping the lru lock	2025-01-13 22:40:30 -08:00