mirror of
https://git.kernel.org/pub/scm/linux/kernel/git/chenhuacai/linux-loongson
synced 2025-08-28 18:10:32 +00:00

- The 4 patch series "mm: ksm: prevent KSM from breaking merging of new VMAs" from Lorenzo Stoakes addresses an issue with KSM's PR_SET_MEMORY_MERGE mode: newly mapped VMAs were not eligible for merging with existing adjacent VMAs. - The 4 patch series "mm/damon: introduce DAMON_STAT for simple and practical access monitoring" from SeongJae Park adds a new kernel module which simplifies the setup and usage of DAMON in production environments. - The 6 patch series "stop passing a writeback_control to swap/shmem writeout" from Christoph Hellwig is a cleanup to the writeback code which removes a couple of pointers from struct writeback_control. - The 7 patch series "drivers/base/node.c: optimization and cleanups" from Donet Tom contains largely uncorrelated cleanups to the NUMA node setup and management code. - The 4 patch series "mm: userfaultfd: assorted fixes and cleanups" from Tal Zussman does some maintenance work on the userfaultfd code. - The 5 patch series "Readahead tweaks for larger folios" from Ryan Roberts implements some tuneups for pagecache readahead when it is reading into order>0 folios. - The 4 patch series "selftests/mm: Tweaks to the cow test" from Mark Brown provides some cleanups and consistency improvements to the selftests code. - The 4 patch series "Optimize mremap() for large folios" from Dev Jain does that. A 37% reduction in execution time was measured in a memset+mremap+munmap microbenchmark. - The 5 patch series "Remove zero_user()" from Matthew Wilcox expunges zero_user() in favor of the more modern memzero_page(). - The 3 patch series "mm/huge_memory: vmf_insert_folio_*() and vmf_insert_pfn_pud() fixes" from David Hildenbrand addresses some warts which David noticed in the huge page code. These were not known to be causing any issues at this time. - The 3 patch series "mm/damon: use alloc_migrate_target() for DAMOS_MIGRATE_{HOT,COLD" from SeongJae Park provides some cleanup and consolidation work in DAMON. - The 3 patch series "use vm_flags_t consistently" from Lorenzo Stoakes uses vm_flags_t in places where we were inappropriately using other types. - The 3 patch series "mm/memfd: Reserve hugetlb folios before allocation" from Vivek Kasireddy increases the reliability of large page allocation in the memfd code. - The 14 patch series "mm: Remove pXX_devmap page table bit and pfn_t type" from Alistair Popple removes several now-unneeded PFN_* flags. - The 5 patch series "mm/damon: decouple sysfs from core" from SeongJae Park implememnts some cleanup and maintainability work in the DAMON sysfs layer. - The 5 patch series "madvise cleanup" from Lorenzo Stoakes does quite a lot of cleanup/maintenance work in the madvise() code. - The 4 patch series "madvise anon_name cleanups" from Vlastimil Babka provides additional cleanups on top or Lorenzo's effort. - The 11 patch series "Implement numa node notifier" from Oscar Salvador creates a standalone notifier for NUMA node memory state changes. Previously these were lumped under the more general memory on/offline notifier. - The 6 patch series "Make MIGRATE_ISOLATE a standalone bit" from Zi Yan cleans up the pageblock isolation code and fixes a potential issue which doesn't seem to cause any problems in practice. - The 5 patch series "selftests/damon: add python and drgn based DAMON sysfs functionality tests" from SeongJae Park adds additional drgn- and python-based DAMON selftests which are more comprehensive than the existing selftest suite. - The 5 patch series "Misc rework on hugetlb faulting path" from Oscar Salvador fixes a rather obscure deadlock in the hugetlb fault code and follows that fix with a series of cleanups. - The 3 patch series "cma: factor out allocation logic from __cma_declare_contiguous_nid" from Mike Rapoport rationalizes and cleans up the highmem-specific code in the CMA allocator. - The 28 patch series "mm/migration: rework movable_ops page migration (part 1)" from David Hildenbrand provides cleanups and future-preparedness to the migration code. - The 2 patch series "mm/damon: add trace events for auto-tuned monitoring intervals and DAMOS quota" from SeongJae Park adds some tracepoints to some DAMON auto-tuning code. - The 6 patch series "mm/damon: fix misc bugs in DAMON modules" from SeongJae Park does that. - The 6 patch series "mm/damon: misc cleanups" from SeongJae Park also does what it claims. - The 4 patch series "mm: folio_pte_batch() improvements" from David Hildenbrand cleans up the large folio PTE batching code. - The 13 patch series "mm/damon/vaddr: Allow interleaving in migrate_{hot,cold} actions" from SeongJae Park facilitates dynamic alteration of DAMON's inter-node allocation policy. - The 3 patch series "Remove unmap_and_put_page()" from Vishal Moola provides a couple of page->folio conversions. - The 4 patch series "mm: per-node proactive reclaim" from Davidlohr Bueso implements a per-node control of proactive reclaim - beyond the current memcg-based implementation. - The 14 patch series "mm/damon: remove damon_callback" from SeongJae Park replaces the damon_callback interface with a more general and powerful damon_call()+damos_walk() interface. - The 10 patch series "mm/mremap: permit mremap() move of multiple VMAs" from Lorenzo Stoakes implements a number of mremap cleanups (of course) in preparation for adding new mremap() functionality: newly permit the remapping of multiple VMAs when the user is specifying MREMAP_FIXED. It still excludes some specialized situations where this cannot be performed reliably. - The 3 patch series "drop hugetlb_free_pgd_range()" from Anthony Yznaga switches some sparc hugetlb code over to the generic version and removes the thus-unneeded hugetlb_free_pgd_range(). - The 4 patch series "mm/damon/sysfs: support periodic and automated stats update" from SeongJae Park augments the present userspace-requested update of DAMON sysfs monitoring files. Automatic update is now provided, along with a tunable to control the update interval. - The 4 patch series "Some randome fixes and cleanups to swapfile" from Kemeng Shi does what is claims. - The 4 patch series "mm: introduce snapshot_page" from Luiz Capitulino and David Hildenbrand provides (and uses) a means by which debug-style functions can grab a copy of a pageframe and inspect it locklessly without tripping over the races inherent in operating on the live pageframe directly. - The 6 patch series "use per-vma locks for /proc/pid/maps reads" from Suren Baghdasaryan addresses the large contention issues which can be triggered by reads from that procfs file. Latencies are reduced by more than half in some situations. The series also introduces several new selftests for the /proc/pid/maps interface. - The 6 patch series "__folio_split() clean up" from Zi Yan cleans up __folio_split()! - The 7 patch series "Optimize mprotect() for large folios" from Dev Jain provides some quite large (>3x) speedups to mprotect() when dealing with large folios. - The 2 patch series "selftests/mm: reuse FORCE_READ to replace "asm volatile("" : "+r" (XXX));" and some cleanup" from wang lian does some cleanup work in the selftests code. - The 3 patch series "tools/testing: expand mremap testing" from Lorenzo Stoakes extends the mremap() selftest in several ways, including adding more checking of Lorenzo's recently added "permit mremap() move of multiple VMAs" feature. - The 22 patch series "selftests/damon/sysfs.py: test all parameters" from SeongJae Park extends the DAMON sysfs interface selftest so that it tests all possible user-requested parameters. Rather than the present minimal subset. -----BEGIN PGP SIGNATURE----- iHUEABYIAB0WIQTTMBEPP41GrTpTJgfdBJ7gKXxAjgUCaIqcCgAKCRDdBJ7gKXxA jkVBAQCCn9DR1QP0CRk961ot0cKzOgioSc0aA03DPb2KXRt2kQEAzDAz0ARurFhL 8BzbvI0c+4tntHLXvIlrC33n9KWAOQM= =XsFy -----END PGP SIGNATURE----- Merge tag 'mm-stable-2025-07-30-15-25' of git://git.kernel.org/pub/scm/linux/kernel/git/akpm/mm Pull MM updates from Andrew Morton: "As usual, many cleanups. The below blurbiage describes 42 patchsets. 21 of those are partially or fully cleanup work. "cleans up", "cleanup", "maintainability", "rationalizes", etc. I never knew the MM code was so dirty. "mm: ksm: prevent KSM from breaking merging of new VMAs" (Lorenzo Stoakes) addresses an issue with KSM's PR_SET_MEMORY_MERGE mode: newly mapped VMAs were not eligible for merging with existing adjacent VMAs. "mm/damon: introduce DAMON_STAT for simple and practical access monitoring" (SeongJae Park) adds a new kernel module which simplifies the setup and usage of DAMON in production environments. "stop passing a writeback_control to swap/shmem writeout" (Christoph Hellwig) is a cleanup to the writeback code which removes a couple of pointers from struct writeback_control. "drivers/base/node.c: optimization and cleanups" (Donet Tom) contains largely uncorrelated cleanups to the NUMA node setup and management code. "mm: userfaultfd: assorted fixes and cleanups" (Tal Zussman) does some maintenance work on the userfaultfd code. "Readahead tweaks for larger folios" (Ryan Roberts) implements some tuneups for pagecache readahead when it is reading into order>0 folios. "selftests/mm: Tweaks to the cow test" (Mark Brown) provides some cleanups and consistency improvements to the selftests code. "Optimize mremap() for large folios" (Dev Jain) does that. A 37% reduction in execution time was measured in a memset+mremap+munmap microbenchmark. "Remove zero_user()" (Matthew Wilcox) expunges zero_user() in favor of the more modern memzero_page(). "mm/huge_memory: vmf_insert_folio_*() and vmf_insert_pfn_pud() fixes" (David Hildenbrand) addresses some warts which David noticed in the huge page code. These were not known to be causing any issues at this time. "mm/damon: use alloc_migrate_target() for DAMOS_MIGRATE_{HOT,COLD" (SeongJae Park) provides some cleanup and consolidation work in DAMON. "use vm_flags_t consistently" (Lorenzo Stoakes) uses vm_flags_t in places where we were inappropriately using other types. "mm/memfd: Reserve hugetlb folios before allocation" (Vivek Kasireddy) increases the reliability of large page allocation in the memfd code. "mm: Remove pXX_devmap page table bit and pfn_t type" (Alistair Popple) removes several now-unneeded PFN_* flags. "mm/damon: decouple sysfs from core" (SeongJae Park) implememnts some cleanup and maintainability work in the DAMON sysfs layer. "madvise cleanup" (Lorenzo Stoakes) does quite a lot of cleanup/maintenance work in the madvise() code. "madvise anon_name cleanups" (Vlastimil Babka) provides additional cleanups on top or Lorenzo's effort. "Implement numa node notifier" (Oscar Salvador) creates a standalone notifier for NUMA node memory state changes. Previously these were lumped under the more general memory on/offline notifier. "Make MIGRATE_ISOLATE a standalone bit" (Zi Yan) cleans up the pageblock isolation code and fixes a potential issue which doesn't seem to cause any problems in practice. "selftests/damon: add python and drgn based DAMON sysfs functionality tests" (SeongJae Park) adds additional drgn- and python-based DAMON selftests which are more comprehensive than the existing selftest suite. "Misc rework on hugetlb faulting path" (Oscar Salvador) fixes a rather obscure deadlock in the hugetlb fault code and follows that fix with a series of cleanups. "cma: factor out allocation logic from __cma_declare_contiguous_nid" (Mike Rapoport) rationalizes and cleans up the highmem-specific code in the CMA allocator. "mm/migration: rework movable_ops page migration (part 1)" (David Hildenbrand) provides cleanups and future-preparedness to the migration code. "mm/damon: add trace events for auto-tuned monitoring intervals and DAMOS quota" (SeongJae Park) adds some tracepoints to some DAMON auto-tuning code. "mm/damon: fix misc bugs in DAMON modules" (SeongJae Park) does that. "mm/damon: misc cleanups" (SeongJae Park) also does what it claims. "mm: folio_pte_batch() improvements" (David Hildenbrand) cleans up the large folio PTE batching code. "mm/damon/vaddr: Allow interleaving in migrate_{hot,cold} actions" (SeongJae Park) facilitates dynamic alteration of DAMON's inter-node allocation policy. "Remove unmap_and_put_page()" (Vishal Moola) provides a couple of page->folio conversions. "mm: per-node proactive reclaim" (Davidlohr Bueso) implements a per-node control of proactive reclaim - beyond the current memcg-based implementation. "mm/damon: remove damon_callback" (SeongJae Park) replaces the damon_callback interface with a more general and powerful damon_call()+damos_walk() interface. "mm/mremap: permit mremap() move of multiple VMAs" (Lorenzo Stoakes) implements a number of mremap cleanups (of course) in preparation for adding new mremap() functionality: newly permit the remapping of multiple VMAs when the user is specifying MREMAP_FIXED. It still excludes some specialized situations where this cannot be performed reliably. "drop hugetlb_free_pgd_range()" (Anthony Yznaga) switches some sparc hugetlb code over to the generic version and removes the thus-unneeded hugetlb_free_pgd_range(). "mm/damon/sysfs: support periodic and automated stats update" (SeongJae Park) augments the present userspace-requested update of DAMON sysfs monitoring files. Automatic update is now provided, along with a tunable to control the update interval. "Some randome fixes and cleanups to swapfile" (Kemeng Shi) does what is claims. "mm: introduce snapshot_page" (Luiz Capitulino and David Hildenbrand) provides (and uses) a means by which debug-style functions can grab a copy of a pageframe and inspect it locklessly without tripping over the races inherent in operating on the live pageframe directly. "use per-vma locks for /proc/pid/maps reads" (Suren Baghdasaryan) addresses the large contention issues which can be triggered by reads from that procfs file. Latencies are reduced by more than half in some situations. The series also introduces several new selftests for the /proc/pid/maps interface. "__folio_split() clean up" (Zi Yan) cleans up __folio_split()! "Optimize mprotect() for large folios" (Dev Jain) provides some quite large (>3x) speedups to mprotect() when dealing with large folios. "selftests/mm: reuse FORCE_READ to replace "asm volatile("" : "+r" (XXX));" and some cleanup" (wang lian) does some cleanup work in the selftests code. "tools/testing: expand mremap testing" (Lorenzo Stoakes) extends the mremap() selftest in several ways, including adding more checking of Lorenzo's recently added "permit mremap() move of multiple VMAs" feature. "selftests/damon/sysfs.py: test all parameters" (SeongJae Park) extends the DAMON sysfs interface selftest so that it tests all possible user-requested parameters. Rather than the present minimal subset" * tag 'mm-stable-2025-07-30-15-25' of git://git.kernel.org/pub/scm/linux/kernel/git/akpm/mm: (370 commits) MAINTAINERS: add missing headers to mempory policy & migration section MAINTAINERS: add missing file to cgroup section MAINTAINERS: add MM MISC section, add missing files to MISC and CORE MAINTAINERS: add missing zsmalloc file MAINTAINERS: add missing files to page alloc section MAINTAINERS: add missing shrinker files MAINTAINERS: move memremap.[ch] to hotplug section MAINTAINERS: add missing mm_slot.h file THP section MAINTAINERS: add missing interval_tree.c to memory mapping section MAINTAINERS: add missing percpu-internal.h file to per-cpu section mm/page_alloc: remove trace_mm_alloc_contig_migrate_range_info() selftests/damon: introduce _common.sh to host shared function selftests/damon/sysfs.py: test runtime reduction of DAMON parameters selftests/damon/sysfs.py: test non-default parameters runtime commit selftests/damon/sysfs.py: generalize DAMON context commit assertion selftests/damon/sysfs.py: generalize monitoring attributes commit assertion selftests/damon/sysfs.py: generalize DAMOS schemes commit assertion selftests/damon/sysfs.py: test DAMOS filters commitment selftests/damon/sysfs.py: generalize DAMOS scheme commit assertion selftests/damon/sysfs.py: test DAMOS destinations commitment ...
183 lines
5.3 KiB
C
183 lines
5.3 KiB
C
// SPDX-License-Identifier: MIT
|
|
/*
|
|
* Copyright © 2024 Intel Corporation
|
|
*/
|
|
|
|
#include <drm/ttm/ttm_backup.h>
|
|
|
|
#include <linux/export.h>
|
|
#include <linux/page-flags.h>
|
|
#include <linux/swap.h>
|
|
|
|
/*
|
|
* Need to map shmem indices to handle since a handle value
|
|
* of 0 means error, following the swp_entry_t convention.
|
|
*/
|
|
static unsigned long ttm_backup_shmem_idx_to_handle(pgoff_t idx)
|
|
{
|
|
return (unsigned long)idx + 1;
|
|
}
|
|
|
|
static pgoff_t ttm_backup_handle_to_shmem_idx(pgoff_t handle)
|
|
{
|
|
return handle - 1;
|
|
}
|
|
|
|
/**
|
|
* ttm_backup_drop() - release memory associated with a handle
|
|
* @backup: The struct backup pointer used to obtain the handle
|
|
* @handle: The handle obtained from the @backup_page function.
|
|
*/
|
|
void ttm_backup_drop(struct file *backup, pgoff_t handle)
|
|
{
|
|
loff_t start = ttm_backup_handle_to_shmem_idx(handle);
|
|
|
|
start <<= PAGE_SHIFT;
|
|
shmem_truncate_range(file_inode(backup), start,
|
|
start + PAGE_SIZE - 1);
|
|
}
|
|
|
|
/**
|
|
* ttm_backup_copy_page() - Copy the contents of a previously backed
|
|
* up page
|
|
* @backup: The struct backup pointer used to back up the page.
|
|
* @dst: The struct page to copy into.
|
|
* @handle: The handle returned when the page was backed up.
|
|
* @intr: Try to perform waits interruptible or at least killable.
|
|
*
|
|
* Return: 0 on success, Negative error code on failure, notably
|
|
* -EINTR if @intr was set to true and a signal is pending.
|
|
*/
|
|
int ttm_backup_copy_page(struct file *backup, struct page *dst,
|
|
pgoff_t handle, bool intr)
|
|
{
|
|
struct address_space *mapping = backup->f_mapping;
|
|
struct folio *from_folio;
|
|
pgoff_t idx = ttm_backup_handle_to_shmem_idx(handle);
|
|
|
|
from_folio = shmem_read_folio(mapping, idx);
|
|
if (IS_ERR(from_folio))
|
|
return PTR_ERR(from_folio);
|
|
|
|
copy_highpage(dst, folio_file_page(from_folio, idx));
|
|
folio_put(from_folio);
|
|
|
|
return 0;
|
|
}
|
|
|
|
/**
|
|
* ttm_backup_backup_page() - Backup a page
|
|
* @backup: The struct backup pointer to use.
|
|
* @page: The page to back up.
|
|
* @writeback: Whether to perform immediate writeback of the page.
|
|
* This may have performance implications.
|
|
* @idx: A unique integer for each page and each struct backup.
|
|
* This allows the backup implementation to avoid managing
|
|
* its address space separately.
|
|
* @page_gfp: The gfp value used when the page was allocated.
|
|
* This is used for accounting purposes.
|
|
* @alloc_gfp: The gfp to be used when allocating memory.
|
|
*
|
|
* Context: If called from reclaim context, the caller needs to
|
|
* assert that the shrinker gfp has __GFP_FS set, to avoid
|
|
* deadlocking on lock_page(). If @writeback is set to true and
|
|
* called from reclaim context, the caller also needs to assert
|
|
* that the shrinker gfp has __GFP_IO set, since without it,
|
|
* we're not allowed to start backup IO.
|
|
*
|
|
* Return: A handle on success. Negative error code on failure.
|
|
*
|
|
* Note: This function could be extended to back up a folio and
|
|
* implementations would then split the folio internally if needed.
|
|
* Drawback is that the caller would then have to keep track of
|
|
* the folio size- and usage.
|
|
*/
|
|
s64
|
|
ttm_backup_backup_page(struct file *backup, struct page *page,
|
|
bool writeback, pgoff_t idx, gfp_t page_gfp,
|
|
gfp_t alloc_gfp)
|
|
{
|
|
struct address_space *mapping = backup->f_mapping;
|
|
unsigned long handle = 0;
|
|
struct folio *to_folio;
|
|
int ret;
|
|
|
|
to_folio = shmem_read_folio_gfp(mapping, idx, alloc_gfp);
|
|
if (IS_ERR(to_folio))
|
|
return PTR_ERR(to_folio);
|
|
|
|
folio_mark_accessed(to_folio);
|
|
folio_lock(to_folio);
|
|
folio_mark_dirty(to_folio);
|
|
copy_highpage(folio_file_page(to_folio, idx), page);
|
|
handle = ttm_backup_shmem_idx_to_handle(idx);
|
|
|
|
if (writeback && !folio_mapped(to_folio) &&
|
|
folio_clear_dirty_for_io(to_folio)) {
|
|
folio_set_reclaim(to_folio);
|
|
ret = shmem_writeout(to_folio, NULL, NULL);
|
|
if (!folio_test_writeback(to_folio))
|
|
folio_clear_reclaim(to_folio);
|
|
/*
|
|
* If writeout succeeds, it unlocks the folio. errors
|
|
* are otherwise dropped, since writeout is only best
|
|
* effort here.
|
|
*/
|
|
if (ret)
|
|
folio_unlock(to_folio);
|
|
} else {
|
|
folio_unlock(to_folio);
|
|
}
|
|
|
|
folio_put(to_folio);
|
|
|
|
return handle;
|
|
}
|
|
|
|
/**
|
|
* ttm_backup_fini() - Free the struct backup resources after last use.
|
|
* @backup: Pointer to the struct backup whose resources to free.
|
|
*
|
|
* After a call to this function, it's illegal to use the @backup pointer.
|
|
*/
|
|
void ttm_backup_fini(struct file *backup)
|
|
{
|
|
fput(backup);
|
|
}
|
|
|
|
/**
|
|
* ttm_backup_bytes_avail() - Report the approximate number of bytes of backup space
|
|
* left for backup.
|
|
*
|
|
* This function is intended also for driver use to indicate whether a
|
|
* backup attempt is meaningful.
|
|
*
|
|
* Return: An approximate size of backup space available.
|
|
*/
|
|
u64 ttm_backup_bytes_avail(void)
|
|
{
|
|
/*
|
|
* The idea behind backing up to shmem is that shmem objects may
|
|
* eventually be swapped out. So no point swapping out if there
|
|
* is no or low swap-space available. But the accuracy of this
|
|
* number also depends on shmem actually swapping out backed-up
|
|
* shmem objects without too much buffering.
|
|
*/
|
|
return (u64)get_nr_swap_pages() << PAGE_SHIFT;
|
|
}
|
|
EXPORT_SYMBOL_GPL(ttm_backup_bytes_avail);
|
|
|
|
/**
|
|
* ttm_backup_shmem_create() - Create a shmem-based struct backup.
|
|
* @size: The maximum size (in bytes) to back up.
|
|
*
|
|
* Create a backup utilizing shmem objects.
|
|
*
|
|
* Return: A pointer to a struct file on success,
|
|
* an error pointer on error.
|
|
*/
|
|
struct file *ttm_backup_shmem_create(loff_t size)
|
|
{
|
|
return shmem_file_setup("ttm shmem backup", size, 0);
|
|
}
|