17.8.3.7 Excluding Buffer Pool Pages from Core Files (original) (raw)

17.8.3.7 Excluding Buffer Pool Pages from Core Files

A core file records the status and memory image of a running process. Because the buffer pool resides in main memory, and the memory image of a running process is dumped to the core file, systems with large buffer pools can produce large core files when the mysqld process dies.

Large core files can be problematic for a number of reasons including the time it takes to write them, the amount of disk space they consume, and the challenges associated with transferring large files.

To reduce core file size, you can disable theinnodb_buffer_pool_in_core_file variable to omit buffer pool pages from core dumps. Theinnodb_buffer_pool_in_core_file variable was introduced in MySQL 8.0.14 and is enabled by default.

Excluding buffer pool pages may also be desirable from a security perspective if you have concerns about dumping database pages to core files that may be shared inside or outside of your organization for debugging purposes.

Note

Access to the data present in buffer pool pages at the time the mysqld process died may be beneficial in some debugging scenarios. If in doubt whether to include or exclude buffer pool pages, consult MySQL Support.

Disablinginnodb_buffer_pool_in_core_file takes effect only if thecore_file variable is enabled and the operating system supports theMADV_DONTDUMP non-POSIX extension to themadvise() system call, which is supported in Linux 3.4 and later. TheMADV_DONTDUMP extension causes pages in a specified range to be excluded from core dumps.

Assuming the operating system supports theMADV_DONTDUMP extension, start the server with the --core-file and--innodb-buffer-pool-in-core-file=OFF options to generate core files without buffer pool pages.

$> mysqld --core-file --innodb-buffer-pool-in-core-file=OFF

The core_file variable is read only and disabled by default. It is enabled by specifying the--core-file option at startup. Theinnodb_buffer_pool_in_core_file variable is dynamic. It can be specified at startup or configured at runtime using aSET statement.

mysql> SET GLOBAL innodb_buffer_pool_in_core_file=OFF;

If theinnodb_buffer_pool_in_core_file variable is disabled but MADV_DONTDUMP is not supported by the operating system, or anmadvise() failure occurs, a warning is written to the MySQL server error log and thecore_file variable is disabled to prevent writing core files that unintentionally include buffer pool pages. If the read-onlycore_file variable becomes disabled, the server must be restarted to enable it again.

The following table shows configuration andMADV_DONTDUMP support scenarios that determine whether core files are generated and whether they include buffer pool pages.

Table 17.4 Core File Configuration Scenarios

The reduction in core file size achieved by disabling theinnodb_buffer_pool_in_core_file variable depends on the size of the buffer pool, but it is also affected by the InnoDB page size. A smaller page size means more pages are required for the same amount of data, and more pages means more page metadata. The following table provides size reduction examples that you might see for a 1GB buffer pool with different pages sizes.