当前位置: 首页 > news >正文

MySQL通用性能优化模板(MySQL General Performance Optimization Template)

MySQL通用性能优化模板

01

硬件优化

  • CPU:物理机上建议配置更高性能的CPU,不仅是核数越多越好,处理主频也是越高越好。生产环境建议配置不低于8 Cores的CPU;

  • MEM:建议配置更大的物理内存,生产环境建议配置不低于8 GB的物理内存;

  • DISK:建议使用更好的物理I/O设备,配置更高物理IOPS性能的设备,如SSD;

  • NET:如果是构建构建MGR集群,建议使用不低于千兆网络的条件。条件允许的话建议使用万兆网络。

  • 02

操作系统优化

  • 1. 采用XFS文件系统,保证在高I/O负载情况下IOPS的性能及稳定性

mkfs.xfs -f -L /mysql /dev/sdb
  • 2. 关闭SWAP交换分区,避免使用SWAP造成数据库性能急剧下降;

echo "vm.swappiness=0" >> /etc/sysctl.confsysctl -pswapoff -a
  • 3. 关闭透明大页,避免内存碎片化严重时分配透明大页页面出现较高延迟,从而影响性能;

echo never > /sys/kernel/mm/transparent_hugepage/enabledecho never > /sys/kernle/mm/transparent_hugepage/defragcat /sys/kernle/mm/transparent_hugepage/enabled
  • 4. 调整数据库分区的I/O Scheduler为noop或deadline;

echo 'noop' > /sys/block/sdb/queue/schedulercat /sys/block/sdb/queue/scheduler
  • 5. 确认CPU性能模式为高性能模式;

cpupower frequency-info --policy# 预期输出是:The governor "performanace",代表高性能模式
  • 6. 确认NUMA模式;

针对X86架构的CPU,建议关闭NUMA;针对ARM架构的CPU,如果单台服务器上运行多个实例,建议开启NUMA提升性能。cat /etc/default/grub
  • 7. 优化系统内核参数、调整用户资源使用上限;

# 调整内核参数echo "fs.file-max = 1000000" >> /etc/sysctl.confecho "vm.overcommit_memory = 1" >> /etc/sysctl.confecho "net.core.somaxconn = 32768" >> /etc/sysctl.confecho "net.ipv4.tcp_syncookies = 0" >> /etc/sysctl.confsysctl -p
# 调整用户资源使用上线mysql           soft    nofile         65535mysql           hard    nofile         65535mysql           soft    stack          32768mysql           hard    stack          32768mysql           soft    nproc          65535mysql           hard    nproc          65535
  • 8. 安装常用系统辅助工具包。

yum -y install net-tools perf sysstat iotop tmux strace
cat /etc/my.cnf# 32C 64G 服务器 mysql配置文件参考[client]port = 3306socket = /mysql/mysql.sock[mysqld]user = mysqlport = 3306server_id = 1basedir = /usrdatadir = /mysql/datasocket = /mysql/mysql.sockpid-file = /mysql/mysql.pidcharacter-set-server = UTF8MB4skip_name_resolve = 1default_time_zone = "+8:00"bind_address = "0.0.0.0"
#performance setttingslock_wait_timeout = 3600open_files_limit = 65535back_log = 1024max_connections = 1024max_connect_errors = 1000000table_open_cache = 2048table_definition_cache = 2048sort_buffer_size = 4Mjoin_buffer_size = 4Mread_buffer_size = 8Mread_rnd_buffer_size = 4Mbulk_insert_buffer_size = 64Mthread_cache_size = 768interactive_timeout = 600wait_timeout = 600tmp_table_size = 96Mmax_heap_table_size = 96Mmax_allowed_packet = 64Mnet_buffer_shrink_interval = 180#GIPKloose-sql_generate_invisible_primary_key = ON
#log settingslog_timestamps = SYSTEMlog_error = /data/errlog/error.loglog_error_verbosity = 3slow_query_log = 1log_slow_extra = 1slow_query_log_file = /mysql/slowlog/slow.log#设置slow log文件大小1G及总文件数10max_slowlog_size = 1073741824max_slowlog_files = 10long_query_time = 3log_queries_not_using_indexes = 1log_throttle_queries_not_using_indexes = 60min_examined_row_limit = 100log_slow_admin_statements = 1log_slow_replica_statements = 1log_slow_verbosity = FULLlog_bin = /data/binlog/binlogbinlog_format = ROWsync_binlog = 1binlog_cache_size = 4Mmax_binlog_cache_size = 6Gmax_binlog_size = 1G#控制binlog总大小,避免磁盘空间被撑爆binlog_space_limit = 500Gbinlog_rows_query_log_events = 1binlog_expire_logs_seconds = 604800binlog_checksum = CRC32binlog_order_commits = OFFgtid_mode = ONenforce_gtid_consistency = TRUE
#myisam settingskey_buffer_size = 32Mmyisam_sort_buffer_size = 128M
#replication settingsrelay_log_recovery = 1replica_parallel_type = LOGICAL_CLOCK#并行复制线程数可以设置为逻辑CPU数量的2倍replica_parallel_workers = 64binlog_transaction_dependency_tracking = WRITESETreplica_preserve_commit_order = 1replica_checkpoint_period = 2
#mgr settingsloose-plugin_load_add = 'mysql_clone.so'loose-plugin_load_add = 'group_replication.so'loose-group_replication_group_name = "aaaaaaaa-aaaa-aaaa-aaaa-aaaaaaaaaaa1"#MGR本地节点IP:PORTloose-group_replication_local_address = "192.168.56.11:33061"#MGR集群所有节点IP:PORTloose-group_replication_group_seeds = '192.168.56.11:33061,192.168.56.12:33061,192.168.56.13:33061'loose-group_replication_start_on_boot = ONloose-group_replication_bootstrap_group = OFFloose-group_replication_exit_state_action = READ_ONLYloose-group_replication_flow_control_mode = "QUOTA"loose-group_replication_single_primary_mode = ONloose-group_replication_enforce_update_everywhere_checks = 0loose-group_replication_communication_max_message_size = 10Mreport_host = 192.168.56.11report_port = 3306
#innodb settingsinnodb_buffer_pool_size = 16Ginnodb_buffer_pool_instances = 8innodb_data_file_path = ibdata1:12M:autoextendinnodb_flush_log_at_trx_commit = 1innodb_log_buffer_size = 32Minnodb_log_file_size = 2Ginnodb_log_files_in_group = 3innodb_redo_log_capacity = 6Ginnodb_doublewrite_files = 2innodb_max_undo_log_size = 4G# 根据您的服务器IOPS能力适当调整# 一般配普通SSD盘的话,可以调整到 10000 - 20000# 配置高端PCIe SSD卡的话,则可以调整的更高,比如 50000 - 80000innodb_io_capacity = 4000innodb_io_capacity_max = 8000innodb_open_files = 65534# 当需要用CLONE加密特性时,不要选用O_DIRECT模式,否则会比较慢innodb_flush_method = O_DIRECTinnodb_lru_scan_depth = 4000innodb_lock_wait_timeout = 10innodb_rollback_on_timeout = 1innodb_print_all_deadlocks = 1innodb_online_alter_log_max_size = 4Ginnodb_print_ddl_logs = 1innodb_status_file = 1innodb_status_output = 0innodb_status_output_locks = 1innodb_sort_buffer_size = 64Minnodb_adaptive_hash_index = 0innodb_numa_interleave = OFFinnodb_spin_wait_delay = 20innodb_print_lock_wait_timeout_info = 1#自动杀掉超过5分钟不活跃事务,避免行锁被长时间持有kill_idle_transaction = 300#异步清理大表innodb_data_file_async_purge = ON
#innodb monitor settings#根据实际需要开启,会影响数据库性能,但有利于故障诊断和性能优化#innodb_monitor_enable = "module_innodb,module_server,module_dml,module_ddl,module_trx,module_os,module_purge,module_log,module_lock,module_buffer,module_index,module_ibuf_system,module_buffer_page,module_adaptive_hash"#pfs settingsperformance_schema = 1#performance_schema_instrument = '%memory%=on'performance_schema_instrument = '%lock%=on'

相关文章:

  • Kafka简介
  • Maven 依赖坐标与BOM统一管理
  • ERR_SSL_KEY_USAGE_INCOMPATIBLE
  • Ubuntu18.04 升级最新版本Cmake
  • kaggle网站使用教程
  • 2025.04.23华为机考第三题-300分
  • JVM 生产环境问题定位与解决实战(七):实战篇——OSSClient泄漏引发的FullGC风暴
  • 网络原理————HTTP
  • ReAct Agent 实战:基于DeepSeek从0到1实现大模型Agent的探索模式
  • 【每天一个知识点】如何解决大模型幻觉(hallucination)问题?
  • Keras
  • Java与C语言核心差异:从指针到内存管理的全面剖析
  • 用 Firebase 和 WebRTC 快速搭建一款浏览器视频聊天应用
  • 线段树讲解(小进阶)
  • 基于UDP协议的群聊服务器开发(C/C++)
  • 深度解析算法之模拟
  • 第十五届蓝桥杯 2024 C/C++组 合法密码
  • C++学习之游戏服务器开发十五QT登录器实现
  • 在C#串口通信中,一发一收的场景,如何处理不同功能码的帧数据比较合理,代码结构好
  • vue | 不同 vue 版本对复杂泛型的支持情况 · vue3.2 VS vue3.5
  • 科普|结石疼痛背后的危机信号:疼痛消失≠警报解除
  • 融入长三角一体化发展,苏南名城镇江的优势和机遇何在
  • 福特中国CFO:依然坚信中国市场,上海帮助公司吸引到人才
  • 科普书单·新书|鸟界戏精观察报告
  • 人民日报刊文:美国滥施关税及中国反制措施的法理视角透析
  • 沉浸式表演+窥探式观演,《情人》三登人艺实验剧场