MySQL每12-18小时100%CPU

时间:2018-11-14 16:54:44

标签: mysql database windows innodb database-performance

我继承了Windows Server(2016),我们拥有一个不是我编写的专有软件,它使用MySQL数据库。我是SQL的新手。

有些客户端软件会在一整天内随机连接到服务器。根据我们的忙碌程度,全天将有10到200台不同的计算机登录到该服务器。

我们使用的VPS带有4个虚拟内核,8GB的RAM和204GB的本地磁盘。

似乎每隔12-18个小时我们就会遇到软件挂起的问题,然后任务管理器会显示mysqld的99-100%CPU使用率

直到我强制退出软件然后重新启动mysql服务后,它才能再次正常运行。

这是我之前跟踪的设置文件。

my.ini设置:

[client]
port=3306
[mysql]
no-beep=
default-character-set=utf8
[mysqld]
port=3306
datadir=C:/ProgramData/MySQL/MySQL Server 5.7\Data
character-set-server=utf8
default-storage-engine=INNODB
sql-mode="STRICT_TRANS_TABLES,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION"
log-output=FILE
general-log=0
general_log_file="xyz.log"
slow-query-log=1
slow_query_log_file="xyz-slow.log"
long_query_time=10
log-error="xyz.err"
server-id=1
secure-file-priv="C:/ProgramData/MySQL/MySQL Server 5.7/Uploads"
max_connections=151
table_open_cache=2000
tmp_table_size=249M
thread_cache_size=10
myisam_max_sort_file_size=100G
myisam_sort_buffer_size=486M
key_buffer_size=8M
read_buffer_size=64K
read_rnd_buffer_size=256K
innodb_flush_log_at_trx_commit=1
innodb_log_buffer_size=1M
innodb_buffer_pool_size=8M
innodb_log_file_size=48M
innodb_thread_concurrency=13
innodb_autoextend_increment=64
innodb_buffer_pool_instances=8
innodb_concurrency_tickets=5000
innodb_old_blocks_time=1000
innodb_open_files=300
innodb_stats_on_metadata=0
innodb_file_per_table=1
innodb_checksum_algorithm=0
back_log=80
flush_time=0
join_buffer_size=256K
max_allowed_packet=4M
max_connect_errors=100
open_files_limit=4161
sort_buffer_size=256K
table_definition_cache=1400
binlog_row_event_max_size=8K
sync_master_info=10000
sync_relay_log=10000
sync_relay_log_info=10000

这里是Windows的MySQLTuner的图片,其结果是: mysql_tuner

只需寻找对我们可以在此处采取的措施以缓解此问题的一些见解。看来我们需要运行OPTIMIZE来修复表的碎片。

它还显示了0缓存的23M选择。

innodb数据大小/缓冲池为687M / 8M

任何帮助将不胜感激。

[编辑]

我刚刚运行了在另一个线程中找到的以下命令:

SELECT CEILING(Total_InnoDB_Bytes*1.6/POWER(1024,3)) RIBPS FROM
(SELECT SUM(data_length+index_length) Total_InnoDB_Bytes
FROM information_schema.tables WHERE engine='InnoDB') A;

我的返回值为2,所以我应该设置innodb_buffer_pool_size=2G吗?

SET GLOBAL innodb_buffer_pool_size=2*1024*1024*1024;
会没事的。您有8GB的计算机。我将花一些时间让MySQL动态地实现此目的。用SELECT @@innodb_buffer_pool_size;检查30分钟,看看它是否完成了您的动态请求。

这是SHOW CREATE TABLE的配方:

mysql> USE xyz; SHOW CREATE TABLE recipes;
Database changed
+---------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Table   | Create Table                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
+---------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| recipes | CREATE TABLE `recipes` (
  `id` int(11) NOT NULL,
  `name` varchar(64) NOT NULL,
  `dname` varchar(64) NOT NULL DEFAULT '',
  `descrpara` text NOT NULL,
  `category` varchar(32) NOT NULL,
  `costperserving` float NOT NULL DEFAULT '0',
  `batchsize` int(11) NOT NULL DEFAULT '1',
  `servname` varchar(32) NOT NULL DEFAULT 'Serving',
  `rectype` tinyint(4) NOT NULL DEFAULT '0',
  `servweight` float NOT NULL DEFAULT '0',
  `servflvol` float NOT NULL DEFAULT '0',
  `flags` tinyint(4) NOT NULL DEFAULT '0',
  `isapproved` tinyint(4) NOT NULL DEFAULT '0',
  `isapproved2` tinyint(4) NOT NULL DEFAULT '0',
  `tags` varchar(128) NOT NULL DEFAULT '',
  `allrestr` tinyint(4) NOT NULL DEFAULT '0',
  `numsides` tinyint(4) NOT NULL DEFAULT '0',
  `utensils` varchar(64) NOT NULL DEFAULT '',
  `active` tinyint(4) NOT NULL DEFAULT '1',
  PRIMARY KEY (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=latin1 |
+---------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
1 row in set (0.00 sec)

再次,我是超级新手,但是在my.ini文件中是否可以显示默认字符集utf8的地方,但是其中却显示了latin1?

我会在24小时后再次更新

PasteBin链接

SHOW GLOBAL STATUS

SHOW GLOBAL VARIABLES

SHOW ENGINE INNODB STATUS


超过1天的正常运行时间后,

MySQLTuner。这也是在将innodb_buffer_pool_size = 8M更改为1G之后。从那以后,mysqld的总RAM使用量约为1.25G。

MySQL Tuner 0.8.3 - Peter Chapman <peter@conglomo.co.nz>
Performing tests on localhost:3306 at Friday, 16 November 2018 6:13:41 AM
Currently running supported MySQL version 5.7.24-log
Archive Engine Installed
Berkeley DB Engine Not Installed
Federated Engine Not Installed
InnoDB Engine Installed
ISAM Engine Not Installed
NDBCLUSTER Engine Not Installed
Data in InnoDB tables: 687M (Tables: 257)
Data in MyISAM tables: 6M (Tables: 32)
Total fragmented tables: 67
All database users have passwords assigned
Up for: 1d 10h 33m 15s (49M q [397.000 qps], 38K conn, TX: 43G, RX: 3G)
Reads / Writes: 99% / 1%
Total buffers: 1.0G global + 1.1M per thread (151 max threads)
Maximum possible memory usage: 1.2G (14% of installed RAM)
Slow queries: 1% (4/49M)
Highest usage of available connections: 26% (38/151)
Key buffer size / total MyISAM indexes: 8.0M/1.0M
Key buffer hit rate: 98% (630 cached / 9 reads)
Query cache efficiency: 0% (0 cached / 47M selects)
Query cache prunes per day: 0
Sorts requiring temporary tables: 1% (2K temp sorts / 377K sorts)
Joins performed without indexes: 13254
Temporary tables created on disk: 3% (2K on disk / 79K total)
Thread cache hit rate: 99% (41 created / 38K connections)
Table cache hit rate: 26% (2K open / 7K opened)
Open file limit used: 0% (10/6K)
Table locks acquired immediately: 100% (682 immediate / 682 locks)
InnoDB data size / buffer pool: 687.0M/1.0G
Run OPTIMIZE TABLE to defragment tables for better performance
Adjust your join queries to always utilize indexes
query_cache_limit (> 1M, or use smaller result sets)
join_buffer_size (> 256.0K, or always use indexes with joins)
Scan Completed at Friday, 16 November 2018 6:13:44 AM

SHOW GLOBAL STATUS - > 1 day uptime

SHOW GLOBAL VARIABLES - > 1 day uptime

2 个答案:

答案 0 :(得分:0)

建议立即寻求救济

SET GLOBAL innodb_buffer_pool_size=1*1024*1024*1024

在您的MySQL命令提示符下

将为您带来与众不同的世界,并可能让您在整理其他细节的同时生存下来。

为下一次停止/启动服务将my.ini [mysqld]部分更改为1G。

答案 1 :(得分:0)

有关my.ini [mysqld]部分的其他建议 每秒速率= RPS

innodb_buffer_pool_size=2G  # from 1G reported in SHOW GLOBAL STATUS of 11/16
innodb_lru_scan_depth=100  # from 1024 to conserve CPU cycles every SECOND
thread_cache_size=100  # from 10 to increase threads_cached for increased performance
innodb_io_capacity=1600  # from 200 to allow higher IOPS 
read_rnd_buffer_size=192K  # from 256K to reduce handler_read_rnd_next RPS of 63407
innodb_log_buffer_size=16M  # from 1M for ~ 30 minutes in RAM before WD
open_files_limit=8192  # from 6209 to reduce opened_files RPHour of 152
table_open_cache=3000  # from 2000 to reduce opened_tables RPHour of 258
query_cache_size=0  # from 1M to conserve RAM since QC is OFF

有关其他帮助,请查看我的个人资料,网络个人资料以获取联系信息。

如果您添加评论,请以@wilsonhauck开头,以便SO自动提醒我。