Performance Tuning on FromDual GmbH

Creating synthetic data sets for tuning SQL queries

oli.sennhauser@fromdual.com (Oli Sennhauser) — Fri, 02 Oct 2020 16:50:33 +0000

When it comes to SQL Query tuning with customers we often get the slow running SQL query and possibly, in good cases, also the table structure. But very often, for various reasons, we do not get the data.

Special MySQL and MariaDB trainings 2018 in English

oli.sennhauser@fromdual.com (Oli Sennhauser) — Wed, 06 Jun 2018 15:49:03 +0000

Due to a strong customer demand FromDual offers 2018 two extra MySQL/MariaDB trainings with its Training partner The Linuxhotel in Essen (Germany). Those trainings are in English.

MySQL single query performance - the truth!

oli.sennhauser@fromdual.com (Oli Sennhauser) — Fri, 13 Dec 2013 17:33:44 +0000

MySQL single query performance - the truth!

As suggested by morgo I did a little test for the same query and the same data-set mentioned in Impact of column types on MySQL JOIN performance but looking into an other dimension: the time (aka MySQL versions).

MariaDB and MySQL advanced training

oli.sennhauser@fromdual.com (Oli Sennhauser) — Wed, 16 Jan 2013 10:36:20 +0000

You are already familiar with the MySQL or MariaDB and you are challenged to operate a serious MySQL database. If this is the case this training is the right one for you.

What can MySQL performance monitoring graphs tell you?

oli.sennhauser@fromdual.com (Oli Sennhauser) — Thu, 16 Feb 2012 18:32:45 +0000

Many of you may monitor their databases for different purposes. Beside alerting it is often good to also make some graphs from MySQL performance counters to see what is actually happening on your database.

MySQL Monitoring solutions

oli.sennhauser@fromdual.com (Oli Sennhauser) — Sat, 13 Mar 2010 19:49:33 +0000

Basic solutions (CLI)

Those solutions are run from the command line (CLI):

MariaDB and MySQL Benchmarking

oli.sennhauser@fromdual.com (Oli Sennhauser) — Thu, 11 Mar 2010 23:29:59 +0000

Database Benchmark

sysbench (filesystems and OS/HW tests), Sysbench source, sysbench v0.5, sysbench scripts
OSDL Database Test Suite (download)
DBT2 (TPC-C, OLTP), DBT2 Benchmark Tool for MySQL
DBT3 (TPC-H, complex and long running queries, data warehouse (DWH))
TM1 (3^rd party, ODBC, telecom benchmark)
TPC Benchmarks
TPCC-mysql
db_STRESS
HammerDB
db_bench
Acronis perfkit (benchmark, benchmark-db)
Web3Bench (TiDB, MySQL written in Java/Python)
Finch (Finch is a MySQL benchmark tool developed for software engineers and modern infrastructures.)

General Benchmarking Tools

Apache JMeter: To test performance on static and dynamic resources (files, Servlets, Perl scripts, Java Objects, Data Bases and Queries, FTP Servers and more).
Gatling: Gatling is a highly capable load testing tool. It is designed for ease of use, maintainability and high performance.
Tsung: Open-source multi-protocol distributed load testing tool.
Slamd Java-based Distributed Load Generation Engine application designed for stress testing and performance analysis of network-based applications.
Grinder A Java load testing framework that makes it easy to run a distributed test using many load injector machines.
mysqlslap mysqlslap is a diagnostic program designed to emulate client load for a MySQL server and to report the timing of each stage. It works as if multiple clients are accessing the server.
bm
httperf
apachebench (ab)

CPU Benchmarking

CoreMark

Disk benchmarking

FIO
Filesystem Benchmark: IOzone, Bonnie
Harddisk-Benchmark: Bonnie++, Iometer

# bonnie -s 2047 -S 10000

Bonnie 1.4: File './Bonnie.12330', size: 2146435072, volumes: 1
Writing with putc()... done: 20440 kB/s 89.7 %CPU
Rewriting... done: 18940 kB/s 18.3 %CPU
Writing intelligently... done: 46256 kB/s 28.8 %CPU
Reading with getc()... done: 18771 kB/s 82.1 %CPU
Reading intelligently... done: 32549 kB/s 17.3 %CPU

 ---Sequential Output (nosync)--- ---Sequential Input-- --Rnd Seek-
 -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --10k (03)-
Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
master 1*2047 20440 89.7 46256 28.8 18940 18.3 18771 82.1 32549 17.3 183.6 1.5

with fsync

Transaction performance

oli.sennhauser@fromdual.com (Oli Sennhauser) — Mon, 12 Mar 2007 12:06:00 +0000

Transaction performance relates among other things from I/O performance. This means hard disk performance.

Do not trust other peoples benchmarks!

oli.sennhauser@fromdual.com (Oli Sennhauser) — Tue, 06 Apr 2021 13:26:06 +0200

Because they do NOT reflect your problems.

One of our customers upgraded last month from MariaDB 10.2 to MariaDB 10.5. In the same change he also converted all his data warehouse (DWH)/BI tables from MyISAM to Aria. An all this, naturally, without testing. And it miserably failed! And then we were under heavy time pressure to make things working again…

Performance Tuning on FromDual GmbH

Creating synthetic data sets for tuning SQL queries

Special MySQL and MariaDB trainings 2018 in English

MySQL single query performance - the truth!

MySQL single query performance - the truth!

MariaDB and MySQL advanced training

What can MySQL performance monitoring graphs tell you?

MySQL Monitoring solutions

Basic solutions (CLI)

MariaDB and MySQL Benchmarking

Table of Contents

Database Benchmark

General Benchmarking Tools

CPU Benchmarking

Disk benchmarking

Transaction performance

Do not trust other peoples benchmarks!