Database on FromDual GmbH

Partial physical database restore for MariaDB and MySQL

oli.sennhauser@fromdual.com (Oli Sennhauser) — Tue, 02 Jul 2024 18:13:47 +0000

What is it about?

When describing backup and restore scenarios, a full backup and a full restore of the database instance (mariadbd/mysqld) are usually assumed. This means that the entire database instance, including all databases (schemas), is backed up and restored.

Migration of your data from one database to another

oli.sennhauser@fromdual.com (Oli Sennhauser) — Thu, 17 Nov 2022 17:01:44 +0000

Before you consider migrating your data from MySQL to another database you have to know which objects have to be migrated.

Partial Restore of a Table into a MariaDB Galera Cluster

oli.sennhauser@fromdual.com (Oli Sennhauser) — Fri, 20 Nov 2020 15:08:29 +0000

In my former Blog Post Partial Table or Schema restore from mariabackup full backup we worked out the basics of a partial restore of a table into a MariaDB database instance.

Do not underestimate performance impacts of swapping on NUMA database systems

oli.sennhauser@fromdual.com (Oli Sennhauser) — Fri, 21 Jun 2019 09:26:59 +0000

If your MariaDB or MySQL database system is swapping it can have a significant impact on your database query performance! Further it can also slow down your database shutdown and thus influence the whole reboot of your machine. This is especially painful if you have only short maintenance windows or if you do not want to spend the whole night with operation tasks.

MariaDB and MySQL Benchmarking

oli.sennhauser@fromdual.com (Oli Sennhauser) — Thu, 11 Mar 2010 23:29:59 +0000

Database Benchmark

sysbench (filesystems and OS/HW tests), Sysbench source, sysbench v0.5, sysbench scripts
OSDL Database Test Suite (download)
DBT2 (TPC-C, OLTP), DBT2 Benchmark Tool for MySQL
DBT3 (TPC-H, complex and long running queries, data warehouse (DWH))
TM1 (3^rd party, ODBC, telecom benchmark)
TPC Benchmarks
TPCC-mysql
db_STRESS
HammerDB
db_bench
Acronis perfkit (benchmark, benchmark-db)
Web3Bench (TiDB, MySQL written in Java/Python)
Finch (Finch is a MySQL benchmark tool developed for software engineers and modern infrastructures.)

General Benchmarking Tools

Apache JMeter: To test performance on static and dynamic resources (files, Servlets, Perl scripts, Java Objects, Data Bases and Queries, FTP Servers and more).
Gatling: Gatling is a highly capable load testing tool. It is designed for ease of use, maintainability and high performance.
Tsung: Open-source multi-protocol distributed load testing tool.
Slamd Java-based Distributed Load Generation Engine application designed for stress testing and performance analysis of network-based applications.
Grinder A Java load testing framework that makes it easy to run a distributed test using many load injector machines.
mysqlslap mysqlslap is a diagnostic program designed to emulate client load for a MySQL server and to report the timing of each stage. It works as if multiple clients are accessing the server.
bm
httperf
apachebench (ab)

CPU Benchmarking

CoreMark

Disk benchmarking

FIO
Filesystem Benchmark: IOzone, Bonnie
Harddisk-Benchmark: Bonnie++, Iometer

# bonnie -s 2047 -S 10000

Bonnie 1.4: File './Bonnie.12330', size: 2146435072, volumes: 1
Writing with putc()... done: 20440 kB/s 89.7 %CPU
Rewriting... done: 18940 kB/s 18.3 %CPU
Writing intelligently... done: 46256 kB/s 28.8 %CPU
Reading with getc()... done: 18771 kB/s 82.1 %CPU
Reading intelligently... done: 32549 kB/s 17.3 %CPU

 ---Sequential Output (nosync)--- ---Sequential Input-- --Rnd Seek-
 -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --10k (03)-
Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
master 1*2047 20440 89.7 46256 28.8 18940 18.3 18771 82.1 32549 17.3 183.6 1.5

with fsync

MySQL Database Health Check

oli.sennhauser@fromdual.com (Oli Sennhauser) — Sat, 07 Nov 2009 22:13:39 +0000

Partial Table or Schema restore from mariabackup full backup

oli.sennhauser@fromdual.com (Oli Sennhauser) — Wed, 11 Nov 2020 21:59:19 +0100

For me it was for a long time not clear if a mariadb-backup full backup can be used to do partial table or schema restores. Now we faced this challenge with a customer. So time to try it out…

MyEnv for MySQL Multi-Database set-ups

oli.sennhauser@fromdual.com (Oli Sennhauser) — Sun, 14 Nov 2010 17:22:30 +0100

This week I showed one of my customers our MyEnv. He was very interested in it and suggested to make it known in public. In fact MyEnv is available for download already several years…