Feed Aggregator

[http://www.blogger.com/profile/09563736552283458282 Leandro] said…

Not to mention that sysstat also includes “sar”, which is one of the best tools to record system resource usage history! :)

[http://www.blogger.com/profile/11195863756524022642 Shinguz] said…

Hi Brian,

Thanks for the hint. Just added it!

HNY, Oli

[http://www.blogger.com/profile/10147638743111625798 Brian Moon] said…

You forgot:

emerge -avq sysstat

Gentoo 4tw!! =)

iostat is a very handy tool to help you investigating what kind of performance problems you have. Especially your databases can cause a lot of troubles to your I/O system and thus it would be very nice if every DBA has installed iostat on all of his MySQL database servers.

Unfortunately most of the Linux distributions do NOT install iostat by default. This causes often unfortunate situations when you are in a MySQL consulting engagement or have a MySQL support case and ask the customer for the output of iostat. In some cases they are not willing or allowed to install iostat on their production systems on the fly (even though I never have seen it causing troubles during or after the installation).

Further iostat is also not too easy to find because is is hidden in the sysstat package. But iostat can be easily post-installed as follows:

shell> sudo apt-get install sysstat
shell> yum install sysstat
shell> rpm -i sysstat-<version>.rpm
shell> dpkg -i sysstat-<version>.deb
shell> emerge …

Open job offers

We currently have no job opportunities open. If you are interested to work for FromDual leave us a note and we will inform you about our future job offerings…

Old job offers

MySQL DBA for FromDual Support Line (open until September 30^th 2015)!

MySQL DBA for FromDual Support Line (open until January 31^st 2014)

MySQL DBA for FromDual Support Line (open until May 31^st 2013)

FromDual delivers neutral and vendor independent on-site consulting services on MariaDB, MySQL, Galera Cluster and Percona Server. Our experienced consultants recommend you the best solutions fitting to your needs.

We help you in delicate matters as:

• Getting the maximum out of your current hardware through Performance Tuning and SQL Query Tuning by adding indexes where necessary.
• Evaluating more advanced Database Architectures like Master/Slave Replication or synchronous multi-Master Replication with Galera to reach your goals for the near and far future.
• Reviewing your Backup Concepts and implementing it in a way it also works when you need it (= restore).
• Check your Database Design and suggest changes if necessary.
• Upgrading your database to recent releases and Migrating your data to MariaDB, MySQL, Galera Cluster or Percona Server.
• Designing Scale-Out Architectures with Replication, Clustering or Sharding.

If you prefer remote consultancy services we recommend you our remote-DBA services for MariaDB and …

FromDual Performance Monitor

The FromDual Performance Monitor is a monitoring solution for MariaDB, Galera Cluster, MySQL, Percona Server and PostgreSQL databases.

It is based on the monitoring solution Zabbix.

The FromDual Performance Monitor supports monitoring the following MariaDB/MySQL storage engines: InnoDB, Aria and MyISAM.

Further you can monitor:

• Galera Cluster topologies
• Master/Slave replication topoligies
• Unix processes (mariadbd/mysqld)
• MariaDB/MySQL/Percona server specific information
• etc.

More details you can find here.

Have also a look at the Performance Monitor Documentation.

FromDual Ops Center

FromDual Ops Center is a graphical user interface (GUI) to operated centralized MariaDB, MySQL or PostgreSQL instances on different machines.

This includes also complex topologies like Master/Slave or Galera cluster set-ups.

More details you can find here.

Have also a look at the Ops Center Documentation.

FromDual Backup and Recovery Manager

FromDual Backup and Recovery Manager is command line tool …

You can get in contact with us as follows:

FromDual GmbH (LLC) is a Swiss company founded in February 2010 by its CEO Oli Sennhauser to provide neutral and vendor independent consulting, support and training services for MariaDB and MySQL users.

Our engineers cover different flavours of MySQL like Galera Cluster, MariaDB, MySQL/Oracle and Percona Server.

Our main products and services are:

• Consulting, Support and Training for MySQL and its derivatives.
• Consulting, Support and Training for Galera Cluster.
• FromDual’s Performance Monitor for MySQL (mpm).
• Monitoring as a Service (MaaS) for MySQL.

FromDual customers range from world wide acting global players to small Internet start-ups in branches like Telecommunication and VoIP, e-Commerce, ERP, Hosting, Financial Services, e-Marketing, Tourism, Education, etc.

FromDual is Oracle Silver Partner, Open Database Alliance (ODBA) Silver Partner and Service Partner of Codership for Galera Cluster for MySQL.

Neutral and vendor independent
MariaDB, Galera Cluster, MySQL and Percona Server
Consulting and Services!

MariaDB/MySQL Consulting

You get neutral and vendor independent on-site Consulting for MariaDB, MySQL, Galera Cluster and Percona Server without the need of a support contract or a subscription. Our consultants recommend you the best solutions fitting to your needs.

Learn more about our MariaDB/MySQL Consulting…

Training for MySQL and MariaDB

When you need a Training for MariaDB or MySQL, we teach you specifically according to your needs. If it is about the SQL basics, about how to install or upgrade MariaDB or MySQL, how to do Backup/Recovery properly or how to tune your database performance does not matter.

Learn more about our MariaDB/MySQL Trainings…

MariaDB/MySQL remote-DBA Services

If you do not want to operate your databases yourself or if you need assistance in running your MySQL database properly we offer you our Remote-DBA services. The work is performed over ssh or other screen …

[http://www.blogger.com/profile/11195863756524022642 Shinguz] said…

Hi Roland,

Ups! It seems like I did not look into it well enough… :( Thanks for your hint!

Just found the [http://www.mysqludf.org/ UDF repository] on your site. Great stuff…

Windows? What is this? No honestly: I did not try this out. There is no such system close to me nor have I a Win compiler or such stuff… Sorry!

[http://www.blogger.com/profile/13365137747952711328 Roland Bouman] said…

Hi there,

I did this too once (http://rpbouman.blogspot.com/2008/07/writing-to-mysql-error-log.html)

I’m just wondering, does your implementation work in case you’re running under windows as a service (bug #35916) ?

I really like this new toy (for me) called UDF. So I try to provide some more, hopefully useful, functionality.

The newest extension I like is the possibility to write to the MySQL error log through the application. Oracle can do that since long. Now we can do this as well…

A list of what I have done up to now you can find here:

• Query and change InnoDB spin_wait_delay: udf_spin_wait_delay-5.1.30-linux-i686-glibc23.so (md5 807c6bc09b5dc88a8005788519f2483a, BIN … kbyte)
• Send message to the MySQL error log: udf_log_error-5.1.30-linux-i686-glibc23.so (md5 dc8ef3e91cf6dec84ab3ad95626ec9b5, BIN … kbyte)
• …

If you have some more suggestions, please let me know.

The complete details you can find here.

[http://www.blogger.com/profile/11195863756524022642 Shinguz] said…

I was told that spin_wait_delay is exposed to public with the InnoDB pluggable storage engine 1.0.4. Seems I have to look for an other hidden variables now. :)

[http://www.blogger.com/profile/11195863756524022642 Shinguz] said…

Hi Papagnome,

You are absolutely right, UDF’s came in in 3.23 already (I was told). What was in my mind was more the pluggable stuff. This feature is very nice an pretty new. But somehow I did not manage to express what I wanted to… :)

Regards, Oli

[http://www.blogger.com/profile/04939369461678423022 papagnome] said…

Just FWIW, UDFs existed in 4.1 and I’m pretty sure in 4.0 as well.

Thanks for the nice writeup!

[http://www.blogger.com/profile/11195863756524022642 Shinguz] said…

Hi Mark,

Thanks a lot for your feedback. And how is the correct way to make it version IN-dependent and thus better portable?

[http://www.blogger.com/profile/15864507044869250062 Mark Robson] said…

I also tried to use mysql UDFs to call internal MySQL APIs. It works.

All you really have to do is include the relevant headers, call the appropriate functions, and it just works.

But it is a bit dangerous, as your compiled UDF will then be dependent on the ‘‘’exact’’’ MySQL version that you’re using.

In one of my previous posts I was writing about how to read other processes memory
[ 1
]. As an example I tried to get the value of the hard coded MySQL internal InnoDB variable spin_wait_delay (srv_spin_wait_delay).

In this example we were using gdb or the operating system ptrace function to retrieve this value. This method has the disadvantage that it is pretty invasive.

When I was working on a customer support case I had the idea to solve this by the much less invasive method of User-Defined Functions (UDF).

UDF were introduced in MySQL 3.23
[ 2
]. They provide the feasibility to enlarge the MySQL functionality by adding external code.

The clue is now that you also can use this external code to do some MySQL internal stuff.

My idea was now, instead of using gdb/ptrace to get the value of spin_wait_delay, to write and UDF to get and set this value.

The code for the UDF looks as follows:

/*

  CREATE FUNCTION spin_wait_delay
  RETURNS INTEGER SONAME "udf_spin_wait_delay.so";
  SELECT …