MySQL Tech-Feed (en)

Sparse files

Shinguz - Fri, 2008-01-18 13:21

What is a sparse file?

“A sparse file is a file where space has been allocated but not actually filled with data. These space is not written to the file system. Instead, brief information about these empty regions is stored, which takes up much less disk space. These regions are only written to disk at their actual size when data is written to them. The file system transparently converts reads from empty sections into blocks filled with zero bytes at runtime.”
[ 1
]

In other words: Files are not …


Taxonomy upgrade extras:  English  Sparse Files 

Ranking in MySQL results

Shinguz - Fri, 2008-01-18 12:06

A friend of me asked me long time ago: “How can I have a ranking on a result with MySQL?”. Now I found some time to write it down:

Lets do first some preparation for the example:

CREATE TABLE sales (
  id     INT UNSIGNED NOT NULL AUTO_INCREMENT PRIMARY KEY
, fruit  VARCHAR(32)
, amount DECIMAL
);

INSERT INTO sales
VALUES (NULL, 'apple', 12.75), (NULL, 'orange', 1.89), (NULL, 'pear', 19.23)
     , (NULL, 'banana', 4.25), (NULL, 'cherry', 123.75), (NULL, 'plum', 23.15)
;

Now lets query:

SELECT …

Taxonomy upgrade extras:  Mysql  Ranking  Result 

MySQL logon trigger

Shinguz - Fri, 2007-05-25 17:06

With MySQL 5.0 the database provides trigger functionality on INSERT, REPLACE, UPDATE and DELETE.

Those of you who know some other RDBMS know, that there are also some system events where one would like to have triggers.

Unfortunately MySQL does not (yet) provide such functionality. This is sad because as database administrator this would be sometimes very helpful.

But you can build your own LOGON and STARTUP trigger.

MySQL provides some hooks for these events…

Complete Story (PDF 160 kbyte).


Taxonomy upgrade extras:  English  Mysql  Logon Trigger  Trigger  Login Trigger  Audit 

MySQL Cluster restore

Shinguz - Thu, 2007-03-22 19:05

Recently the question came up if it is faster to restore a MySQL cluster when all nodes are up or only ONE node from each node group during restore.

The answer from our gurus was: All nodes up during restore! I wanted to find out why. So I set up the following cluster and started to measure:

MySQL Cluster set up

Cluster set-up

MySQL Cluster backup

The backup is not that interesting. But I made the drawing for possible future use :-) :

Backup

MySQL Cluster restore

For the restore there are 4 different ways thinkable:

  • Restore …

Taxonomy upgrade extras:  English  Backup  Restore  Recovery  Mysql  Cluster 

MyEnv (MySQL and MariaDB BasEnv)

Shinguz - Tue, 2007-03-20 17:14

What is MyEnv?

MyEnv is a tool to run several MySQL or MariaDB database instances on ONE host. You can even run multiple database instances with different binary versions. We call this multi-instance set-ups.

With MyEnv a multi-instance set-up is more comfortable to handle than with mysqld_multi (old) or Systemd services (new) and it provides more useful functionality.

Using MyEnv does not need the use of the root user to operate MySQL and MariaDB database instances. Thus it is appropriate for classical …


Taxonomy upgrade extras:  Environment  Virtualization  Consolidation  Multi Instance  Saas  Myenv  License  Container  Docker 

MySQL Active - Active Clustering

Shinguz - Tue, 2007-03-13 12:06

It is possible to use an active - active shared-disk cluster in MySQL in some cases. For doing this you have to fulfill the following requirements:

  • Works with MyISAM tables only.
  • POSIX-locking compliant cluster file system on the device (such as OCFS2 or GFS).
  • External locking must be enabled.
  • The MySQL query cache must be turned off.
  • The MySQL delay key write must be turned off.
  • OS where file locking is supported in MySQL.

External Locking

Interested? To read more, follow the link: MySQL active - active Cluster (PDF 157 …


Taxonomy upgrade extras:  English  Mysql  Performance  Active-Active Clustering  Cluster 

Transaction performance

Shinguz - Mon, 2007-03-12 12:06

Transaction performance relates among other things from I/O performance. This means hard disk performance.

Hard disk performance

When you select a hard disk, an important feature to consider is the performance (speed) of the drive. Hard disks come in a wide range of performance capabilities. As is true of many things, one of the best indicators of a drive’s relative performance is its price. An old saying from the automobile-racing industry is appropriate here: “Speed costs money. How fast do you want …


Taxonomy upgrade extras:  English  Performance Tuning  Performance  Transaction 

Round-Robin Database Storage Engine (RRD)

Shinguz - Sat, 2007-03-03 13:29

In a round-robin database (RRD) usually time-series data like network bandwidth, temperatures, CPU load etc. is stored. The data is stored in the way that system storage footprint remains constant over time. This avoids resource expensive purge jobs and reduces complexity.

RRD

MySQL does NOT yet provide this kind of storage engine. Although some people were thinking about and some prototypes exists.

Nevertheless in this paper it is shown how you can build your own RRD tables: Round-Robin Database Storage …


Taxonomy upgrade extras:  English  Mysql  Storage Engine  Rrd  Round-Robin Database 

SATA Flash Solid State Disk up to 160 Gbyte announced!

Shinguz - Mon, 2007-02-26 09:33

The price for a 160 Gbyte disk will be around USD 15'000. This is still a bit expensive. But the access time is around 0.5 ms (both for reading and writing) which is around 10 times faster than a normal 15'000 rpm SCSI disk! The disk has NO cache because it is a cache itself (according to the supplier. Maybe this will change in the future). And the lifetime of a cell is > 5 mio writes. For the same performance one needs usually an array of around 10 disks. If your database is heavily write-I/O bound you …


Taxonomy upgrade extras:  English  Performance  Sata  Flash  Solid State Disk 

MySQL Multi-Master - Single-Slave - Replication

Shinguz - Thu, 2006-12-21 16:39

MySQL provides its replication for High Availability (HA) and for read Scale-out. Generally it is known that in a MySQL replication you can only replicate from one Master to many slaves. In this paper it is shown how a set-up can look like to replicate from two masters to one slave.

Caution: Handle this information with care!!!


Taxonomy upgrade extras:  Multi-Master  Slave  Replication  Multi-Source 

Profiling MySQL with oprofile

Shinguz - Tue, 2006-11-07 20:24

Probably the answer to this question is already known. But we want to prove it and by the way learn to deal with MySQL and oprofile.


Taxonomy upgrade extras:  English  Mysql  Profiling  Oprofile 

Materialized Views (MV) with MySQL

Shinguz - Mon, 2006-11-06 20:22

Materialised View (MV) is the pre-calculated (materialised) result of a query. Unlike a simple VIEW the result of a Materialised View is stored somewhere, generally in a table. Materialised Views are used when immediate response is needed and the query where the Materialised View bases on would take to long to produce a result. Materialised Views have to be refreshed once in a while. It depends on the requirements how often a Materialised View is refreshed and how actual its content is. Basically a …


Taxonomy upgrade extras:  Mysql  View  Performance  Materialized Views  Materialised Views 

Pittfalls with Federated Tables

Shinguz - Thu, 2006-11-02 20:22

A Federated Table is a table which points to a table in an other MySQL database instance (mostly on an other server). It can be seen as a view to this remote database table. Other RDBMS have similar concepts for example database links.

Read more about the pittfalls with MySQL Federated Tables


Taxonomy upgrade extras:  English  Pittfalls  Federated Tables  Federated Storage Engine 

Some more MySQL tools added

Shinguz - Wed, 2006-11-01 20:21

We have added some more tools to our MySQL consulting tools collection.


Taxonomy upgrade extras:  Mysql  Tool  Consulting  Tools  Mysql-Consulting 

Some more benchmarks added

Shinguz - Wed, 2006-11-01 20:20

We have added some more database benchmarks to our collection.

More details you can find on our Benchmarking page.


Taxonomy upgrade extras:  English  Mysql  Benchmark  Tool 

MySQL storage engines

Shinguz - Thu, 2006-10-19 22:19

One of the big advantages of MySQL is its concept of pluggable Storage Engines (SE). This means you can choose the most optimal storage engine for your needs. This also has a disadvantage: You have to know what you are doing…

More details you can find here: MySQL pluggable Storage Engines (SE).


Taxonomy upgrade extras:  English  Mysql  Storage Engine 

Full-Text Search Engines

Shinguz - Thu, 2006-10-19 22:19

MySQL has also a Full-Text Search Engine built in. But this Search Engine is not as fast a you probably want to. Thus there are some alternative Full-Text Search Engines which might be working together with MySQL.

More information

Who uses what Full-Text Search Engine …


Taxonomy upgrade extras:  English  Full-Text  Search  Engine  Sphinx  Lucene 

Stealthy migrating MySQL tables and MySQL data access interfaces using enlarged updateable VIEW functionality

Shinguz - Tue, 2006-10-03 22:18

Applications occasionally require redesign. However, redesigning an application cannot be done in one step because the application is distributed or several versions of applications must be supported. MySQL 5.0 provides the necessary means to stealthy migrate your data. In a short overview let’s look at what we plan to do: Stealthy Migration (PDF 98.7 kByte).


Taxonomy upgrade extras:  English  Mysql  Migration  Table  Data  Access  Interface  View 

Shinguz - Mon, 0001-01-01 00:00

Taxonomy upgrade extras: 

Pages

Subscribe to FromDual aggregator - MySQL Tech-Feed (en)