Log in

No account? Create an account

"Looking for MySQL Storage Engine Writer"

« previous entry | next entry »
Apr. 14th, 2007 | 12:43 pm

I would not normally blog this, but I thought it was interesting to see this appear in the MySQL forums:

We're looking for a consultant to help us write a custom storage engine that distributes data amongst many machines but abstracts this from clients who still issue regular MySQL queries.

You can look at it as a stripped down version of MySQL Cluster or a beefed up version of the FEDERATED storage engine.

Candidates must have strong knowledge of clustering and MySQL internals.


When I was in Japan last week I got to meet another one of the Storage Engine vendors. Who had joined their company to do this work?

One of my X interns.

There is a good and growing eco-system forming around this work. On Friday of the week of our Conference I am hosting a Storage Engine Summit. This is for the different vendors/engine writers to sit down and discuss what they are seeing and what they need. I'll blog about this when we get closer to the event (it is a closed, invitation only to just engine writers).

Link | Leave a comment |

Comments {2}


from: burtonator
date: Apr. 14th, 2007 11:24 pm (UTC)

It sounds like what they want is a sharding engine. Basically duplicate all the functionality of building a sharded database within MySQL.

This idea keeps coming up.... Most people just implement it on TOP of MySQL in their own language.

Reply | Thread

Brian "Krow" Aker

Re: sharding........

from: krow
date: Apr. 15th, 2007 02:29 am (UTC)

I know... I build it on top as well, but I don't know if this is the best idea.

I worked out a scalable was to do this with hashes and a large modules domain (and I have replicated this to a few different companies).... but you know, I still think the software should be doing this.

What we are all doing is using MySQL to build a Google style Big Table. Sure, it has more features, but in the end this is what we are doing.

Reply | Parent | Thread