Oracle Linux, Distributions, Redux

« previous entry | next entry »
Nov. 28th, 2006 | 02:14 pm

I was talking to Elliot this morning a bit about Linux Distributions and it made me think a bit more about where we are at today.

Let me share my thoughts on this topic.

First, I'm really unhappy with the state of Linux distributions today. Its a tower of babel for the most part. Its a hope that the LSB will solve some of this, but today shipping on Linux is a real mess. Upgrading is a mess, especially for applications developed to rely on a stable platform.

Let us talk about the first distribution by sharing a story.

Last year I walk into a customer's shop and they asked me why MySQL is crashing. The problem?

"apt-get upgrade"

It was a mismatch of libraries on their Debian systems. Debian is a great distribution to play with, but unless you have an expert (and you probably do not!) I find that its not the most stable distribution to use. I do not see this changing even with HP backing the project.

Ubuntu gives me great hope for Linux on the desktop. Every time I turn around I meet another happy Ubuntu person. That is awesome, but it doesn't solve the problem of the Server. I've not found a peer yet using it as a server under any sort of load that makes me feel comfortable about deploying it at as a server. Ubuntu needs a win to get people onboard with them being a server distribution.

Redhat ES is still the 800lb gorilla. Problem is that its too expensive when you get thousands of servers (or even a hundred). There was a day and an age where libc problems kept rearing their heads but that seems to be mostly over. I'm not going to pay what they want me to pay. They don't present me with a value proposition that I like. I used to buy one copy of it each time it was released to keep my servers upgraded, but I stopped that after RH9.

CentOS is a knockoff, I am not crazy about knockoffs. It adds nothing. This is something I argued with Tridge about last year on a panel... to me open source is about extending, its not about just copying. Sometimes copying happens for commodization, fine, that is good for everyone. Most open source does a task and does it better. Its ability to do this through an open process is something I value. The right to fork to me is a fundamental right.

Oracle Enterprise Linux is in the same category at the moment as Centos, but I am hoping that they do more then just copy the bits. They are an ISV, which means they have the pain of shipping software. An ISV should put a lot more effort into the distribution then the average packager since they need to make sure the distribution works well for them. They have smart kernel engineers so they have the ability to do this. I've been asked about why in a recent blog post I mentioned that I am having a server shipped with OEL to me. I am hoping that they changed it, for the better :)

Fedora Core is what I use. Now why is that? Because it was the easiest upgrade path years ago from RH9. Am I happy with it? Mostly. I've found it to be stable, and while I have had issues with getting it to upgrade online, it works. The short life span is a pain, and yes I realize that this is deliberate. I get that, but it doesn't make me happy. Why overwrite an OEL install for Fedora Core? OEL needs some time to bake, and all of my other production servers are FC. Moving away from FC is an investment in time for me, and I am not willing to make it unless I see an upgrade path that I know will be around for the next decade.

rPath is a great idea but I need to see how upgrading is going to work with it. The Appliance concept I get, and I love, but appliances have data, and you need to be able to upgrade and keep your data (and yes in the back of my mind exists the idea of a Database distribution of rPath). I am currently testing the new Asterisk distribution which is based on rPath, I'll write more about this later.

Suse? It has just never entered into my radar. I am well aware that it has users, and I find a lot of Europeans who like it, but it has never done anything for me. The recent patent deal with Microsoft is just... from a community view, weird. It does not make me want to use the distribution, and it doesn't make me want to format any drive I find it running on. If Suse uses the FUD of patents though, I will of course change my mind.

And while its not Linux, its worth mentioning Open Solaris. Dealing with Solaris is like stepping back in time. None of the right tools come with it, the website to download it is byzantine and frankly no one seems to be able to point to what I would need to run it on generic hardware. I am well aware that Sun seells their selling servers with it running on it, but I hear more about Linux being installed on the boxes once they are deployed. Could Solaris make a come back? Yes. Will they overcome their own fear of the GPL and the attitude of "this is right for our customers", its doubtful. The larger the company, the slower it tends to move. I find this to be a shame, since when I graduated from undergraduate I bought a Sun because of quality (though the NeXT did have color....).

I'd like to see a winning Linux distribution, but right now the race is wide open as far as I am concerned. Fedora could improve on upgrades to the point where I was happy with it. Oracle could innovate and create a platform that ISVs would consider stable. Ubuntu could get a major win and we see sites move to it. Redhat could realize that they have created profit by creating a ceiling for adoption and find a new way to profit (since that ceiling is only going to drop...).

Link | Leave a comment | Add to Memories | Tell a Friend

Comments {19}

Matt Wilson

rPath upgrades

from: [info]mswilson
date: Nov. 29th, 2006 12:55 am (UTC)
Link

appliances have data, and you need to be able to upgrade and keep your data

Appliances built with rPath's tools include a capability to download and apply incremental updates over the internet. The data stays intact while both the operating system components and the application get updates.

Reply | Thread

Brian "Krow" Aker

Re: rPath upgrades

from: [info]krow
date: Nov. 29th, 2006 01:10 am (UTC)
Link

In the current list of "things to do" is to try out the AsteriskNow rPth distribution. I am curious to see how well it can handle an upgrade. Asterisk is very twitchy about different kernels and being up able to upgrade and not have to "set it all up again" has been a big problem.

Reply | Parent | Thread

greglinden

Upgrading Fedora Core

from: [info]greglinden
date: Nov. 29th, 2006 01:39 am (UTC)
Link

I have found upgrading Fedora Core on major releases (e.g. Core 3 -> Core 4) on headless servers to be a real pain. For example, I have had servers fail to boot after a remote upgrade using yum. Has that not been a problem for you?

Reply | Thread

Brian "Krow" Aker

Re: Upgrading Fedora Core

from: [info]krow
date: Nov. 29th, 2006 02:22 am (UTC)
Link

I did online upgrades for 3 -> 4 using yum. For 5 I found that I had to on at least one server upgrade from CD. In one of the online 4 -> 5 the upgrade somehow forgot the kernel :)

I am preparing to upgrade to 6 in the next couple of days on my development server, so I will find out how much of a pain that will be. I will first try doing an online upgrade since I don't have heads or CDs on any of the 1u boxes.

Reply | Parent | Thread

qu1j0t3

we all have our prejudices, I guess

from: [info]qu1j0t3
date: Nov. 29th, 2006 01:54 am (UTC)
Link

I don't know about OpenSolaris, but on Solaris 10, pretty much all the GNU stuff you need comes bundled and installed.

The problem is it's typically not in your default PATH, and sometimes is renamed to avoid clashing with the Sun tools (e.g. gtar, gmake, gpatch, etc). Believe it or not, it is done this way for reasons of backward compatibility! (This is also why root's shell is still Bourne, etc).

So most people coming from Linux conclude that Solaris doesn't have the facilities they're used to. And ironically, the confusion arises from Sun's single-minded devotion dedication to change management which people complain Linux (sometimes genuinely) lacks.

I won't bother talking about my distaste for anything with rpm in it... :)

Today's "what were they thinking" moment was reading that Ubuntu Edgy Eft ditched bash for dash. Now that's just REALLY DUMB, guys.

Reply | Thread

Brian "Krow" Aker

Re: we all have our prejudices, I guess

from: [info]krow
date: Nov. 29th, 2006 02:25 am (UTC)
Link

Did you install the GNU cd that came with Solaris?

Default shell under Solaris is ancient, the vi is ancient. I've spoke to a couple of VPs at Sun on this issue and there is some acknowledgment that they know they need to more forward. They just have a lot of culture internally to overcome to make that happen.

One other thing, the management of keeping Sun boxes up to date is a real pain. They need to make a very clear, and very simple approach to this.

Apple is getting some of this right with OSX, but OSX really lacks package management.

Reply | Parent | Thread

qu1j0t3

does it matter

from: [info]qu1j0t3
date: Nov. 29th, 2006 03:14 am (UTC)
Link

The old vi, the old sh on Solaris just don't get in my way. I set my user accounts to bash, problem solved. I put the useful PATH in ~/.bash_profile, problem solved. Not very different from Linux after all, except for oh, zones, ZFS, and so on... :)

Reply | Parent | Thread

qu1j0t3

the GNU Companion CD?

from: [info]qu1j0t3
date: Nov. 29th, 2006 03:27 am (UTC)
Link

Oh - the GNU CD? Never needed it. gcc, and all those other tools mentioned, are preinstalled. I sometimes grab stuff from Sunfreeware, but there's a surprising amount already there (Apache 1 & 2, PHP, MySQL 4.0, etc). I sometimes miss Portage, but Solaris package management is quite adequate.

I certainly agree there should be a good CLI package manager built into OS X. I wonder what they will choose...

Reply | Parent | Thread

timothy

Ubuntu and friends

from: [info]tlord
date: Nov. 29th, 2006 05:22 am (UTC)
Link

a) I like Debian overall, have for a few years. I remain (and it seems always will) a mostly clueless computer user, but I still care about how my computers act, and how easy they are for me to deal with. In particular, I want my data to be in portable formats, I want there to be lots of nice software to play with, and I want a visually appealing, easy to manage desktop. (Of course, I also have strong opinons about the car I drive and can't do much more than replace headlights and jump start a battery. Deal!)

b) Debian's gotten better lately, and the 4.0 release looks promising. As a very outside observer (reading planet.debian.org and the occasional article on the usual news sites is the extent of it), I think that Ubuntu is a big reason for that. (And, going back further, so are all the other Live CDs; I don't know if it was truly the first, but Knoppix is certainly to blame for much of the Live CD rash, especially the excellent trend -- or now expected default, I'd say -- of using the Live CD as the installer ...)

c) My ThinkPad died; seems like a motherboard problem. But I was very happy with Ubuntu on it, so on the new replacement laptop (grrr!), I had in the drive a copy of Linux-Mint (Ubuntu derived, includes a lot of the codecs and such that Canonical can't / won't), so it never booted into Windows, but straight into the desktop from the Live CD. This was Thanksgiving weekend, when I was visiting the home fort (in Harrisburg), and since she was around, I asked my mom to do the installation. With minimal help from me, she clicked all the right buttons and installed it, easy as pie. At least as easy as the last time I installed Windows from a Ghosted backup disk, and that didn't offer nearly as much on several axes.

d) At first, I was a bit put off by the fact that Ubuntu isn't "pure" Debian, for the same reason that I didn't like Knoppix installing a system that was almost, but not completely unlike, Debian proper. Don't listen if someone says that apt-get is always right: I am an expert at being inexpert, and have managed to mangle a few machines through sheer force of will and stupidity, and I've been especially successful at that particular feat while using systems that are Near Debian (Knoppix, Mepis, etc).

However, Ubuntu's charm has mostly won me over; I might soon convert my main machine (the desktop on which I type) to it, because I have been pleased with it on a few other machines (iBook, ThinkPad, and an old Toshiba Satellite on which it was only used as a Live CD rather than installed -- that's my Windows machine for the moronic Windows-only software required for exam taking at Temple Law).

And Linux Mint really is a nice way to use Ubuntu; it seems less of a crapshoot than using Ubuntu + Automatix or one of the other quick paths to codec heaven. My new Toshiba laptop doesn't like to suspend (and the ThinkPad, even while working closer to normal, didn't either), but Hey, the boot process is nice and fast at least, so that's less of an issue than it would be with a slower-booting system.

timothy

Reply | Thread

Alan Morgan

(no subject)

from: [info]stormerider
date: Nov. 29th, 2006 05:37 am (UTC)
Link

Just curious as to what your thoughts on Mandra-er.., Mandriva these days, are.

Truth be told I've mostly been out of the Linux scene for the last few years, due to time and hardware constraints (my fiancee ended up using my former Linux box as her main desktop, and well... getting married does tend to suck up a bit of your time :)). I always liked Mandrake on the desktop, particularly with laptops, and used it for a server for quite some time. Still had the same problem as RH moving from one major release to the next but they do keep supporting security patches for older releases for some time... and urpmi was my version of apt-get, just a bit more stable imho than apt-get is.

Reply | Thread

(no subject)

from: [info]ianw
date: Nov. 29th, 2006 05:47 am (UTC)
Link

While rpath is nice (I talked with them a fair amount during Ohio LinuxFest and tried to push them to where I work), there are some roadblocks to implementing them in my line of work.

The biggest one: Push-only updates. Some customers have their appliances behind firewalls, and keeping a port open to the outside world just doesn't want to work.

The next one: Incremental cost. While I understand that everyone's in it to make money (hell, $WORK is), it's somewhat cost prohibitive to maintain one of these setups. For around 100 or so appliances, you needed at least a $10K up-front investment along with the additional bandwidth needed for updates.

I've been a diehard debian guru for the past few years. For my personal stuff, it's a great distro. On my work stuff, it's all RHEL/CentOS, SuSE, or Debian. I tried out Oracle's Linux last night and I was shocked...my kickstart scripts ran without hassle, everything was generally in the same 'good' look and feel, and our app installed right out of the box with no tweaking aside of the normal install steps. Getting our app to run on debian is nothing short of asking for a root canal without any pain meds.

For a personal system, I think Ubuntu has hit the mark for the past year -- it's so easy, hairdressers are using it (and loving it). For commercial systems, I get the feeling that Oracle is going to be the way to go. Novell just pushed them self out of the 'serious' market with their MS fiasco.

Reply | Thread

rPath upgrade mechanism

from: [info]smithj_foo
date: Nov. 29th, 2006 02:59 pm (UTC)
Link

rPath's update mechanism uses a pull, not push. To update, the system contacts the server running by whichever vendor sold your appliance (or by rPath if you're using one of our community projects) and pulls updates from there. The only pushing is when a software vendor who is using rPath to deliver their stack decides to make the update available - *they* push it to their public mirror site, which means that using an rPath-based appliance behind a stringent firewall requires no modifications nor opening ports. See wiki.conary.com or #conary on freenode for more info :-)

Reply | Parent | Thread

Brian "Krow" Aker

Re: rPath upgrade mechanism

from: [info]krow
date: Dec. 5th, 2006 10:22 pm (UTC)
Link

Hi!

Can I control what packages are updated? If I wanted to create an optimized/certified version of rPath built for a particular application, could I quality control what updates the end user gets? Kernel, etc... (or even filter... allow all openssh, but control kernel)

Thanks!

-Brian

Reply | Parent | Thread

Re: rPath upgrade mechanism

from: [info]smithj_foo
date: Dec. 6th, 2006 04:15 am (UTC)
Link

Of course! The rPath concept of a "group" defines the updates the end user gets, and the group is totally controlled by you. You can specify all the way down to a specific binary build of a specific version of the recipe of the kernel, version 2.6.17.6. You could say you always want the most recent version of binutils, and so on.

Reply | Parent | Thread

Brian "Krow" Aker

Re: rPath upgrade mechanism

from: [info]krow
date: Dec. 7th, 2006 02:29 pm (UTC)
Link

Can you insert or swap in your own compiled binaries?

How does rpath fund itself?

Reply | Parent | Thread

Re: rPath upgrade mechanism

from: [info]smithj_foo
date: Dec. 7th, 2006 04:15 pm (UTC)
Link

We are a company, so our customers and venture capitalists provide funding. See http://www.rpath.com/corp/company.html for more info on that.

Reply | Parent | Thread

rainblogger

(no subject)

from: [info]rainblogger
date: Nov. 29th, 2006 07:30 am (UTC)
Link

I agree with almost everything you've said here. Especially Debian. I want to like it, but I've seen systems totally foobared by apt-get upgrade.

Of course, there are those of us that can appreciate the ancient UNIX code that is still Solaris. :-) It's stable as hell and you know what to expect version to version. There's nothing more annoying to me than with an OS that keeps changing the common tools, including major version changes within a minor OS release. That tends to happen more with Linux than UNIX.

I need to revisit Fedora Core at some point; the libc fiasco that happened in RH9 turned me off of Redhat.

Recently, at work I switched to Ubuntu from SuSE and really am as productive as ever so I'll hold in this pattern for a while. SuSE has had a great track record for years (I've used it on and off since version 6.x), but with 10.1 they really took a dive in terms of reliability (e.g., package updating just breaks eventually).

I definitely agree that if you have to build code on Solaris, it's often painful, particularly recent open source software. However, if you can configure one system as a build environment just the way you need it, you simply make a FlashArchive of it. You can then readily clone it (either via installing the FLAR onto a DVD image or via network-based Jumpstart). I also make use of Sunfreeware packages where possible: some of the 3rd party Sun-packaged stuff is too old IMHO.
Sun has just released Sun Studio 11 which now includes the Sun Workshop compiler suite for *free*. That's huge.

For configuration management, I love cfengine. It's a bit tough to get going because it's a blank slate to start with, but once you do, it's an amazingly helpful tool. It's OS agnostic, and can even be used on Windows clients. And it can be deployed securely (using SSL or SSH) and leverage CVS/SVN for versioning builds and config files. At my last job, three of us managed hundreds of servers with cfengine and literally made all our config changes in one place. Those changes were propagated via rsync over ssh to datacenter CVS servers, which in term served up files to the local cfengine master server for automagickal deployment.

Just based on the buzztalk so far, I think all eyes are on Ubuntu to provide the next ubiquitous community distro. By that I mean something akin to the impact RedHat had from 1995 to 2002. I'm not sure if that long of a run is possible anymore, but there's definitely a need for more competition to FC and SuSE.

Reply | Thread

Debian

from: [info]fnord32
date: Dec. 6th, 2006 11:34 pm (UTC)
Link

Come on people! Debian is dead stable! You just have to use ... well ... Debian Stable, which few people do, for some reason.

The trick is to use stable, but if you really, really need something newer, do backports or manual installations/compilations. Really, this is not a problem.

Reply | Thread

Brian "Krow" Aker

Re: Debian

from: [info]krow
date: Dec. 12th, 2006 08:42 pm (UTC)
Link

Backports and manual installations requirements alone might make someone wonder why they would ever want to use it in production :)

Reply | Parent | Thread