Toss in new instructions that do the work of four old instructions, into one.
Gamble on the outcome, branch prediction.
More layers of caching.
When I cook I take the ingredients out of the fridge and place them on the counter where I will do the prep. From there they move to the flat area next to the stove.
I am caching so I can make food more quickly.
In computing we do a lot of caching today.
This came out of the specs from a user who I have been talking to:
"80 nodes, 640 cores... with 21 nodes in our Lustre cluster serving 65T... which we can sustain ~2.5GB/s to"
It was not fast enough for their needs. The system worked well enough for "containing the data", but for executing on the data it could not keep up.
Today they have a 100 nodes with 2gigs of ram a piece. They are using libmemcached to access their memcached servers on the nodes.
Classical web application?
No their business has nothing to do with the web :)
They do geo exploration.
Back a year ago there was a great quote, that I cannot find, from the CIO at Walmart.
What impression did it leave me with? That Walmart realized that they need to be more like a YouTube, and less like Big Iron 90's company.