The Sultans of Speed

February 18, 2009
41 Views

Whatever else you might say about Google, they understand how to engineer web-scale systems. Check out Greg’s notes (or Michael Bendersky’s via Jeff’s Search Engine Caffe) about Google Fellow Jeff Dean’s keynote at last week’s WSDM 2009 conference.

Here’s the teaser from Greg’s notes:

Jeff gave several examples of how Google has grown from 1999 to 2009. They have x1000 the number of queries now. They have x1000 the processing power (# machines * speed of the machines). They went from query latency normally under 1000ms to normally under 200ms. And, they dropped the update latency by a factor of x10000, going from months to detect a changed web page and update their search results to just minutes.

This is no small feat, and it gives you a sense for the bar that Google has set in the web search market. Students of the Innovator’s Dilemma take note: if you want to beat Google, you’re not going to do it by stuggling to incrementally outdo them on their own turf. For the use cases it addresses, Google is surely good enough. And damn fast.

Whatever else you might say about Google, they understand how to engineer web-scale systems. Check out Greg’s notes (or Michael Bendersky’s via Jeff’s Search Engine Caffe) about Google Fellow Jeff Dean’s keynote at last week’s WSDM 2009 conference.

Here’s the teaser from Greg’s notes:

Jeff gave several examples of how Google has grown from 1999 to 2009. They have x1000 the number of queries now. They have x1000 the processing power (# machines * speed of the machines). They went from query latency normally under 1000ms to normally under 200ms. And, they dropped the update latency by a factor of x10000, going from months to detect a changed web page and update their search results to just minutes.

This is no small feat, and it gives you a sense for the bar that Google has set in the web search market. Students of the Innovator’s Dilemma take note: if you want to beat Google, you’re not going to do it by stuggling to incrementally outdo them on their own turf. For the use cases it addresses, Google is surely good enough. And damn fast.

Link to original post

You may be interested

How SAP Hana is Driving Big Data Startups
Big Data
298 shares2,906 views
Big Data
298 shares2,906 views

How SAP Hana is Driving Big Data Startups

Ryan Kh - July 20, 2017

The first version of SAP Hana was released in 2010, before Hadoop and other big data extraction tools were introduced.…

Data Erasing Software vs Physical Destruction: Sustainable Way of Data Deletion
Data Management
41 views
Data Management
41 views

Data Erasing Software vs Physical Destruction: Sustainable Way of Data Deletion

Manish Bhickta - July 20, 2017

Physical Data destruction techniques are efficient enough to destroy data, but they can never be considered eco-friendly. On the other…

10 Simple Rules for Creating a Good Data Management Plan
Data Management
69 shares622 views
Data Management
69 shares622 views

10 Simple Rules for Creating a Good Data Management Plan

GloriaKopp - July 20, 2017

Part of business planning is arranging how data will be used in the development of a project. This is why…