Harold Davis on SIPs in Braintique archives

http://www.braintique.com/research/mt-archives/000155.shtml

The Googleplex Blog: Harold Davis's Blog


April 22, 2005
Statistically Improbable Phrases (SIP)
Statistically Improbable Phrases (a/k/a "SIP") is the improbable term Amazon.com uses as a search ranking technique. Here's Amazon's explanation.
In more-or-less plain English, here's how this works. Amazon indexes the "Search Inside" content of the books in its catalog (that is, the books in which publishers provide this content). In many cases, Amazon provides a list of SIPs on the main listing page for the title. For example, Starting an Online Business for Dummies by Greg Holden has a number of linked SIPs listed, including "your online business." These SIPs are phrases that appear with anomalous frequency in the inside content of the cataloged book compared with the entire the rate of occurence of the SIP in the universe of books in general. This statistic over-occurence implies that the SIP is a significant representation of the content of the book.
By clicking one of the SIP links, you get other books in which the SIP occurs, sorted from most to least by the number of SIP references. For example, "Web Analytics" and "E-Commerce for Dummies" have the next highest occurences of the SIP "your online business" after "Starting an Online Business for Dummies."
This is a different and somewhat appealing way to use Amazon's search facilities to find books in which the author uses distinctive phrases. Longer run, the concept has an elegant simplicity (as did the original PageRank algorithm), and may be useful for automated tagging and ranking of content.
Click here for a lively discussion of SIPs in the context of author as phrase maker, and here's a fun discussion and list of adult SIPs on Amazon (over 18 only please click this link).Posted by Harold Davis at April 22, 2005 11:17 AM


About Braintique.com
Braintique.com was co-founded by well-known authors Harold Davis and Phyllis Davis to provide quality, Web-based information about a wide range of topics. View the current Table of Contents to find out what's available.Click here for an FAQ, and here for information about services Harold Davis and Phyllis Davis provide.
Reviews and Press:
Current Cites reviews Building Research Tools with Google for Dummies (04/2005)
Press Release - Building Research Tools with Google for Dummies by Harold Davis is now available from Wiley Publishing and your favorite bookseller. (4/11/2005)
Press Release - Braintique announces the publication of the Googleplex Blog (2/8/2005)
Press Release - C# Programming Techniques area now open (1/30/2005)
Googly Goodness according to ResearchBuzz at Braintique's companion site for Building Research Tools with Google For Dummies (1/17/2005)
Braintique supplies WiFi Basics (The WiFi Weblog, 1/15/2005)
Braintique press release (1/15/2005)
Contact Information
Braintique.com632 San Fernando AvenueBerkeley, CA 94707Telephone: 510.528.9977For questions about the Braintique.com subject matter and content, please use our contact form, or contact us via email at question@braintique.com.For information about consulting and related services, contact info@braintique.com.You can send email to Harold Davis at harold@braintique.com.You can send email to Phyllis Davis at phyllis@braintique.com.
function goGoogle(term){
var siteURL = "braintique.com ";
var googURL = "http://www.google.com/search?q=site:" +
siteURL + term;
window.location = googURL;}
Search Braintique

Put a Braintique Search box on your website.How does the Braintique Search box work? Click here to find out.