Comments on: How Search Really Works: The Compressed Index http://www.searchenginepeople.com/blog/how-search-really-works-the-compressed-index.html Canada's Search and Social Media Authority Thu, 20 Nov 2008 18:52:17 +0000 http://wordpress.org/?v=2.2.3 By: How Search Really Works: Simple Query Optimization http://www.searchenginepeople.com/blog/how-search-really-works-the-compressed-index.html#comment-1266 How Search Really Works: Simple Query Optimization Sat, 22 Mar 2008 00:16:09 +0000 http://www.searchenginepeople.com/blog/how-search-really-works-the-compressed-index.html#comment-1266 [...] This post is part of an ongoing series: How Search Really Works. Last week: The Compressed Index. [...] […] This post is part of an ongoing series: How Search Really Works. Last week: The Compressed Index. […]

]]> By: Weekly Links for March 21th, 2008 | .eduGuru http://www.searchenginepeople.com/blog/how-search-really-works-the-compressed-index.html#comment-1267 Weekly Links for March 21th, 2008 | .eduGuru Fri, 21 Mar 2008 21:56:13 +0000 http://www.searchenginepeople.com/blog/how-search-really-works-the-compressed-index.html#comment-1267 [...] How Search Really Works: The Compressed Index - Although a little advanced, still a very nice look at how a search engine works by analysing the Index [...] […] How Search Really Works: The Compressed Index - Although a little advanced, still a very nice look at how a search engine works by analysing the Index […]

]]> By: Ruud Hein http://www.searchenginepeople.com/blog/how-search-really-works-the-compressed-index.html#comment-1270 Ruud Hein Wed, 19 Mar 2008 05:33:30 +0000 http://www.searchenginepeople.com/blog/how-search-really-works-the-compressed-index.html#comment-1270 Thanks Gabriel -- appreciate the comment! Thanks Gabriel — appreciate the comment!

]]> By: Gab "SEO ROI" Goldenberg http://www.searchenginepeople.com/blog/how-search-really-works-the-compressed-index.html#comment-1269 Gab "SEO ROI" Goldenberg Wed, 19 Mar 2008 03:29:22 +0000 http://www.searchenginepeople.com/blog/how-search-really-works-the-compressed-index.html#comment-1269 Nice technical post Ruud :). Nice technical post Ruud :).

]]> By: Ruud Hein http://www.searchenginepeople.com/blog/how-search-really-works-the-compressed-index.html#comment-1271 Ruud Hein Mon, 17 Mar 2008 03:02:51 +0000 http://www.searchenginepeople.com/blog/how-search-really-works-the-compressed-index.html#comment-1271 Kim, it talks about storing differences between numbers (the pointers). Any time you work with large/long numbers, storing the difference between those numbers costs, on average, less space than storing the actual numbers. It also can help speed things up. So instead of saying "this word appears in document 1040, 1050 and 1052" you say "this word appears in document 1040, 10 documents after that and 2 documents after that one". Each number points to the next place: go 2 streets down.... 5 houses further... 10 dollar extra etc. Kim, it talks about storing differences between numbers (the pointers).

Any time you work with large/long numbers, storing the difference between those numbers costs, on average, less space than storing the actual numbers.

It also can help speed things up.

So instead of saying “this word appears in document 1040, 1050 and 1052″ you say “this word appears in document 1040, 10 documents after that and 2 documents after that one”.

Each number points to the next place: go 2 streets down…. 5 houses further… 10 dollar extra etc.

]]> By: spostareduro http://www.searchenginepeople.com/blog/how-search-really-works-the-compressed-index.html#comment-1272 spostareduro Sun, 16 Mar 2008 22:08:04 +0000 http://www.searchenginepeople.com/blog/how-search-really-works-the-compressed-index.html#comment-1272 Ruud, I kinda got lost on this one. Right about here: "compressed representation encodes occurrences of a term as a pointer to the next occurrence of the term to facilitate rapid enumeration of the occurrences of the term"...I hate being blond! :-) Ruud, I kinda got lost on this one. Right about here:
“compressed representation encodes occurrences of a term as a pointer to the next occurrence of the term to facilitate rapid enumeration of the occurrences of the term”…I hate being blond! :-)

]]> By: Ruud Hein http://www.searchenginepeople.com/blog/how-search-really-works-the-compressed-index.html#comment-1268 Ruud Hein Sun, 16 Mar 2008 03:16:32 +0000 http://www.searchenginepeople.com/blog/how-search-really-works-the-compressed-index.html#comment-1268 Thanks for letting me know, Benny. You have a <a href="http://www.geekblogger.net/" rel="nofollow">great blog</a> going there, by the way. <a href="http://geekblogger.net/about/" rel="nofollow">Funny photo</a> too :) Feel free to hit me up on Twitter any time. Thanks for letting me know, Benny. You have a great blog going there, by the way. Funny photo too :)
Feel free to hit me up on Twitter any time.

]]> By: Benny http://www.searchenginepeople.com/blog/how-search-really-works-the-compressed-index.html#comment-1273 Benny Sun, 16 Mar 2008 01:19:08 +0000 http://www.searchenginepeople.com/blog/how-search-really-works-the-compressed-index.html#comment-1273 Nice post you got going here. Keep up the good work, you have really nice articles. Nice post you got going here. Keep up the good work, you have really nice articles.

]]>