http://www.allpeers.com/blog/2006/10/06/seek-but-ye-shant-find/ The official AllPeers blog Fri, 05 Dec 2008 10:23:47 +0000 http://wordpress.org/?v=2.2 http://www.allpeers.com/blog/2006/10/06/seek-but-ye-shant-find/#comment-25220 Mike Fri, 06 Oct 2006 20:27:08 +0000 http://www.allpeers.com/blog/2006/10/06/seek-but-ye-shant-find/#comment-25220 Matt, there are two ways to apply linguistic processing: (1) interpreting the user’s query; (2) extracting the true meaning of the pages themselves. Just as PageRank indexed hyperlinks to pages, the ability to deeply analyze all of the web’s pages themselves is the key. You can then extract information. For example, you search for the link between global warming and hurricanes (e.g. enter keywords global warming hurricanes) and you get both pro/con references with links to core research articles on both sides of the argument. This alone would be huge, but it would require crawling an analyzing the pages instead of just indexing them. But then people could see for themselves that there is no support for a link between the frequency or severity of hurricanes in the Gulf and global warming…but that is another post. Matt, there are two ways to apply linguistic processing: (1) interpreting the user’s query; (2) extracting the true meaning of the pages themselves. Just as PageRank indexed hyperlinks to pages, the ability to deeply analyze all of the web’s pages themselves is the key. You can then extract information. For example, you search for the link between global warming and hurricanes (e.g. enter keywords global warming hurricanes) and you get both pro/con references with links to core research articles on both sides of the argument. This alone would be huge, but it would require crawling an analyzing the pages instead of just indexing them. But then people could see for themselves that there is no support for a link between the frequency or severity of hurricanes in the Gulf and global warming…but that is another post.

]]>