Monday, May 19, 2008

The Semantic Search Engines: the "Google Killers"

The issue of Keyword Search Engine
There is a sort of rebellion on the web these past few months. Google dominates the search engine market, but a lot of people criticize their algorithm, based on keyword search. Because of this concept, some web pages, stuffed with keywords have a better ranking than some more qualitative pages that focused on content quality instead of search engine optimization.

The main issue that keyword-based search causes is that human language is more complex than a simple juxtaposition of words. Some words have double meanings, and if you don't take into consideration the syntax and the context.
Therefore, some companies started prospecting some new ways to search the web, with new concept of searches. Some of them are based on human collaboration (human search engine). The most famous of these one is mahalo.com. I have already tried mahalo for a little while, but I have not really been convinced by it so far. To be honest, I think this style of search engine requires a lot of time to be efficient, and will never been able to be as reactive as a search engine that will go through the Internet on a regular basis.

Google Killers
However, today I have seen another kind of search engine that could be define as a "Google Killer". This is called Semantic Search Engine. As I have said, it is very important not only to check keywords, but also the context why they have been used in a specific webpage. And these new search engine are eager to focus on this semantic aspect that Google do not take into consideration (maybe so far, as Google will probably adjust its search engine within the next few years).

One of them is start-up Powerset.

"Keyword engines treat pages as word bags, indexing their content without grasping its meaning, he said. Meanwhile, Powerset's engine, applying technology developed in-house as well as licensed from Xerox's PARC subsidiary, creates a semantic representation by parsing each sentence and extracting its meaning. "Meaning is what we index," he said." (source: computerworld.com). So far, Powerset focuses on Wikipedia's pages (it is a beta version you can try out). But the fact is that they might be the future of search engine.

Problem that might have Semantic Search Engine
The main problem is that languages are difficult to analyze. Languages are complex, especially because syntax changes from a language to another. Also, because of double meanings, play on words, and all sort of different problem, it won't be easy to set up a reliable semantic search engine solution. However, with the research advances and the will to see Google's supremacy coming to an end, I believe Powerset and like can see a great future before them.

What do you think? Do you think some of these new actors in the market have a chance to challenge Google's search engine model? Do you believe semantic search have a future?


Blogged with the Flock Browser

5 comments:

  1. Anonymous9:41 PM

    I agree with you about these. Well someday Ill create a blog to compete you! lolz.

    ReplyDelete
  2. I agree with your blog. Nice topic has been given and there will be nobody to argue or to compete with you except one website which I had seen recently. Go through that one for clarification.

    ReplyDelete
  3. Google has zero incentive to improve the natural search results, there out for the almighty click ad. Same way cities, counties and state governments dont mind high gas prices or inflation because the higher an item is the more tax revenue for the city or state government agency. If they cared about user experience they would have at least put a visual accent to the organic search results. Google proves when you financially rule the roost you can do what ever you want even if your not the smartest or most entertaining chicken in the bunch. They dont even need to innovate when they can simply buy the next hot rising location engine. When they bought youtube it was a supposed marriage between the king of search and king of video sites. To be a leading competitor in the future of search they are going to need a "King of Location" acquistion. http://www.killerstartups.com/Search/Mylocatorcom---Vertical-Locator-Network/

    ReplyDelete
  4. Powerset doesn't pretend to be a Google-killer: we're just trying to provide a better way to search and discover information on Wikipedia.

    Language *is* difficult to analyze, but Powerset thinks we've got a great solution, from technology we've licensed from (Xerox) PARC and that we've built with our small army of computational linguists. Try it out and review your experience :)

    BTW, my dad lives in Fulton, NY, right next to Oswego.

    ReplyDelete
  5. @myocator, that is true, so far Google has a dominant position in the market + a competitive advantage with its technology that does not incentive the firm to enhance its product. But I believe that if a company shows up with a better product, Google will have to make some adjustments.

    @Mark Johnson, I am glad someone from Powerset responded to this post. I used the term "Google Killer" because it is used in the article I read about the topic. You are probably not a "Google Killer", but aims to replace probably the search modell that has been settled by the Mountain View company.

    I am also glad to know you know about Oswego! I'll be pleased to visit you if possible as I am living in Mountain View. Good luck anyway with your company.

    ReplyDelete