AI based search engine in JAVA

[Saurabh Agrawal]

Hello friends,
I am hereby interested in doing some reasearch work.These days i am trying to implement an AI based search engine in JAVA.Can anyone guide me how to go ahead as i have enough matter to understand the concept of AI and search engines like PROFUSION using the same.

Can anyone give me detailed understanding on how to implement the same.I mean basic idea of how to start and where to start from ?

I want to explore more of same as i have keen interest in AI.This question is placed in this forum since i would be implementing the same using JAVA.
I hope i will get a heavny response for this topic,
Regards,
Saurabh
Software Engineer

[Damanjit Kaur]

Should you not consider LISP or Prolog for AI instead of Java.

[William Brogden]

Should you not consider LISP or Prolog for AI instead of Java.

For one thing, Java is a LOT easier for a beginner. For another, in a search engine application it will be alot faster. The Lucene text search engine - recently discussed in the "Other Open Source Projects" discussion uses some AI-like ranking algorithms.
Bill

[Azriel Abramovich]

WOW that is one heck of a question...

I am not certain what you mean in your question so I will answer it to my best understanding.

Any search engine is constructed of (at least) these parts:
1. Collector
2. Indexer
3. Retriever

The collector collects pages (HTML or whatever). The part of AI, to my understanding, is not huge. Just filtering "unreasonable" pages, such as ads etc..

Indexer has no AI as far as I see it. It might have some other interesting algorithms for ranking noun-phrasing etc..

The retriever's AI algorithm comes into fomulating the search terms into complete sentences, the ability to break users sentences into terms and rank that answers based on them.

For example, if the user enters the following question: Who is the smartes man on the face of the earth, the user would expect an answer: Azriel Abramovich (me ) he he he... But no page would hold that answer. You would be happy to see the answer "The smartest man on the face of the earth is Azriel Abramovich" or any other similar text in a page.

So your (easiest) task is to be able to form the structure of the sought answer and then look for it. This is very hard. But it is easiest because you would be happy if the user entered that question. The user will probably enter "man smartes who". And maybe even with typos.

Once you get all the premutations of the text you want to search, you need to be able to cast any sentece which is equivalent to that and check it.

For example: Azriel Abramovich, the smartes man, died today from a too large an ego..

So, go right ahead. This is a VERY VERY VERY difficult project you wish to undertake.

I wish you luck and success. If you do well you might even make a nice $$$ of it...Not to mention world-wide recognition.

From all the "AI" engines I saw they were not too good and mainly not too fast.

If my answer made ANY sense to you and your question... Then I am happy.


Azriel Abramovich, not so smart, not so modest.
[e-mail]

[Saurabh Agrawal]

Thanks Azriel and others,
You guys have made a real contribution to my understanding meaning i have got an idea on how to start and where to start from ?
Still Azriel i want to know how should i go ahead , i mean to ask now that i know part of AI search engine and want to really implement the 2 parts of it as described by you, how should i approch ?

Morever i am looking for some team of professionals if not more than 3-4 who can together with me put in their efforts to go ahead with this work.Will you be interested to work with me ?

Anyone whos is interested can mail me at : [e-mail].

I would wait for early response from you .
Saurabh

[Damanjit Kaur]

Hi Saurabh,

I am interested in working on this project but will be able to devote time only on weekends.

[Saurabh Agrawal]

Originally posted by Damanjit Kaur:
Hi Saurabh,

I am interested in working on this project but will be able to devote time only on weekends.

Hello damanjeet,
Nice to know that you want to form the team with me and it would be great toinclude you in the same and even i deveote time on weekends as such.Before we start off anything i would like to know about your profile and work experience so that i can judge how can we go ahead.So do mail me your profile on : [e-mail].
Alternatively you can call me at 9818664383
Hoping to hear from you soon,
Saurabh

[Saurabh Agrawal]

Hello folks,
Is anyone interested to work with me on AI BASED SEARCH ENGINE ? If yes send me your profiles on [e-mail].

Morever, you can contact me at : 9818664383

Hoping to get some response from you all,
Saurabh

[Damanjit Kaur]

Hi Saurabh,

I have sent you email.