• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other Pie Elite all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Jeanne Boyarsky
  • Ron McLeod
  • Paul Clapham
  • Liutauras Vilda
Sheriffs:
  • paul wheaton
  • Rob Spoor
  • Devaka Cooray
Saloon Keepers:
  • Stephan van Hulst
  • Tim Holloway
  • Carey Brown
  • Frits Walraven
  • Tim Moores
Bartenders:
  • Mikalai Zaikin

NLP tool in Java

 
Ranch Hand
Posts: 254
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Hi All,

I've a bundle of comment/reviews in my DB. Now I want to sort out them as good or bad reviews. So, I'm searching for Natural Language Processing Tool (NLP), which sort out comment according to my requirements. I found GATE(General Architecture for Text Engineering), which I got examples code. But, I don't think those examples fit to my requirement. Is there anyone over here, who worked on GATE ? Please help me. OR anyone Please suggest me, which NLP tool is better for my requirement.

Thanks:
Ramakrishna k.C
 
Bartender
Posts: 10780
71
Hibernate Eclipse IDE Ubuntu
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator

Ramakrishna Udupa wrote:Please suggest me, which NLP tool is better for my requirement.


Unfortunately, without knowing what your requirements are, or why GATE doesn't fit them, it's very difficult to give any advice. This is also a highly specialised (and advanced) topic, so I'm moving it to our General forum for now.

Winston
 
Ramakrishna Udupa
Ranch Hand
Posts: 254
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
I'm crawling some product site. So, I need to sort out those product reviews good or bad basis on user reviews on that site. So, I want NLP, which sort out them. I'm not sure GATE'll not fit my application/requirement, But I think. I want everybody's solution, not only GATE developers.

Thanks:
Ramakrishna K.C
 
Winston Gutkowski
Bartender
Posts: 10780
71
Hibernate Eclipse IDE Ubuntu
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator

Ramakrishna Udupa wrote:So, I want NLP, which sort out them. I'm not sure GATE'll not fit my application/requirement...


Yes, but unless we know WHAT your requirement is, or why you don't think GATE will fit them, how can we possibly advise?

PS: Please KeepItDown (←click). Using lots of bold and caps is like SHOUTING!!!, and it's not pleasant to read and won't get you answers any faster (in fact, likely the reverse).

Winston
 
Ramakrishna Udupa
Ranch Hand
Posts: 254
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator

but unless we know WHAT your requirement is



I think I told my requirement.

crawling some product site. So, I need to sort out those product reviews good or bad basis on user reviews on that site.



I think the above explanation is enough. am I clear? Please tell me, if I'm not clear.


Thanks:
Ramakrishna K.C
 
Winston Gutkowski
Bartender
Posts: 10780
71
Hibernate Eclipse IDE Ubuntu
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator

Ramakrishna Udupa wrote:

crawling some product site. So, I need to sort out those product reviews good or bad basis on user reviews on that site.

I think the above explanation is enough. am I clear? Please tell me, if I'm not clear.


It's not. Sorting those reviews could involve any number of things that have nothing to do with language processing (for example, ratio of "favourable" to "not favourable", assuming this is registered via something like a "thumbs up/down").

Question 1: Why do you think you need language processing?
Question 2 (probably tougher): Exactly what qualifies as "bad" or "good"?
Question 3 (still not answered): WHY don't you think GATE fulfils your needs? And be specific about what capabilities you need that it doesn't offer.

Language processing is a very specialised topic (I've only done a small amount myself; and never with GATE) and you're unlikely to find too many experts on the subject, so any information you can give us is likely to get you a better answer to your question.

Winston
 
Ramakrishna Udupa
Ranch Hand
Posts: 254
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator

Question 2 (probably tougher): Exactly what qualifies as "bad" or "good"?


I think. based on ratings I'll qualifies "bad" or "good". (there will be ratings 1-5 for each review).

Question 3 (still not answered): WHY don't you think GATE fulfils your needs? And be specific about what capabilities you need that it doesn't offer.


ANNIE, which recognizes Person and Location (Hard-coded in Snippet). If I want to add some more words, again I've to change in the code which is not possible often. GATE have UI, which they given tutorials. I'm satisfied with that. But, there all tutorials based on their UI not any Java code.

Question 1: Why do you think you need language processing?


Not sure for this, but what I thought is, it'll sort-out/separate all the reviews by analyzing sentimental in reviews.
 
Winston Gutkowski
Bartender
Posts: 10780
71
Hibernate Eclipse IDE Ubuntu
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator

Ramakrishna Udupa wrote:I think. based on ratings I'll qualifies "bad" or "good". (there will be ratings 1-5 for each review).


OK, now we're getting somewhere. Doesn't sound like language processing to me though.

ANNIE, which recognizes Person and Location (Hard-coded in Snippet). If I want to add some more words, again I've to change in the code which is not possible often. GATE have UI, which they given tutorials. I'm satisfied with that. But, there all tutorials based on their UI not any Java code.


So is it GATE or its tutorials that you're not satified with? I'm afraid I have no knowledge of ANNIE, so can't really advise on how you might go about that.

Not sure for this [language processing], but what I thought is, it'll sort-out/separate all the reviews by analyzing sentimental in reviews.


So, is a key (or an order) what you're looking for? Most search engines sort based on some combination of date and "relevance", but I'm pretty sure that the latter is only keyword-based; it doesn't involve language processing. But I could be wrong.

Winston
 
Ramakrishna Udupa
Ranch Hand
Posts: 254
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Okay. Can you do me a favor? Just run THIS example with all libraries in classPath in simple java application.(After installation of GATE with Prerequisites). I think it'll give run time exception.
 
Winston Gutkowski
Bartender
Posts: 10780
71
Hibernate Eclipse IDE Ubuntu
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator

Ramakrishna Udupa wrote:Okay. Can you do me a favor? Just run THIS example with all libraries in classPath in simple java application...


And that will tell me what, precisely? It sounds like you want us to do the work for you.

As I say, I've never used GATE, so simply running a simple app won't tell me what YOUR concerns are. But a good explanation might.

Winston
 
Ramakrishna Udupa
Ranch Hand
Posts: 254
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator

It sounds like you want us to do the work for you.


If that satisfy my requirement, why would I create this topic. No, nothing like that. Its just an example program. In that class they hard-coded to find all person and location. The program will take input file/URL and find all Persons and locations in that file. It only do that much. But, to run Its giving run-time exception. Like, I've to configure in configuration file. But, I dint get any configuration file with that StanAloneAnnie.java. So, I asked you. May be you'll find the problem, what I'm facing.

so simply running a simple app won't tell me what YOUR concerns are. But a good explanation might.


I don't think it is best example. But, its enough to get know the functionality of Gate.

As I say, I've never used GATE


No, Its Okay. Actually I thought, may be today or tomorrow someone who look this post and already solved this problem will also guide me. That's why I'm specific to StandAloneAnnie.java.

Thanks:
Ramakrishna K.C
 
Sheriff
Posts: 10445
227
IntelliJ IDE Ubuntu
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Like Winston, I too am not sure why you think you need a language processing tool for scraping websites which publish reviews, when more credible and tangible mechanisms exist ( like using the actual rating).

As for that tool specific issues, I think it's too specialized and questions related to that will be better answered in their own forums if they exist.
 
Ramakrishna Udupa
Ranch Hand
Posts: 254
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
@Jaikiran Pai I agree that. But, on the basis of ratings I've to sort it out. For that,

1) I've to write the logic.
2) There will be cases like e.g. a camera can be rated as good for a photographer, but too complex for the casual user.

So, there may be other cases we know while implementing it and all of these I've to address. when I asked with my team they told "there are several tools for that. Use one of them, it'll take time if we write logic and also there may be difficult in maintenance too ".
Tools are tested, implemented and using by lots of experts. So, I consider the tool. yes, it is advanced topic.

As for that tool specific issues, I think it's too specialized and questions related to that will be better answered in their own forums if they exist.


Did that and waiting for reply.

Thanks:
Ramakrishna K.C
 
Winston Gutkowski
Bartender
Posts: 10780
71
Hibernate Eclipse IDE Ubuntu
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator

Ramakrishna Udupa wrote:Did that and waiting for reply.


Then, since you don't seem willing to actually TellTheDetails (←click), I suspect you may be waiting far longer than tomorrow.

Next time, I suggest you listen to our instructions and ShowSomeEffort.

Winston
 
Ramakrishna Udupa
Ranch Hand
Posts: 254
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator

Next time, I suggest you listen to our instructions and ShowSomeEffort.



I think I did that. But, you told

It sounds like you want us to do the work for you. As I say, I've never used GATE

 
Marshal
Posts: 28193
95
Eclipse IDE Firefox Browser MySQL Database
  • Likes 1
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Are you seriously suggesting that you want us to download some code, install some software, and some more software, and run it to see if we get a runtime exception? As you can see, nobody wants to do that. It would make a whole lot more sense if you told us what the exception was. It's possible that you just have a simple configuration error. But since you haven't told us any of the details there's no way to tell.
 
Ramakrishna Udupa
Ranch Hand
Posts: 254
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
@Paul Clapham I got you. I've a configuration file in my simple Core-Java App.

gate.xml


creole.xml


StandAloneAnnie.java is HERE. with all libraries.


I'm getting the exception like this,




Thanks:
Ramakrishna K.C
 
Rancher
Posts: 43081
77
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
That seems to be a problem that is indeed closely related to this rather uncommon software, so unless by chance someone here knows that, the odds of getting a meaningful answer are probably slim.

I assume you have rerun the code while adding the missing "-Dgate.plugins.home" property? That's what it's complaining about, after all. Does it produce the same error message, or some other one?
 
Ramakrishna Udupa
Ranch Hand
Posts: 254
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
@Ulf Dittmer Yes. I configured this in creole.xml. See my previous post with snippet. But, I'm getting same exception. They told in prerequisites that set gate.home in System Property. I set that. Still, giving same exception.
 
Paul Clapham
Marshal
Posts: 28193
95
Eclipse IDE Firefox Browser MySQL Database
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
You provided a value for that system property in the command line where you started the application? Then if there's still a problem, it may well lie with the value you provided. I'm guessing it's supposed to be a path to where the plugins are located, or something like that, but my guess is just based on what I've seen here. Perhaps the documentation contains more information.

If it's a path, then it's possible that you didn't specify it correctly on the command line. For example a system property value with a space in it might be easy to get wrong.
 
With a little knowledge, a cast iron skillet is non-stick and lasts a lifetime.
reply
    Bookmark Topic Watch Topic
  • New Topic