• Post Reply Bookmark Topic Watch Topic
  • New Topic

search engine

 
Edward Chen
Ranch Hand
Posts: 798
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
I want to search remote news group with some key words and monitor a specific website if there is updating news. which search engine is fit for this purpose?

thanks
 
Jeroen Wenting
Ranch Hand
Posts: 5093
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Look for an NNTP package to read newsgroups (the protocol is I think rather simple so could be a candidate to dive headfirst into network and multithreaded programming).

For news sites, you'd best be very careful as most require a paid subscription to use their services except through the website itself (which are advertising sponsored).
If you do take out a subscription you'll usually get instructions on how to retrieve the data (which in my experience more often than not comes as an XML file which you can download from a special location to which only subscribers have access).
A simple program that periodically retrieves this data and does something with it (either place it on your system where another application can be used to view it or maybe it can make HTML out of it).
 
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!