Win a copy of Functional Reactive Programming this week in the Other Languages forum!
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic

Monitoring a website for changes

 
Richard Alves
Greenhorn
Posts: 12
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
So I'm not sure if this goes in this thread, but its the best I could think of.

The problem I'm trying to solve is I need to write a code to monitor a webpage and when the webpage changes to either send an email and or make a notification sound, because I can't get access to the source code. This webpage is typically open on android devices so there is that to consider. I can't use an existing program mainly because I haven't found one that checks continuously or at least every thirty seconds or so. I am open to using a different programming language, but I've had more experience with java and C / C++. Any suggestions would be great!

Thanks a ton!
 
harshvardhan ojha
Ranch Hand
Posts: 157
1
Android Java MySQL Database
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
why don't you use something like http://www.changedetection.com.

Or the other way would be to crawl that web page and index, so that you can know when that page got modified.
 
William Brogden
Author and all-around good cowpoke
Rancher
Posts: 13074
6
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
If the web server is generating correct Last-Modified headers, you could use a HTTP HEAD request instead of GET, thus putting less burden on the server.

See java.net.HttpURLConnection docs for setRequestMethod()

Bill
 
Richard Alves
Greenhorn
Posts: 12
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
harshvardhan ojha wrote:why don't you use something like http://www.changedetection.com.

Or the other way would be to crawl that web page and index, so that you can know when that page got modified.


Well unfortunately the website only updates once a day at maximum from what I can tell. I would need to know within a minute or two at max that it has changed.
 
Hikari Shidou
Ranch Hand
Posts: 88
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Could you provide an example of that website? It must be very old if it doesn't have RSS...

Many many ears ago I used an app that verified websites for changes and notified me, something like a RSS reader lol
 
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic