Forums Register Login

Writing a spider

+Pie Number of slices to send: Send
Okay... so I have an application that needs to be spidered. The issues at hand are such
1) needs to be able to fill out a form field before spidering
2) needs to handle javascript
3) needs to start at a specified location after the form field has been filled out
I was thinking about writing this using HTTPUnit. Has anyone written one using this? Does anyone have any other ideas or programs that I might be able to use. Any ideas would be appreciated.
Regards,
Dale DeMott
+Pie Number of slices to send: Send
I guess that we are not into creepy crawling critters in Intermediate .
Let's move this to Advanced and see if they can offer some advice.
+Pie Number of slices to send: Send
What is implied in that "needs to handle Javascript" ???
Do you mean it needs to parse out forms, etc that have Javascript mixed in to the HTML or that it has to execute JavaScript.
I just used HttpClient (from the Jakarta Commons toolkit) to create a load tester that faked responding to a form. I had to use JTidy to get a parsed DOM representation of the page because the HTML was not well formed.
Bill
Right! We're on it! Let's get to work tiny ad!
a bit of art, as a gift, that will fit in a stocking
https://gardener-gift.com


reply
reply
This thread has been viewed 649 times.
Similar Threads
HTML Form
Referencing A Form Inside Of A Form
Excel by email using struts framework
JTable - editing Objects
Master Detail form in JSP
More...

All times above are in ranch (not your local) time.
The current ranch time is
Mar 28, 2024 18:54:02.