I want to use Web Crawler in my Java Web Application it is a Struts 1.1 Application in Java 1.4.
Problem is that Nutch is an open source which is available but its current version 1.1 will work only in java 1.6 and its previous versions are not available which will work in 1.4.
So, please help me to find a solution which is open source for Web Crawler.