Access website through vpnbook.com

[parag humane]

I am working on application to access a web page through vpnbook.com.

my code is sending post request to URL "https://webproxy.vpnbook.com/includes/process.php?action=update" with post parameter as "u=yahoo.com&webproxylocation=random"
i am getting response code 302. and HTTP response header contains location "Location=[http://www.vpnbook.com/webproxy]"

But same request was getting correct correct result when opening through web browser.
result contains header response "Location:https://usproxy.vpnbook.com/browse.php?u=DWnjEwVwhlG5GQhW&b=0&f=norefer"

please tell me what is going wrong in my code.

		try{
			URL	url = new URL("https://webproxy.vpnbook.com/includes/process.php?action=update");
			HttpsURLConnection c = (HttpsURLConnection) url.openConnection();
			c.setRequestProperty("User-Agent", USER_AGENT);
			c.setRequestProperty("Accept-Language", ACCEPT_LANG);
			c.setRequestProperty("Accept", "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8");
			c.setRequestProperty("Host", "webproxy.vpnbook.com");
			c.setRequestProperty("Origin", "http://www.vpnbook.com");
			c.setRequestProperty("Referer", "http://www.vpnbook.com/webproxy");
			c.setRequestMethod("POST");
			c.setDoInput(true);
			c.setDoOutput(true);
			DataOutputStream wr = new DataOutputStream(c.getOutputStream());
			wr.writeBytes("u=yahoo.com&webproxylocation=random");
			wr.flush();
			wr.close();
			
			int responseCode = c.getResponseCode();
			System.out.println("\nSending 'GET' request to URL : " + url);
			System.out.println("Response Code : " + responseCode);
			System.out.println("Response headers : " + c.getHeaderFields());
			Map<String, List<String>> resHdr = c.getHeaderFields();
			if(	resHdr.containsKey("Set-Cookie") ){
				cookies=resHdr.get("Set-Cookie").toString();
				cookies = cookies.replaceAll("\\[|\\]", "");
				System.out.println(cookies);
			}
			
			BufferedReader in =
		            new BufferedReader(new InputStreamReader(c.getInputStream()));
			String inputLine;
			StringBuffer response = new StringBuffer();

			while ((inputLine = in.readLine()) != null) {
				response.append(inputLine);
			}
			in.close();
			
			System.out.println(response);
		}catch(Exception ex) { ex.printStackTrace(); }

[Jeanne Boyarsky]

Some possibilities for why this might be happening:

It is a paid service

They are checking for a valid session

They are checking for certain parameters to be present (like CSRF)

They are checking that you are a browser and not a screen scraper

Basically, is it allowed to be doing this.

[parag humane]

can you give me solution to do this using java.
i succeed using web driver but i have to do this without using browser.

[Tim Moores]

A 302 response is a redirect, which the code doesn't handle. See http://www.mkyong.com/java/java-httpurlconnection-follow-redirect-example/ for how to go about that.

[parag humane]

Tim Moores wrote:A 302 response is a redirect, which the code doesn't handle. See http://www.mkyong.com/java/java-httpurlconnection-follow-redirect-example/ for how to go about that.

I know how to handle redirect in java it is not a big deal for me.

My problem is i am not getting correct response header. i am getting response code 302 that is OK but in response header data, contains
Location=[http://www.vpnbook.com/webproxy]
I am expecting response header
"Location:https://usproxy.vpnbook.com/browse.php?u=DWnjEwVwhlG5GQhW&b=0&f=norefer"

because when accessing web site from browser i am getting same header response
"Location:https://usproxy.vpnbook.com/browse.php?u=DWnjEwVwhlG5GQhW&b=0&f=norefer"

what is way to get above header response?

[Dave Tolls]

Have you gone through the dev tools for your browser to see what the sequence of calls is for that page?