Setting up a HttpURLConnection and trying to retrieve a page is about the only thing I have done. I wonder why that's taking too much time for you. If the server is up it should respond pretty quickly, and if it's down
you should get the error even more quickly.
I have done this on web services and found a system where the HTTP server was up so I got no HTTP error, but the business service was "stopped" somehow. By some quirk in their code it just never returned anything.
You might find some administrative interface to query. In Java 5 and later, see how JConsole connects to a JVM and queries it. Can't imagine the connect would be much faster than an HttpURLConnection.