Java selenium parsing PDF file from browser

[Milos Radovic]

Hi everyone,

I'm trying to parse a PDF file that is opened in Chrome. Here is the relevant code:

Main Class:

public class SwitzerlandDB {
	
public static String validPeriod;
	public static URL url;
	
	public static void main(String[] args) throws InterruptedException, IOException, AWTException, DocumentException, SQLException{
		 //Opening Google Chrome  
		System.setProperty("webdriver.chrome.driver", "C:\\Selenium Files\\chromedriver.exe");
		WebDriver driver = new ChromeDriver();


		#
		#
		#

		 validPeriod = driver.findElement(By.xpath("//*[@id='offer_validity']/form/table/tbody/tr/td/table/tbody/tr[2]/td/table/tbody/tr/td[2]/input[1]")).getAttribute("value");
		
		url = new URL(driver.getCurrentUrl());
		            String text = "This offer is valid for "+validPeriod+" days";
		            System.out.println(url);
		            System.out.println(text);
		            
		            ReadPDF rd = new ReadPDF();
		            
		            rd.readPDF(rd.strip);
		            
		            if(rd.strip.contains(text)) {
		            	
		            	System.out.println("Days of Offer validity are the same on the web page and in the Offer PDF! Test OK.");
		            }else {
		            	
		            	System.out.println("Days of Offer validity are NOT the same on the web page and in the Offer PDF! Test OK.");
		            }

	}
}

ReadPDF Class:

import java.io.BufferedInputStream;
import java.io.IOException;
import java.io.InputStream;
import org.apache.pdfbox.pdmodel.PDDocument;
import org.apache.pdfbox.util.PDFTextStripper;


public class ReadPDF {
	SwitzerlandDB sw = new SwitzerlandDB();
		
	
	public String readPDF(String read) throws IOException, InterruptedException {
		
		
	read = sw.url.toString();

	InputStream istream = sw.url.openStream();
	BufferedInputStream bis=new BufferedInputStream(istream);

	PDDocument document = PDDocument.load(bis);
	pdfContent = new PDFTextStripper().getText(document);

	return pdfContent;

	}
}

 


Console error message:

Exception in thread "main" java.io.IOException: Error: End-of-File, expected line
at org.apache.pdfbox.pdfparser.BaseParser.readLine(BaseParser.java:1519)
at org.apache.pdfbox.pdfparser.PDFParser.parseHeader(PDFParser.java:360)
at org.apache.pdfbox.pdfparser.PDFParser.parse(PDFParser.java:186)
at org.apache.pdfbox.pdmodel.PDDocument.load(PDDocument.java:1230)
at org.apache.pdfbox.pdmodel.PDDocument.load(PDDocument.java:1197)
at switzerlandDB.ReadPDF.readPDF(ReadPDF.java:36)
at switzerlandDB.SwitzerlandDB.main(SwitzerlandDB.java:1182)

The error "at switzerlandDB.ReadPDF.readPDF(ReadPDF.java:36)" referes to this line:

PDDocument document = PDDocument.load(bis);

The error at "switzerlandDB.SwitzerlandDB.main(SwitzerlandDB.java:1182)" referes to this line:

rd.readPDF(rd.pdfContent);

Anyone knows what am I doing wrong?
Thank you!

[Dave Tolls]

Are you sure that that is actually a PDF file in the stream?
Have you tried to save the data in the stream to a file and see what is actually in it, rather than try and treat it as a PDF straight away.

[Milos Radovic]

It turns out that it is an embedded PDF.

The URL looks similar to this: http://something.com/printed.php?printable=yes&reanudar=&detalle=&idioma=1¬ax=no&smart=3&pageBreaks=[]
The source code looks like this:

<embed id="plugin" type="application/x-google-chrome-pdf" src="######/printed.php?printable=yes&reanudar=&detalle=&idioma=1&notax=no&smart=3&pageBreaks=[]" stream-url="blob:chrome-extension://mhjfbmdgcfjbbpaeojofohoefgiehjai/29467a15-f093-488b-aacd-c8c03de3dec3" headers="Access-Control-Allow-Headers: Content-Type, origin, accept, Token, Udid
Access-Control-Allow-Methods: POST, GET, OPTIONS, DELETE, PUT
Access-Control-Allow-Origin: *
Cache-Control: private, must-revalidate, post-check=0, pre-check=0
Connection: close
Content-Disposition: inline; filename="3998__0555880_D011_9555555580_71053869_2018_12_18_15_40_50_839efce89bf34eb0e80400f6c406c2c1.html_privacy.pdf"
Content-Length: 113351
Content-Transfer-Encoding: binary
Content-Type: application/pdf
Date: Tue, 18 Dec 2018 14:40:49 GMT
Expires: 0
Pragma: private
Server: Apache
Vary: User-Agent
X-Powered-By: PHP/5.6.30 ZendServer/8.5.7
X-UA-Compatible: IE=EmulateIE7
" background-color="0xFF525659" top-toolbar-height="56" javascript="allow" full-frame="">

You have any idea how to solve this?

[Dave Tolls]

No idea.
So I take it that URL does not return a PDF?

[Milos Radovic]

If I just paste the URL into the browser it returns me to the login page of the application.

[Bhushan Shet]

Were you able to find a solution for your issue? if so it would be really helpful if you could post it here

[Milos Radovic]

Hi guys, in the end, I solved the problem by downloading the PDF on my computer using Javas Robot Class and then parse the PDF.

The ReadPDFde class:

public class ReadPDFde {
	
	
public static String pdfContent;
	
		
	public static String readPDF() throws IOException, InterruptedException {
		
                //The Main Class
		GermanyDB de = new GermanyDB();

		
        		    InputStream istream = de.url.openStream();
        	
		            BufferedInputStream bis = new BufferedInputStream(istream);		       
		            
		            PDDocument document = PDDocument.load(bis);)
		            pdfContent = new PDFTextStripper().getText(document);		           
		            
			    return pdfContent;
	}

}

Mian Class (GermanyDB):

WebElement rightclick = driver.findElement(By.id("plugin"));

		    //ctrl+s to save the file
	            rightclick.sendKeys(Keys.chord(Keys.CONTROL, "s"));
	            Thread.sleep(3000);
	            
	            Robot rob = new Robot();
	             
	             //rename the file	             
	             rob.keyPress(KeyEvent.VK_N);
	             rob.keyPress(KeyEvent.VK_E);
	             rob.keyPress(KeyEvent.VK_W);
	             rob.keyPress(KeyEvent.VK_F);
	             rob.keyPress(KeyEvent.VK_I);
	             rob.keyPress(KeyEvent.VK_L);
	             rob.keyPress(KeyEvent.VK_E);
	             Thread.sleep(2000);
	             
	             //press enter
	             rob.keyPress(KeyEvent.VK_ENTER);
	             Thread.sleep(6000);
	             
	             //path to the file where the pdf was saved
	             url = new URL("file:///C:/Downloads/newfile.pdf");
	           	            
	            ReadPDFde rd = new ReadPDFde();
	            
	            System.out.println(rd.readPDF());

                    //To compare if some string is present in the PDF
                    if(rd.pdfContent.contains(note)) {
	            	
	            	System.out.println("Note is present.");
	            }else {
	            	
	            	System.out.println("Note is not present.");
	            }

[Rekha Gouda]

Hi

This robot framework doesn't support headless mode.So how to make this code run in headless mode.

Thanks,
Rekha