problem with reading text by POI Apache.

[Pezhman Na]

hi, I wrote the code below to extract text from MS Word doc. it's working well except when it reads the last word of the paragraph I guess it read the new line as well, fro example when I retrieve the length of last token it returns the length of the token plus one.since I wanna compare this token with others I need to be only characters. I'd appreciate your idea to fix this bug, thanks

  
        WordExtractor extractor = null ;
	int j = 0;
	try{
              String delims = "[ {}.,?!%+\\-*/\\^_=)(&%$#@\\[\\]|:;'\"<>\n\t]+";
		File file = null;
		file = new File("C:\\beta.doc");
		FileInputStream fis=new FileInputStream(file.getAbsolutePath());
		HWPFDocument document=new HWPFDocument(fis);
		extractor = new WordExtractor(document);
		String [] fileData = extractor.getParagraphText();
		for(int i=0;i<fileData.length;i++)
		{
			if(fileData[i] != null)
			{
				String[] ttokens = fileData[i].split(delims);
				for(int h = 0 ; h < ttokens.length ; h++)
				{
					
					
					Token temp = new Token(j, ttokens[h],ttokens[h].toString().length());
	        		        tokens.add(temp);
	        		j++;
				}
			}
		}  

[Greg Charles]

I don't know how MS Word delimits its lines, but a Windows text file uses \r\n. I don't see \r in your list of delimiters, so that could be it. You say the last token is one character bigger than you expect. Can you look at that last character? That would be the easiest way to diagnose the problem.

[Pezhman Na]

Greg Charles wrote:I don't know how MS Word delimits its lines, but a Windows text file uses \r\n. I don't see \r in your list of delimiters, so that could be it. You say the last token is one character bigger than you expect. Can you look at that last character? That would be the easiest way to diagnose the problem.

thanks buddy, it worked properly