Kevin,
I believe how whitespace is handled depends on how you set up your StringTokenizer.
I used the constructor
StringTokenizer( String s ); which works as follows:
Constructs a string tokenizer for the specified string. The tokenizer uses the default delimiter set, which is "\t\n\r\f": the space character, the tab character, the newline character, the carriage-return character, and the form-feed character. Delimiter characters themselves will not be treated as tokens.
If this is not what you had in mind, you could check out one of the other StringTokenizer constructors.
Sorry, I've never used StremTokenizer, so I don't know about it.
Stephanie