Text to tokens?

[joeF]

Hi:
I know that I can break a string into tokens by using StringTokenizer
but how do I accomplish this task if I am using FileReader to read the file as characters?
(if possible please provide sample code)
Thanks.

[Eric Fletcher]

Check out the API for StreamTokenizer.StreamTokenizer
Here is an article describing how to use it with code samples.Using StreamTokenizer
Hope that helps,
E

[Jim Yingst]

Another common technique (usually easier then StreamTokenizer, but it depends what you're doing) is to use a BufferedReader to read one line at a time:

    BufferedReader reader = new BufferedReader(new FileReader("filename.txt"));
    try
    {
      String line;
      while ((line = reader.readLine()) != null)
      {
        // parse line with StringTokenizer or other methods
      }
    }
    finally { reader.close(); }

[joeF]

Thanks.