How to input big big ascii files

[Jimmy Chen]

I want to input a very big txt file(about 500m) and analysis it.

Unless I read it all, I can't analysis it. But it's so big, I'm afraid
java can't deal with it. Can I use a array like 50000*50000? Is it a big
problem to jvm?

thanks!

[William A White]

Depending on the kind of analysis you need to do, you probably don't need to load the whole thing into memory. Just read it line by line, discarding each line as it is read and analyzed.

[Joe Ess]

Originally posted by Yu Liang:
I'm afraid java can't deal with it.

It isn't Java you have to worry about. It's your hardware. Do you have over 500Mb of ram? You should take a look at
Memory-mapped files.

[Steven Bell]

You may want to look at the FileChannel and MappedByteBuffer classes.

[Jimmy Chen]

Thanks you all. I will try.