Hi,
I need some guidance on what approach should I use to solve this problem:
I have an ascii file, say file1 on a unix system. I have to read that file, apply some logic and output the result in another ascii file, say file2. The problem is that the file1 has > 100,000 records. So which of these A, B or C is a good approach:
A. Program in Java (or even C)... but bcos there are so many records, searching based on the logic will take lot of time. Also if I do this in Java, how do I deploy this on the unix box so that its scheduled to run automatically.
B. Load the ascii file in a database, perform some sql and dump it back to output ascii file. So there's no java or c involved here.
I'm not looking for the implementation detail but just the basic approach to take or even any good way or feature of unix I should study or something else. Thanks a lot!!
I need some guidance on what approach should I use to solve this problem:
I have an ascii file, say file1 on a unix system. I have to read that file, apply some logic and output the result in another ascii file, say file2. The problem is that the file1 has > 100,000 records. So which of these A, B or C is a good approach:
A. Program in Java (or even C)... but bcos there are so many records, searching based on the logic will take lot of time. Also if I do this in Java, how do I deploy this on the unix box so that its scheduled to run automatically.
B. Load the ascii file in a database, perform some sql and dump it back to output ascii file. So there's no java or c involved here.
I'm not looking for the implementation detail but just the basic approach to take or even any good way or feature of unix I should study or something else. Thanks a lot!!