AWK experts - how would I code around this in awk...
Steve Flynn
anothermindbomb at gmail.com
Fri Feb 19 12:58:17 UTC 2010
On Fri, Feb 19, 2010 at 12:52 PM, Chan Chung Hang Christopher
<christopher.chan at bradbury.edu.hk> wrote:
> For performance, it is C, awk and then perl/python...hmm...not sure
> where php sits. At least, that was how it was back in 2002-2006 when I
> had to parse a few dozen hourly mail log files that were each over 1GB
> in size.
Ran the perl version (Thanks Karl!) through some test data this morning.
Whilst the data itself is no good for this test, I wanted to see the
effects of various values of n (the required record length).
Results are as follows:
File with 1,375,031 lines in it.
N=10: 1m 18 seconds
N = 100: 12 seconds
N = 1000: 6 seconds
N=32768: 5 seconds
32768 will be the limit, as this is a system limit on the MVS
mainframe creating the file.
I'm still waiting to get hold of a suitably large file to give it a
proper workout but so far, it seems promising.
--
Steve
When one person suffers from a delusion it is insanity. When many
people suffer from a delusion it is called religion.
09 F9 11 02 9D 74 E3 5B D8 41 56 C5 63 56 88 C0
More information about the ubuntu-users
mailing list