AWK experts - how would I code around this in awk...

[Steve Flynn]

On Fri, Feb 19, 2010 at 3:30 PM, Karl Auer <kauer at biplane.com.au> wrote:
> On Fri, 2010-02-19 at 12:58 +0000, Steve Flynn wrote:
>> N=10:     1m 18 seconds
>> N = 100:     12 seconds
>> N = 1000:     6 seconds
>> N=32768:     5 seconds
>
> From the look of it, caching is helping the reads here, so be warned
> that it may not be a fair test! Try running the the first test twice -
> or again after the last.

I thought the same thing Karl, however I actually ran them in reverse
order; 32768 first which would imply that either the caching is gets
worse as time goes on or it's not a factor! :)

I'm waiting for the data owners to supply me with a nice realistically
sized file (say > 100 million records) with a good fixed width size.
I'm slightly concerned that the 32K barrier record width might prove
to be too short but as the data causing us problems is human keyed
medical history, I'm hoping no-one has that much! :)

-- 
Steve
When one person suffers from a delusion it is insanity. When many
people suffer from a delusion it is called religion.

09 F9 11 02 9D 74 E3 5B D8 41 56 C5 63 56 88 C0