AWK experts - how would I code around this in awk...

Karl Auer kauer at biplane.com.au
Tue Feb 23 00:31:04 UTC 2010


On Mon, 2010-02-22 at 22:24 +0000, Steve Flynn wrote:
> > A real test would be to see how big Steve Flynn's variables can get :-)
> 
> Fnarr! :)

Fnarr! Fnarr, fnarr, fnarr!  >snort<

> > The likelihood is that a partial record is not wanted anyway.
> 
> Nope, it's not, and if the spec runs true there shouldn't be any
> partial records, period.
> 
> We've all seen specs like that however.

Plus you might want to issue a warning if a partial record turns up,
rather than silently discard it. With 3.8 terabytes to convert, I'm
guessing you won't be watching the migration.

How are you sanity checking the input? Is that being left to the DB
import stage? There might be things you can do that will save a lot of
time, disk space and CPU cycles if the export was done wrongly. You
might need to check for 7-bit clean or something. Anything unexpected,
basically.

Regards, K.

-- 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Karl Auer (kauer at biplane.com.au)                   +61-2-64957160 (h)
http://www.biplane.com.au/~kauer/                  +61-428-957160 (mob)

GPG fingerprint: B386 7819 B227 2961 8301 C5A9 2EBC 754B CD97 0156
Old fingerprint: 07F3 1DF9 9D45 8BCD 7DD5 00CE 4A44 6A03 F43A 7DEF
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 197 bytes
Desc: This is a digitally signed message part
URL: <https://lists.ubuntu.com/archives/ubuntu-users/attachments/20100223/c5771bd1/attachment.sig>


More information about the ubuntu-users mailing list