[CoLoCo] bash question

[Joey Stanford]

I think the easier way is going to be with awk ... but here's a python
program that's roughly equivalent...just not looking for the 3rd field

#! /usr/bin/env python

data = open('big2.log')
totals = {}
for line in data:
    line = line.strip()
    if line:
        pageid = line.split()[1]
        pagecount = int(line.split()[0])
        if pageid in totals:
           totals[pageid] += pagecount
        else:
           totals[pageid] = pagecount

for key in totals:
        print totals[key], key


On Fri, Aug 19, 2011 at 14:45, Jim Hutchinson <jim at ubuntu-rocks.org> wrote:
> Wondering if any of you script gurus can help with a small problem. I have
> several text files containing 3 columns. I was to count the number of
> occurrences of the text in column 2 (or just count the lines) and sum column
> 3 which is a number. I know how to do the latter with something like
>
> #!/bin/bash
>
> file="/home/test/file1.txt"
> cat ${file} | \
> while read name article count
> do
> sum=$(($sum + $count ))
> echo "$sum"
> done
>
> Although that prints each sum as it goes rather than just the final sum.
> I'm not sure how to count text (basically counting the lines that contain
> the numbers would work the same). Also, because each file has a header row
> it's giving errors so I need to tell it to skip row 1.
> Finally, I want to automate the input of each file so having it read the
> list of text files from somewhere, process the file, output to a new file
> amending each time, and then repeat with the next one until all files are
> done.
> Any ideas?
> Thanks.
> --
> Jim (Ubuntu geek extraordinaire)
> ----
> Please avoid sending me Word or PowerPoint attachments.
> See http://www.gnu.org/philosophy/no-word-attachments.html
>
> --
> Ubuntu-us-co mailing list
> Ubuntu-us-co at lists.ubuntu.com
> Modify settings or unsubscribe at:
> https://lists.ubuntu.com/mailman/listinfo/ubuntu-us-co
>
>