This sounds similar to http://bugzilla.kernel.org/show_bug.cgi?id=5038 Could those of you experiencing this bug try some of the tests/workarounds there?
** Changed in: linux-source-2.6.15 (Ubuntu)
Target: ubuntu-6.06 => None
--
System clock runs far too fast
https://launchpad.net/malone/bugs/17589