Call for testing: new CJK support for xapian

David Barth david.barth at canonical.com
Mon Aug 8 15:02:38 UTC 2011


Hi,

Recently we have proposed a patch to let Xapian support CJK and let 
programs using it index and return results for those locales. The patch 
is based on the work of Brandon Schaefer and Mikkel Kamstrup.

We're looking for feedback about potential regressions caused by the 
change. We suggest to check against regressions with classic locales 
first (ie, "C" and a couple of other UTF-8 ones). Then verify that CJK 
strings are properly indexed. And then confirm with a few test queries, 
as applicable to the various programs.

In our limited testing, based on Unity and Software Center, we were not 
able to identify issues, ie: both the existing locales and the new CJK 
ones are returning results as expected.

Since CJK testing may not be everyone's speciality, you can either ask 
in the development community of a given program. Or if you have a reason 
to think that it may not work or is broken, have that be confirmed by 
one of our OEM specialists. Chris Gregan (CC'ed) is the point of contact 
for that part.

The patch went through a number of iterations and reviews with upstream. 
And now Didier has prepared test packages, available at:
https://launchpad.net/~ubuntu-desktop/+archive/ppa 
<https://launchpad.net/%7Eubuntu-desktop/+archive/ppa>

The change does require rebuilding indices though, so packages depending 
on libxapian should check for that on upgrade.

Targets for testing are based on the reverse dependency list of 
libxapian and its binding, ie:

apt-cache rdepends libxapian22
libxapian22
Reverse Depends:
   unity-lens-applications
   xapian-tools
   xapian-omega
   tclxapian
   recoll
   pinot
   packagesearch
   maildir-utils-gtk
   maildir-utils
   libxapian-ruby1.8
   libsearch-xapian-perl
   libnotmuch1
   goplay
   debtags
   aptitude-gtk
   adept
   xapian-examples
   unity-place-applications
   synaptic
   python-xapian
   libxapian22-dbg
   libxapian-dev
   libqapt1
   aptitude

And for example, for the Python bindings
apt-cache rdepends python-xapian
python-xapian
Reverse Depends:
   software-store
   roundup
   python-jarabe-0.84
   python-django-djapian
   python-carquinyol-0.90
   python-carquinyol-0.88
   python-carquinyol-0.86
   python-carquinyol-0.84
   pootle
   penguintv
   fuss-launcher
   zeitgeist-extension-fts
   software-center
   sessioninstaller
   python-xappy
   python-moinmoin
   apt-xapian-index

Please send your feedback to this bug report:
https://bugs.launchpad.net/ubuntu/+source/xapian-core/+bug/822743

Thanks

David



More information about the ubuntu-devel mailing list