Thanks to zasync, I can send some processes to the baground in zope (see past posts in this blog)

We have an intranet where we want to distribute background processes to several machines, so we want to use several zasync clients to maximize the number of simultaneous bakground processes.

Based on the recipe Gary Poster gave me, I have created a tiny Z2 product (about 10 lines of code) that instanciate a folderish object in the ZODB and let the admin create asynchronous call manager objects in it.
Each asynchronous call manager object is linked to a zasync client by changing a few params in the conf file.

The folder object (=the dispatcher) publishes a few APIs (putCall, putSessionCall)

My code calls it and let the dispatcher choose wich asynchronous call manager is the less busy and forward the call to it.

That let the administrator freely add or remove zasync clients, it's  pretty smooth :)

Thanks Gary !

the code is here if you want to use it:

http://svn.nuxeo.org/trac/pub/browser/zasyncdispatcher/

Reverend is a lightweight python tool by Amir Bakhtiar that provides a bayesian classifier. It's a perfect tool to classify spam mails for instance.

http://www.divmod.org/projects/reverend

It was its first use case anyway, since the authors based it on Christophe Delord PopF tool:

http://christophe.delord.free.fr/

I need this tool for the webmail I am coding but since I have thaught of many other usages in zope for a bayesian classifier, I have created a small Zope 3 utility (very early stage right now).

The Z3 product is called "zreverend" and wraps reverend into zope by:

• automatically saving the bayesian network into persistent dictionnaries in the ZODB
• publish all useful methods to use reverend in some code
• provide a minima managment screen
• ... more to come i guess
  

That's my first "pure" zope 3 product so besides its usage it provided me a good training. (it still needs some good code review though)

Notice that Zope 2 developers can use it through Five, by manually instanciate ZBayes objects, like I did in CPSMailAccess with zemantic and like I will with zreverend.

Browse the code here:

https://svn.nuxeo.org/trac/pub/browser/z3lab/zreverend/trunk/

get the code with svn like this:

svn co https://svn.nuxeo.org/pub/z3lab/zreverend/trunk/ zreverend


If this tool is somehow useful to you or if please let me know !

Reinout van Rees is just doing an amazing job in his blog for EP feedback http://vanrees.org/weblog/

I have been at Michael Salib's talk about Xapian, "Stupidity and laser cat toys: Indexing the US Patent Database with Xapian and Twisted"

Xapian is a probabilistic text search engine.

Michael used to index the US Patent Database, wich is pretty big indeed.He wrote a python wrapper called Xapwrap, that you can get here:

http://divmod.org/projects/xapwrap

Michael explained that Xapian was prefered to Lucene because It easier to wrap into Python and provided faster queries and a better precision.

I'm waiting for Michael to upload the slides on the EP sites to give more precise feedback on this.

More info on PyLucene here: http://www.sauria.com/~twl/conferences/pycon2005/20050325/Pulling Java Lucene into Python.html(PyCon05 notes)

feature-wise, Xapian has eveything needed to run a scalabale text engine.(stemming based on snowball, meta-indexes, etc..) It optionnally uses twisted's python.log for logging.

• Lucene features: http://lucene.apache.org/java/docs/features.html
• Xapian features: http://www.xapian.org/features.php

I have the feeling that Xapian would fit pretty well as an external indexer for z3