Re: [Snowball-discuss] Stemming 'communing' and 'communed'

From: Martin Porter (martin.porter@grapeshot.co.uk)
Date: Thu Mar 29 2007 - 09:15:00 BST


> ... my algorithm stems it to "commun". I have run through the spec
> 'by-hand' many times and cannot figure out how to get to the proper
> stemming.
>

Michael,

The reason is that prefix 'commun' is handled specially by Porter2 (see
the 'mark_regions' routine) so that in effect it is treated as one
syllable, rather than two syllables. So 'communing' behaves like
'tuning' etc. Similarly Porter2 stems 'communism' to 'communism' while
Porter stems 'communism' to 'commun'.

Were you thinking of contributing your PHP version to

http://snowball.tartarus.org/otherlangs/index.html

?

Martin



This archive was generated by hypermail 2.1.3 : Thu Sep 20 2007 - 12:02:49 BST