index

module utilities.stemmer

Stemmer

stemmer.py

Contains an utterly simplistic stemmer.

Originally we used a stripped down version of the Porter stemmer, but the
version in here performed at the same level. Note that this stemmer is only used
for those cases when a token does not have a lemma.

class Stemmer

Inherits from: object

Public Functions

__init__(self)

stem(self, key)
Look up key in stem exceptions file. Use the porter stemmer
if key is not in exceptions file.

module functions

strip_plural(token)
Strip away what looks like a plural s.