a simple tokenizer based on regular expressions

Read the readme file.

Download the regexp_tokenizer-0.01.tar.gz archive.

If you use, I would be very curious to get some feedback from you. Please send email to baroni AT sslmit unibo it. is a perl script, and you may copy or redistribute it under the same terms as Perl itself.

Back to Marco's tools and resources page