NAME

Tokenize - Split up data on whitespace into tokens.

SYNOPSIS

use Tokenize;

my $t = Tokenize->new();

$t->tokenize($data);

DESCRIPTION

This module tokenizes data, where a token is delimited by whitespace.

new()

Reterns an instance of the class.

tokenize($data)

Tokenizes the data supplied in the array reference $data.

AUTHOR

Iestyn Pryce, <imp25@cam.ac.uk>

ACKNOWLEDGEMENTS

I'd like to thank the Ensemble project (www.ensemble.ac.uk) for funding me to work on this project in the summer of 2009.

COPYRIGHT AND LICENSE

Copyright (C) 2009 Iestyn Pryce <imp25@cam.ac.uk>

This library is free software; you can redistribute it and/or modify it under the terms of the BSD license.