NAME
wsd.pl - Command line driver for WordNet::SenseRelate::AllWords
SYNOPSIS
wsd.pl --context FILE --format FORMAT [--scheme SCHEME] [--type MEASURE]
[--config FILE] [--stoplist FILE]
[--window INT] [--contextScore NUM] [--pairScore NUM]
[--outfile FILE] [--trace INT] [--silent] [--forcepos]
| --help | --version
DESCRIPTION
Disambiguates each word in the context file using the specified relatedness measure (or WordNet::Similarity::lesk if none is specified).
OPTIONS
N.B., the = sign between the option name and the option parameter is optional.
- --context=FILE
-
The input file containing the text to be disambiguated. This "option" is required.
- --format=FORMAT
-
The format of the input file. Valid values are
- raw
-
The input is raw text. Sentence boundary detection will be performed, and all punctuation will be removed.
- parsed
-
The input is untagged text with one sentence per line and all unwanted punctuation has already been removed. Note: many WordNet terms contain punctuation, such as U.S., Alzheimer's, S/N, etc.
- tagged
-
Similar to parsed, but the input text has been part-of-speech tagged with Penn Treebank tags (perhaps using the Brill tagger).
- wntagged
-
Similar to tagged, except that the input should only contain words known to WordNet, and each word should have a letter indicating the part of speech ('n', 'v', 'a', or 'r' for nouns, verbs, adjectives, and adverbs). For example:
dog#n run#v fast#r
Additionally, no attempt will be made to search for other valid forms of the words in the input. For example, if 'dogs#n' occurs in the input, the program will not attempt to use other forms such as 'dog#n'.
- --scheme=SCHEME
-
The disambiguation scheme to use. Valid values are "normal", "fixed", "sense1", and "random". The default is "normal". In fixed mode, once a word is assigned a sense number, other senses of that word won't be considered when disambiguating words to the right of that context word. For example, if the context is
dogs run very fast
and 'dogs' has been assigned sense number 1, only sense 1 of dogs will be used in computing relatedness values when disambiguating 'run', 'very', and 'fast'.
WordNet sense 1 disambiguation guesses that the correct sense for each word is the first sense in WordNet because the senses of words in WordNet are ranked according to frequency. The first sense is more likely than the second, the second is more likely than the third, etc. Random selects one of the possible senses of the target word randomly.
- --measure=MEAURE
-
The relatedness measure to be used. The default is WordNet::Similarity::lesk.
- --config=FILE
-
The name of a configuration file for the specified relatedness measure.
- --stoplist=FILE
-
A file containing regular expressions (as understood by Perl), surrounded by by slashes (e.g. /\d+/ removes any word containing a digit [0-9]). Any word in the text to be disambiguated that matches one of the regular expressions in the file is removed. Each regular expression must be on its own line, and any trailing whitespace is ignored.
Care must be taken when crafting a stoplist. For example, it is tempting to use /a/ to remove the word 'a', but that expression would result in all words containing the lowercase letter a to be removed. A better alternative would be /\ba\b/.
- --window=INTEGER
-
Defines the size of the window of context. The default is 4. A window size of N means that there will be a total of N words in the context window, including the target word. If N is a (positive) even number, then there will be one more word on the left side of the target word than on the right.
For example, if the window size is 4, then there will be two words on the left side of the target word and one on the right. If the window is 5, then there will be two words on each side of the target word.
The minimum window size is 2. A smaller window would mean that there were no context words in the window.
- --contextScore=REAL
-
If no sense of the target word achieves this minimum score, then no winner will be projected (e.g., it is assumed that there is no best sense or that none of the senses are sufficiently related to the surrounding context). The default is zero.
- --pairScore=REAL
-
The minimum pairwise score between a sense of the target word and the best sense of a context word that will be used in computing the overall score for that sense of the target word. Setting this to be greater than zero (but not too large) will reduce noise. The default is zero.
- --outfile=FILE
-
The name of a file to which output should be sent. This file will display one word and its sense per line.
- --trace=INT
-
Turn tracing on/off. A value of zero turns tracing off, a non-zero value turns tracing on. The different trace levels can be added together to see the combined traces. The trace levels are:
1 Show the context window for each pass through the algorithm. 2 Display winning score for each pass (i.e., for each target word). 4 Display the non-zero scores for each sense of each target word (overrides 2). 8 Display the non-zero values from the semantic relatedness measures. 16 Show the zero values as well when combined with either 4 or 8. When not used with 4 or 8, this has no effect. 32 Display traces from the semantic relatedness module.
- --silent
-
Silent mode. No information about progress, etc. is printed. Just the final output.
- --forcepos
-
Turn part of speech coercion on. POS coercion attempts to force other words in the context window to be of the same part of speech as the target word. If the text is POS tagged, the POS tags will be ignored. POS coercion may be useful when using a measure of semantic similarity that only works with noun-noun and verb-verb pairs.
SEE ALSO
L<WordNet::SenseRelate::AllWords>
The main web page for SenseRelate is
L<http://senserelate.sourceforge.net/>
There are several mailing lists for SenseRelate:
L<http://lists.sourceforge.net/lists/listinfo/senserelate-users/>
L<http://lists.sourceforge.net/lists/listinfo/senserelate-news/>
L<http://lists.sourceforge.net/lists/listinfo/senserelate-developers/>
AUTHORS
Jason Michelizzi
Ted Pedersen, University of Minnesota, Duluth
E<lt>tpederse at d.umn.eduE<gt>
BUGS
Please report to senserelate-users mailing list.
COPYRIGHT
Copyright (C) 2004-2008 Jason Michelizzi and Ted Pedersen
This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.