The London Perl and Raku Workshop takes place on 26th Oct 2024. If your company depends on Perl, please consider sponsoring and/or attending.
 / 
WordNet-SenseRelate-Allwords
/ wsd.pl

NAME

wsd.pl - disambiguate words

SYNOPSIS

wsd.pl --context FILE --format FORMAT [--scheme SCHEME] [--type MEASURE] [--config FILE] [--compounds FILE] [--stoplist FILE] [--window INT] [--contextScore NUM] [--pairScore NUM] [--outfile FILE] [--trace INT] [--silent] [--forcepos] | --help | --version

DESCRIPTION

Disambiguates each word in the context file using the specified relatedness measure (or WordNet::Similarity::lesk if none is specified).

OPTIONS

N.B., the = sign between the option name and the option parameter is optional.

--context=FILE

The input file containing the text to be disambiguated. This "option" is required.

--format=FORMAT

The format of the input file. Valid values are

raw

The input is raw text. Sentence boundary detection will be performed, and all punctuation will be removed.

parsed

The input is untagged text with one sentence per line and all unwanted punctuation has already been removed. Note: many WordNet terms contain punctuation, such as U.S., Alzheimer's, S/N, etc.

tagged

Similar to parsed, but the input text has been part-of-speech tagged with Penn Treebank tags (perhaps using the Brill tagger).

wntagged

Similar to tagged, except that the input should only contain words known to WordNet, and each word should have a letter indicating the part of speech ('n', 'v', 'a', or 'r' for nouns, verbs, adjectives, and adverbs). For example:

  dog#n run#v fast#r

Additionally, no attempt will be made to search for other valid forms of the words in the input. For example, if 'dogs#n' occurs in the input, the program will not attempt to use other forms such as 'dog#n'.

--scheme=SCHEME

The disambiguation scheme to use. Valid values are "normal", "fixed", "sense1", and "random". The default is "normal". In fixed mode, once a word is assigned a sense number, other senses of that word won't be considered when disambiguating words to the right of that context word. For example, if the context is

  dogs run very fast

and 'dogs' has been assigned sense number 1, only sense 1 of dogs will be used in computing relatedness values when disambiguating 'run', 'very', and 'fast'.

WordNet sense 1 disambiguation guesses that the correct sense for each word is the first sense in WordNet because the senses of words in WordNet are ranked according to frequency. The first sense is more likely than the second, the second is more likely than the third, etc. Random selects one of the possible senses of the target word randomly.

--measure=MEAURE

The relatedness measure to be used. The default is WordNet::Similarity::lesk.

--config=FILE

The name of a configuration file for the specified relatedness measure.

--compounds=FILE

A file containing compound words.

--stoplist=FILE

A file containing regular expressions (as understood by Perl), surrounded by by slashes (e.g. /\d+/ removes any word containing a digit [0-9]). Any word in the text to be disambiguated that matches one of the regular expressions in the file is removed. Each regular expression must be on its own line, and any trailing whitespace is ignored.

Care must be taken when crafting a stoplist. For example, it is tempting to use /a/ to remove the word 'a', but that expression would result in all words containing the lowercase letter a to be removed. A better alternative would be /\ba\b/.

--window=INTEGER

Defines the size of the window of context. The default is 4. A window size of N means that there will be a total of N words in the context window, including the target word. If N is a (positive) even number, then there will be one more word on the left side of the target word than on the right.

For example, if the window size is 4, then there will be two words on the left side of the target word and one on the right. If the window is 5, then there will be two words on each side of the target word.

The minimum window size is 2. A smaller window would mean that there were no context words in the window.

--contextScore=REAL

If no sense of the target word achieves this minimum score, then no winner will be projected (e.g., it is assumed that there is no best sense or that none of the senses are sufficiently related to the surrounding context). The default is zero.

--pairScore=REAL

The minimum pairwise score between a sense of the target word and the best sense of a context word that will be used in computing the overall score for that sense of the target word. Setting this to be greater than zero (but not too large) will reduce noise. The default is zero.

--outfile=FILE

The name of a file to which output should be sent. This file will display one word and its sense per line.

--trace=INT

Turn tracing on/off. A value of zero turns tracing off, a non-zero value turns tracing on. The different trace levels can be added together to see the combined traces. The trace levels are:

  1 Show the context window for each pass through the algorithm.

  2 Display winning score for each pass (i.e., for each target word).

  4 Display the non-zero scores for each sense of each target
    word (overrides 2).

  8 Display the non-zero values from the semantic relatedness measures.

 16 Show the zero values as well when combined with either 4 or 8.
    When not used with 4 or 8, this has no effect.

 32 Display traces from the semantic relatedness module.
--silent

Silent mode. No information about progress, etc. is printed. Just the final output.

--forcepos

Turn part of speech coercion on. POS coercion attempts to force other words in the context window to be of the same part of speech as the target word. If the text is POS tagged, the POS tags will be ignored. POS coercion may be useful when using a measure of semantic similarity that only works with noun-noun and verb-verb pairs.

SEE ALSO

WordNet::SenseRelate::AllWords(3)

The main web page for SenseRelate is

http://senserelate.sourceforge.net/

There are several mailing lists for SenseRelate:

http://lists.sourceforge.net/lists/listinfo/senserelate-users/

http://lists.sourceforge.net/lists/listinfo/senserelate-news/

http://lists.sourceforge.net/lists/listinfo/senserelate-developers/

AUTHORS

Jason Michelizzi, <jmichelizzi at users.sourceforge.net>

Ted Pedersen, <tpederse at d.umn.edu>

BUGS

None known.

COPYRIGHT

Copyright (C) 2004-2005 Jason Michelizzi and Ted Pedersen

This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.