DESCRIPTION

Online evaluation metric module.

DESCRIPTION

Base class of all evaluation metrics.

update

Update the internal evaluation.

Parameters
----------
labels : list of NDArray
    The labels of the data.

preds : list of NDArray
    Predicted values.

reset

Clear the internal statistics to initial state.

get

Get the current evaluation result.

Returns
-------
name : str
   Name of the metric.
value : float
   Value of the evaluation.

DESCRIPTION

Manage multiple evaluation metrics.

NAME

AI::MXNet::Perplexity

DESCRIPTION

Calculate perplexity

Parameters
----------
ignore_label : int or undef
    index of invalid label to ignore when
    counting. usually should be -1. Include
    all entries if undef.

DESCRIPTION

Custom evaluation metric that takes a NDArray function.

Parameters
----------
eval_function : subref
    Customized evaluation function.
name : str, optional
    The name of the metric
allow_extra_outputs : bool
    If true, the prediction outputs can have extra outputs.
    This is useful in RNN, where the states are also produced
    in outputs for forwarding.

create

Create an evaluation metric.

Parameters
----------
metric : str or callable
    The name of the metric, or a function
    providing statistics given pred, label NDArray.