edu.columbia.cs.ref.algorithm.evaluation
Class Evaluator

java.lang.Object
  edu.columbia.cs.ref.algorithm.evaluation.Evaluator

public class Evaluator
extends java.lang.Object

The Class Evaluator is used to evaluate the quality of the results of a given relationship extraction model.

An Evaluator is composed by a list of measures that are to be computed in order to evaluate models.

Since:

2011-09-27

Version:

0.1

Author:

Pablo Barrio, Goncalo Simoes

Constructor Summary

Evaluator()

Method Summary

void	addMeasure(Measure measure) Adds a new measure to the evaluator.
double	getResult(Measure m) Gets the evaluation result for a given measure
void	printEvaluationReport(java.util.List<OperableStructure> testingFiles, Model m) Prints the evaluation report.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Evaluator

public Evaluator()

Method Detail

addMeasure

public void addMeasure(Measure measure)

Adds a new measure to the evaluator.

Parameters:

measure - the new measure

getResult

public double getResult(Measure m)

Gets the evaluation result for a given measure

Parameters:

m - the measure for which we want to retrieve the result

Returns:

the result of the evaluation of the input measure

printEvaluationReport

public void printEvaluationReport(java.util.List<OperableStructure> testingFiles,
                                  Model m)

Prints the evaluation report.

Parameters:

testingFiles - the Operable structures to be used during testing. It is assumed that they are tagged with the gold set labels.

m - the model that will be evaluated.