nordlys.core.eval.eval module

Evaluation

Console application for eval package.

Author:Faegheh Hasibi
class nordlys.core.eval.eval.Eval(operation, qrels=None, runs=None, metric=None, output_file=None)[source]

Bases: object

Main entry point for eval package.

Parameters:
  • operation – operation (see OPERATIONS for allowed values)
  • qrels – name of qrels file
  • runs – name of run files
  • metric – metric
OPERATIONS = ['query_diff']
OP_QUERY_DIFF = 'query_diff'
run()[source]

Runs the operation with the given arguments.

nordlys.core.eval.eval.arg_parser()[source]
nordlys.core.eval.eval.main(args)[source]