primeqa.mrc.metrics.tydi_f1.tydi_eval.compute_final_f1#

primeqa.mrc.metrics.tydi_f1.tydi_eval.compute_final_f1(passage_answer_stats, minimal_answer_stats)#

Computes overall F1 given passage and minimal answers, ignoring scores.

Note: this assumes that the answers have been thresholded based on scores.

Parameters

  • passage_answer_stats – List of passage answer scores.

  • minimal_answer_stats – List of minimal answer scores.

Returns

Dictionary of name (string) -> score.