primeqa.mrc.metrics.nq_f1.eval_utils.gold_has_long_answer

primeqa.mrc.metrics.nq_f1.eval_utils.gold_has_long_answer(gold_label_list: list, long_non_null_threshold: int = 2) → bool

Gets vote from multi-annotators for judging if there is a long answer. :param gold_label_list: list of gold labels for judging :param long_non_null_threshold: Require this many non-null long answer annotations

to count gold as containing a long answer. Defaults to 2 like the original paper.