primeqa.boolqa.processors.dataset.mrc2dataset.create_dataset_from_json_str#

primeqa.boolqa.processors.dataset.mrc2dataset.create_dataset_from_json_str(json_str: str, unpack: bool) datasets.arrow_dataset.Dataset#

Converts the output of run_mrc.py (eval_predictions.json, not eval_predictions_processed.json) into a Dataset for use with the classifiers

Parameters

json_str (str) – json encoding of the current state of eval_predictions

Returns

a dataset containing all of the fields in mrcfn as features, for the top-ranked answer

Return type

Dataset