primeqa.ir.dense.dpr_top.dpr.dpr_util.queries_to_vectors#

primeqa.ir.dense.dpr_top.dpr.dpr_util.queries_to_vectors(tokenizer: Union[transformers.models.rag.tokenization_rag.RagTokenizer, transformers.models.dpr.tokenization_dpr.DPRQuestionEncoderTokenizer], question_encoder, queries: Union[List[str], List[Tuple[str, str]]], *, max_query_length=None)#
Parameters
  • tokenizer – a RagTokenizer (the question_encoder will be used) or a DPRQuestionEncoderTokenizer

  • question_encoder

  • queries – list of string queries or list of title/text pairs

  • max_query_length

Returns