primeqa.ir.dense.colbert_top.colbert.modeling.tokenization.query_tokenization_xlmr.QueryTokenizerXLMR#
- class primeqa.ir.dense.colbert_top.colbert.modeling.tokenization.query_tokenization_xlmr.QueryTokenizerXLMR(query_maxlen, model_type)#
Bases:
object
Methods
encode
tensorize
tokenize