primeqa.ir.dense.colbert_top.colbert.modeling.tokenization.query_tokenization.QueryTokenizer

class primeqa.ir.dense.colbert_top.colbert.modeling.tokenization.query_tokenization.QueryTokenizer(query_maxlen, model_type, attend_to_mask_tokens)

Bases: object

Methods

encode
tensorize
tokenize