primeqa.tableqa.preprocessors.dataset.TableQADataset

class primeqa.tableqa.preprocessors.dataset.TableQADataset(data_path_root, train_dataset_path, dev_dataset_path, tokenizer=None)

Bases: object

Methods

load_data

This function preprocesses raw data and returns the processes dataset for train and dev

load_data()

This function preprocesses raw data and returns the processes dataset for train and dev

Returns

Returns train dataset and eval dataset

Return type

Dataset, Dataset