primeqa.tableqa.tapex.utils.argument_utils_for_tapex.DataTrainingArguments#
- class primeqa.tableqa.tapex.utils.argument_utils_for_tapex.DataTrainingArguments(dataset_name: Optional[str] = 'wikitablequestions', dataset_config_name: Optional[str] = None, train_file: Optional[str] = None, validation_file: Optional[str] = None, test_file: Optional[str] = None, overwrite_cache: bool = False, preprocessing_num_workers: Optional[int] = None, max_source_length: Optional[int] = 1024, max_target_length: Optional[int] = 128, val_max_target_length: Optional[int] = None, pad_to_max_length: bool = False, max_train_samples: Optional[int] = None, max_eval_samples: Optional[int] = None, max_predict_samples: Optional[int] = None, num_beams: Optional[int] = None, ignore_pad_token_for_loss: bool = True)#
Bases:
objectArguments pertaining to what data we are going to input our model for training and eval.
Methods
Attributes
dataset_config_namedataset_nameignore_pad_token_for_lossmax_eval_samplesmax_predict_samplesmax_source_lengthmax_target_lengthmax_train_samplesnum_beamsoverwrite_cachepad_to_max_lengthpreprocessing_num_workerstest_filetrain_fileval_max_target_lengthvalidation_file