hypers_base#

Functions

dist_initialize

initializes torch distributed :return: local_rank, global_rank, world_size

Classes

This should be the base hyperparameters class, others should extend this.