primeqa.ir.dense.dpr_top.torch_util.hypers_base.dist_initialize

primeqa.ir.dense.dpr_top.torch_util.hypers_base.dist_initialize()

initializes torch distributed :return: local_rank, global_rank, world_size