primeqa.util.transformers_utils.torch_utils.all_gather

primeqa.util.transformers_utils.torch_utils.all_gather(tensor)

all gather the tensor with dimensions [d0 x d1 x…], returning a tensor with dimensions [d0*world_size x d1 x…] :param tensor: this process’s tensor :return: