pimm.utils.comm.all_gather

all_gather(data, group=None)

Run all_gather on arbitrary picklable data (not necessarily tensors).

Parameters:

• data – any picklable object

• group – a torch process group. By default, will use a group which contains all ranks on gloo backend.

Returns:

list[data] – list of data gathered from each rank