Documentation for training with multiple GPUs

Is there any official tutorial or documentation around how to train with multiple GPUs? I’ve found various issues on github and here, but I didn’t find anything on outside of the API documentation.

Hi, multi-GPU support is still experimental so we don’t have official documentation or a tutorial yet. You may try out this functionality with the following:

model = scvi.model.SCVI(adata)
model.train(accelerator="gpu", devices=-1, strategy="ddp_find_unused_parameters_true")

but note that the behavior might be buggy.

Thanks this is helpful, I had not included strategy="ddp_find_unused_parameters_true" in my attempt to use multiple GPUs.