I had similar issues and found this:
I think this is a pytorch issue, not an scVI issue.
I think this is the pytorch issue where they track mps compatibility:
I think the specific function that’s incompatible (at least for my usage) was
aten::_standard_gamma