tree 492cdb9256297939bb973315d2b32eee19bfa6bd
parent 65c5eed01d3bf1b971f97c143beaa9dd8b0be0df
author Peter Bell <peterbell10@live.co.uk> 1703273626 +0000
committer PyTorch MergeBot <pytorchmergebot@users.noreply.github.com> 1703293603 +0000

[inductor] Do variance calculation in opmath type (#115181)

Fixes #114903

Previously large split variance reductions stored the intermediates as float16
precision, which may lead to overflow as the intermediate result is
unnormalized.

In #114903 we see two different `num_split` decisions made based on the
hardware capabilities, one of which has large enough intermediates to cause
overflows.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/115181
Approved by: https://github.com/shunting314