Stop using BitCastToUnsigned(SignedType{args.imm}) where possible.

And where it's actually intended add comment about the reason.

Test: m berberis_all

Change-Id: I060eae059c587075eb3619949faeaa13ad7f019c
2 files changed