Merge "LeAudio: Fix switching to not active le audio device"