Razer Wolverine Ultimate intermittent headset issue

So i have the wolverine controler on my Xbox Series X. When i use the junk xbox headset it works fine but when i try to use my plantronics rig 500 pro esports edition headset the mike only works about 1 time in 20. I can hear fine but the mike wont transmit at all. When i use the rig 500 on a normal Xbox Series X controler it works every time. Am i missing something? Any help would be greatly appreciated.