Yeah, take the case off. 

Im wondering if there is a case that fits with the razer kishi.

I don't think there is any case, for any phone, that will safely mount the kishi. Maybe a skin / sticker type of thing? Not even the official carbon fiber case for the Razer phone will work.  Because the USB needs to be square and straight in, any angle is risking damage to your phone and or kishi. 

I had the same issue with my Razer Kishi V2 and phone case. Unfortunately, Razer doesn’t make cases for Google Pixel...
 

Yeah, unfortunately, the Razer Kishi V2 isn’t compatible with thicker phone cases. It’s a tight fit. And you're right—Razer doesn’t make Pixel-specific cases, which is frustrating. You might have to remove the case to use it properly. CredibleBH