I have tried with and without HDR enabled (and with HDR enabled I have tried all combinations of 8 bit/10 bit/11 bit remastering). I have tried changing some settings in rendering settings. I have also tried both the injected version of Special K and the global version. Nothing fixes the issue, except removing Special K from the game.
Something to note is that the issue seems to only occur after I open the pause menu in-game.