Oh, that makes more sense, ( assuming you mean the right side white PCB board with 4 Channels doesn't make exact contact.) I have the same case, and the foam doesn't seem to cause any issues? Is it possible that the gold pins are bent on 4 channel white PCB? Otherwise, maybe side panel is not latched to the side of case tight enough?
The simplest solution may involve:
bending pins outwards more
putting belt or bands around the case to hold the panel on tighter?
putting a few washers between white PCB and the case. ( It can still screw into the interior side of the case, but will stick out a few millimeter more, so that gold pins pressed into the side pannel more.)
Hopefully, all goes well. Are you selling the case, or using it for a cool build?