IP Passthrough to Secondary Router VPN not working

I have a pepwave Max BR1 Mini that has a unifi USG behind it. I am trying to VPN into the USG and cant seem to get that to work. IP passthrough seems to work, but somehow it is blocking the VPN access. Is there anything else I need to do to let the VPN through?