How are the non-working zone ports connected to their respective VLANs?
And how does the return path routing then work from these interfaces?
I wonder if there is some asymmetrical routing paths because this is a second ip address that is not the default gateway for the subnet where they are connected and that is why the connections won't work.
If you can, I would start by connecting a laptop to each port directly and putting this into the same subnet as the interface as a test. If this works you know the SSG hardware is good and you have a routing configuration issue.