I'm confused by this. Are you saying you only have one ip address assigned by the ISP?
Then yes, you would not be able to use another ip in the subnet for a vip it won't work.
Yes that is exacty what I am saying I need to be able to send traffic from my 1 ISP address (interface address) to this internal server