When launched in the conventional direction, you can add the tangential velocity to the velocity of the rocket to achieve escape velocity.
Since you don't have the tangential velocity, you will have to double what the tangential velocity would have been to add to the rocket's velocity.