Sure, you might last longer your first few times, but it's easy to control it if you know what you're doing.
And only about 30% of women can actually orgasm from penetration, the rest need some other stimulation, so it doesn't matter how long you can last for 70% of women.