Yes and it is an old custom that the guy speak. Maybe his dad never told him or maybe he was startled. You were fine except that you could have smiled sweetly and nodded. Any guy should have been flattered. He could be taken and not used to attention. You may have made his day.