They did a lot of hard labor. Could you imagine waiting until night to eat? Plus I vaguely remember reading that daylight had something to do with it. They went to sleep much earlier because they didn't have electricity.
They worked very hard, it took long periods of time to make meals, and most likely since it would be easier to deal with meals when the sun was still up, would make mid day meals more appropriate.