> It's "standard" for a reason

The reason is that with standard time, solar noon coincides with local noon, so the day is approximately symmetric about noon, not regarding atmospheric refraction lengthening the day. It wasn't done on a whim.