Using high-resolution surface irradiance data with original temporal resolutions between 0.01 s and 1 s from six different locations in the Northern Hemisphere, we characterize the changes in representation of temporal variability resulting from time averaging. Our results indicate that a temporal averaging time scale of around 1 s marks a transition in representing single-point irradiance variability, such that longer averages result in substantial underestimates of variability.