I’ve had both DSLR and mirrorless kit out in similar temps on many occasions — yes keep batteries close to you whenever possible. Watch for lens fogging when gong between temp extremes.

Autofocus can also go a little wonky when the temps get real low as well — I’d keep them as warm as possible for as long as possible, ideally next to your body.