If it is cold outside and you take it into a heated area you are asking for big trouble (read misfire). Condensation will build up inside the barrel and cause your powder to get wet. If you want to leave it loaded (minus primer or cap i would hope) leave it in an unheated garage or somewhere where it isn't heated so no condensation has a chance to form.