When using a sleeping bag, strip down to just your underwear when inside. When you sleep, your body produces heat which will cause you to sweat. If that sweat cannot be wicked away from your body, via the sleeping bag, it will stay next to your skin causing you to lose heat and, at worst, freeze in the night. Your clothes will keep the sweat next to you.
Random man Knowledge