Can I build up immunity to cold temperature?

Be careful about the limits of adaptation. You can certainly adjust to temperatures that are colder than you're used to. You will still die if you are inactive outside without protection below 50 degrees F (10C).