Yes, the number of molecules in the balloon will decrease when the temperature is increased since they will leave the balloon at an increased rate.