We need to add :rename_setting_keys before :add_new_settings task. This way the value of the old key will not be lost.