My pulmonary Dr. Told me it's OK to turn it up if I'm feeling short of breath when trying to do something like cleaning, but turn it back down when I'm at rest.

Well if your pulmonologist says its ok for you to do so, then I say ok, just be sure to follow his/her instructions. Take care, and breathe easy.

Thanks, was reading that too much oxygen for COPD could be harmful.

Yes. The last time I was in the hospital due to a flare up (January 2024), I was instructed to turn it up. Also my pulmonologist and PCP have told me to turn it up.