In my younger days, see my avatar, I could lug around the Nikon 300mm f2.8 and other gear all day at a baseball game. Now, at 66, I have the family arthritis so a couple of hours with my D780 and 300 PF or new Sigma 150/600 C lens on a monopod is enough. I can't afford a 500PF or some of the lighter mirrorless cameras but frankly, I'm not sure they weigh significantly less. I just try to minimize the load and do short trips. Sometimes it's not the weight but the repetitive motions. I admire the shooters who can be out 12 hours but that's just not me.
Be self aware and do what feels good,
Vinny