Not only IBIS floating around, but for recent Nikon F or Z mount VR lenses you really want the lens VR mechanism to dock before taking the lens off the camera. If you remove such a lens while the VR is active the lens will make a rattling sound off-camera or in your camera bag as the VR lens elements float around. I haven't heard any first hand reports of lens damage from this but it's certainly disconcerting to pick up an expensive lens and hear things rattling around inside. Turning the camera off before removing a lens eliminates this problem as the VR elements dock securely on power down.
Yeah, the camera's IBIS issue is similar but at least that's limited to just the camera for the duration you're changing the lens but the lens VR elements can remain undocked and rattle around until you mount that lens back on a camera body and power things up and then shut it down properly prior to removing the lens.