Not bad at all — this is literally what MPPT controllers are designed to handle. The controller doesn't just "shut off", it throttles back the power draw from the panels through PWM switching. Victron calls this the absorption/float cycle. The panels aren't damaged, the controller isn't stressed.
The slight caveat: if you've got a genuinely oversized array hammering a small controller at or near its rated current constantly, that's where you'd start seeing thermal wear over years. But a controller hitting float on a sunny afternoon? Completely fine, happens on my narrowboat every clear day in summer.
Worth distinguishing between MPPT and PWM controllers here though — they handle the excess differently under the hood. MPPT is more elegant about it.
One thing that does matter: make sure your battery voltage settings are correct. If the absorption voltage is set too high and your controller keeps pushing into a full LiFePO4 bank, that's where you can cause actual harm — but that's a settings issue, not an inherent flaw in the process.
What controller are you running? And is it LiFePO4 or lead-acid? Makes a difference to the conversation.