Hi Elcaplette,
If Bandsteering is enabled then AP forces client to connect to 5G band.
If you have some clients with only 2.4G band supported, then you need to try connecting multiple times.
Please find the more detailed information regarding bandsteering form below link:
Suggestion is:
If you require bandsteer, then 2.4G clients take more time to connect or multiple retries required for connection.
Otherwise you can disable bandsteer and clients will connect to AP smoothly.