APs suddenly stop all wireless communication causing 100% outage

I attempted to go through the normal paid support process but that 100% failed again. So, I’m posting here in hopes that a Cambium engineer/developer will see this and have some concern for their clients and can find a solution.

I have had multiple instances where my XE3-4 APs suddenly stop accepting wireless connections and they drop all existing connections causing a 100% outage to all wireless clients. The APs may operate without issue for weeks or even months. Then out of the blue they just stop accepting connections of any kind, regardless of encryption, regardless of SSID, regardless of authentication. A reboot will get the AP operating normally again. Clearly the AP is getting stuck in some bad state it cannot recover from.

I have hundreds of XE3-4 units and this has happened at multiple geographically separated locations so I cannot point to anything environmental as the cause. The APs are running 6.6.2.1-r5. Upgrading to the 7.x codebase is not an option as that firmware is extremely unstable and completely unusable in a production environment (been there, tried that, back-rev’d). I have a tech dump from an AP while it is in this bad/broken state. I am available and ready to work with someone at Cambium that has a concern about this issue.

Did you put your tech dump in your support portal?

Of course! But that’s not the hold up…

I have a maybe 4 XE3-4 out there. They are all in the 6.x firmwares.

It’s not a real fix, but it might help reduce the disruptions for now. You can schedule a service reboot on the APs by adding this to the user‑defined override. I’ve had to keep this in place for years—definitely not perfect, but it does stop problems.

!
service schedule reload 01:00:00
!

Hey Rob. I’ve done similar hacks like this in the past for very limited issues. But something widespread that impacts hundreds of APs across all campuses would be too disruptive. We have critical systems that rely on stable WiFi so interrupting that on a regular basis would not be feasible. The best solution would be for qualified Cambium engineers/developers to take an interest and actually look into what the cause of this issue is. Unfortunately, that is not happening.

Totally!

Are you based within EMEA? I have contacts in that region who can help me escalate issues that are not gaining traction.

I’m in Texas, USA. :upside_down_face:

@Mitchell_Mitchell
Please confirm if this issue persists with clients connecting on all radios or one single radio.

Please share tech-support when the AP is faulty state.

Thank you.

Good morning (Shashank?). Thank you for responding. Yes, it happens on all radios and all SSIDS. ALL wireless communication completely stops. Doesn’t matter if the SSID is open, WPA2, wpa2/wpa3, no clients can connect. I have emailed you the tech dump of an AP in the faulty state, I don’t want to upload it here as it contains information that should not be posted publicly online.

Maybe edit out or put notes where your removed things and place something like “PLACHOLDERHERE”

hey Shashank. Another AP started rejecting clients again this am. I’m gathering the logs and will email them to you shortly.