F300 issue question

For those who don’t want to read through this, the question being asked: Is there a software version out there that resolved the ethernet port lock up issue on the F300 when used as a back haul?

So we’ve been have a rash of F300 issues in the last 24 hours, in addition to the ongoing ones.

We have a 5 mile back haul link using 2 F300-25 that was completely stable for months and then started the issue where the ethernet side would simply cease functioning requiring a reboot. This happened on both the master and slave sided. We were running 4.4.3 at the time. We tried the “latest” software versions which did not fix the problem and actually made it worse, going from a failure every 7 to 10 days to 1 to 2 a day, and ended up rolling back to 4.4.3, which has been the most stable.

Today the master F300-25 began a series of reboots. We replaced the power supply, swapped to another cable, visually inspected everything and could find nothing wrong. The problem continued until the F300-25 breathed its last. No outside reason for the failure we can determine. We had an ice storm about 3 weeks ago, but weather has been great since and there was no lightning associated. There were some power surges but the unit is protected by an UPS, surge protector and well grounded. Hardware failures happen, right?

We had used our spare F300 on another back haul, so we took an F300-16 up as a temporary replacement, and restored the link, though obviously at a lower RSL. Throughput was still good. Problem solved until we get the replacement in.

About midnight, we were checking on everything and made a couple of tweaks to the configuration which caused the unit the “briefly” disconnect. 14 minutes later it had still not recovered so we rebooted the master AP, and it came up in a minute or so. We then noticed the F300-16 was spitting out a continuous red ERROR notification via the notification tab. It didn’t give any information simply 02:33:14 error. The syslog shows nothing but the unit was passing traffic. Checking around in the unit, rhe main radio configuration page is basically blank. About 15 minutes later is appeared to recover with the error message going away and the screen populated correctly. I do have screen capture of the event so I’m not crazy,.

So the purpose of this rant is that we have had continuous issues with the F300 line and we have not lit our epmp 3000 yet, so concerned on how that will go.
The backhauls have NOT been stable. We had a short BH using F300-16 less than a quarter mile that began having the ethernet port lock up issues requiring a reboot and we tried software releases up through 4.5.6 (with 4.4.3 being the most stable) and finally threw in the towel and replaced it with the old F180 epmp 1000 running 3.5.6 (solid for almost 60 days now).
That’s not an option with one of our primary BH links due to bandwidth requirements. We tend to be VERY conservative in trying new software releases but the epmp 3000 forced us to step up to the latest and greatest version to get support for the MU-MIMO omni.

We have two other F300-25 back haul links that continue to experience the ethernet lockup issue. Unless we have a LOT of bad hardware, logic would dictate it is software related.

We’re big Cambium fans and fully understand there are always bugs and challenges, but I do have to say our experience to date with the F300 product has been vastly underwhelming. The specs are great, but the stability is not. Reading through the forums it appears there are a continuous series of issues since 2018 and I can see a lot of frustration noted, ours now included.
We are very small with a limited budget so the F300-25 seems an excellent solution for our BH needs, but…

So to the bottom line question: Though I’m not seeing it, Is there a software version that provides stability for the F300 lock up issue? We have tried every software version but the beta 4.6 RFC29. 4.4.3 has proven the most stable of the unstable, but weekly outages having to use watchdog reboots is unacceptable. Multiple daily outages even less so.

It appears the primary focus has been resolving the SM shedding issue with the epmp 3000 and 3000L. Haven’t seen much activity lately on the F300 ethernet port lock up issue.

We are going to try one last time with the latest BETA on a recently turned up BH link with F300-25s and see if that helps any. If the answer is no then we will most likely abandon the F300 as a back haul product and go with a proven Ubiquiti solution… Hopefully we can repurpose the F300 units as SM’s with the epmp 3000.

And before you ask, yes we’ve talked to Cambium and been told to either upgrade to the latest greatest software or replace the unit. Been there, done that, got the t-shirt.

use 4.4.3 for f200 and 4.5 for f300 and 3000L in PTP-TDD mode IF using GPS. These versions are good for PTP-TDD. if not using GPS there is only hope in the latest beta.

Thanks, we’ll give that a shot. We are using GPS on the 3000. We did some range testing with it Saturday and everythng seems to be working as expected. Currently have it on 4.6 RC 29 Beta and plan on only using F300 SMs. We’ll try the 4.5 on the F300 BH. We may just bit the bullet swap out the F300 BH’s with PTP 450i’s but seems overkill for 5 and 6 miles BH’s.to area that do not need a huge amount of capacity.

Hello,

Could you please open a ticket with Cambium Support or send Tech Support files from F300s you are experiencing the issue with to me please?
fedor.trutsko(at)cambiumnetworks(dot)com

Thank you.

Will do but it appears the issue was hardware. The F300-25 we were using as a master finally started increasingly short intervals of reboots and then died. We pulled it down and replaced it. Testing it on the bench it would start up after a hard reboot with at the login page it had the message INTERNAL DEVICE ERROR. Since we’ve replaced it, haven’t had any issues so far. This particular unit has only been in service about 6 months with the lockups beginning about 3 months ago. We were kind of surprised as its the first time in three years we’ve actually had a hard failure on any Cambium equipment that wasn’t associated to a physical event, which was why we were so biased towards a software issue.

2 Likes

Glad you have resolved your issue, we have had nothing but issues since February of this year with Force 300 line up, epmp 3000 and r201p and r195w routers. There are so many issues within each software for the epmp 3000 and force 300 (we are using mainly 25db and some of the 19db) that I have very little stability and multiple variables to work through every week. The most stable thus far is the 4.4.3, for us anyway, and when I have upgraded software, one issue is exchanged for 3 different ones in the next version. I had a thicker head of hair in February and lower blood pressure…good luck to all.

2 Likes

Nov 24 22:12:29 F300-25_2827f0 admin[192.168.0.100] web_interface: User: 'admin' role: 'admin' is logged in…
Nov 24 22:11:54 F300-25_2827f0 DEVICE-AGENT[4238]: platform_set_cns_connection_state: New CNS_STATE cns_serv_stat Connecting(4)
Nov 24 22:11:37 F300-25_2827f0 netifd: Network device 'eth0' link is up
Nov 24 22:11:36 F300-25_2827f0 netifd: Network device 'eth0' link is down
Nov 24 22:10:52 F300-25_2827f0 DEVICE-AGENT[4238]: platform_set_cns_connection_state: New CNS_STATE cns_serv_stat Connecting(4)
Nov 24 22:09:51 F300-25_2827f0 DEVICE-AGENT[4238]: platform_set_cns_connection_state: New CNS_STATE cns_serv_stat Connecting(4)
Nov 24 22:09:12 F300-25_2827f0 DEVICE-AGENT[4238]: Trap data received: name STA_REG timestamp 1606273752 mac 00:04:56:28:56:49 status 0 msg []
Nov 24 22:09:12 F300-25_2827f0 kernel: [ 5037.527482] SM[00:04:56:28:56:49] aid=1 associated with AP
Nov 24 22:09:12 F300-25_2827f0 hostapd: ath0: STA 00:04:56:28:56:49 WPA: pairwise key handshake completed (RSN)
Nov 24 22:09:12 F300-25_2827f0 hostapd: ath0: STA 00:04:56:28:56:49 RADIUS: starting accounting session 1A40093FD4580F1E
Nov 24 22:09:12 F300-25_2827f0 hostapd: ath0: STA 00:04:56:28:56:49 IEEE 802.11: associated
Nov 24 22:08:49 F300-25_2827f0 DEVICE-AGENT[4238]: Trap data received: name STA_DROP timestamp 1606273687 mac 00:04:56:28:56:49 status 48 msg [COMMUNICATION LOST]
Nov 24 22:08:49 F300-25_2827f0 DEVICE-AGENT[4238]: Trap data received: name STA_REJECT timestamp 1606273687 mac 00:04:56:28:56:49 status 48 msg [COMMUNICATION LOST]
Nov 24 22:08:49 F300-25_2827f0 DEVICE-AGENT[4238]: platform_set_cns_connection_state: New CNS_STATE cns_serv_stat Connecting(4)
Nov 24 22:08:49 F300-25_2827f0 DEVICE-AGENT[4238]: Attempting (re)connection in 5 minutes
Nov 24 22:08:49 F300-25_2827f0 DEVICE-AGENT[4238]: Unable to discover cnMaestro URL (re-discover in 335 seconds)
Nov 24 22:08:49 F300-25_2827f0 DEVICE-AGENT[4238]: OpenConnection: getaddrinfo -2:(Name or service not known)
Nov 24 22:08:49 F300-25_2827f0 DEVICE-AGENT[4238]: OpenConnection to cloud.cambiumnetworks.com:443 failed
Nov 24 22:08:07 F300-25_2827f0 hostapd: ath0: STA 00:04:56:28:56:49 IEEE 802.11: disassociated
Nov 24 22:08:07 F300-25_2827f0 kernel: [ 4972.517235] SM[00:04:56:28:56:49] aid=1 disassociated. Reason: 48 (COMMUNICATION LOST)
Nov 24 22:07:49 F300-25_2827f0 DEVICE-AGENT[4238]: OpenConnection: hostname [cloud.cambiumnetworks.com] port [443/443]
Nov 24 22:07:49 F300-25_2827f0 DEVICE-AGENT[4238]: platform_set_cns_connection_state: New CNS_STATE cns_serv_stat Connecting(4)
Nov 24 22:07:49 F300-25_2827f0 DEVICE-AGENT[4238]: build_http_get_request: No cambium_id available
Nov 24 22:07:49 F300-25_2827f0 DEVICE-AGENT[4238]: build_http_get_request: Data serialNo: &serialNo=E6UA014GD500
Nov 24 22:07:43 F300-25_2827f0 DEVICE-AGENT[4238]: platform_set_cns_connection_state: New CNS_STATE cns_serv_stat Connecting(4)
Nov 24 22:07:43 F300-25_2827f0 DEVICE-AGENT[4238]: Attempting (re)connection in 5 seconds
Nov 24 22:07:43 F300-25_2827f0 DEVICE-AGENT[4238]: platform_set_cns_connection_state: New CNS_STATE cns_serv_stat Not Connected(0)
Nov 24 22:07:43 F300-25_2827f0 DEVICE-AGENT[4238]: callback_websocket: LWS_CALLBACK_CLOSED
Nov 24 22:07:43 F300-25_2827f0 DEVICE-AGENT[4238]: Websocket not closed destroying
Nov 24 22:07:12 F300-25_2827f0 DEVICE-AGENT[4238]: Saving reason string [1606273632:DEV_PING_TIMEOUT]
Nov 24 22:07:12 F300-25_2827f0 DEVICE-AGENT[4238]: send_close_frame_to_cnmaestro: da.state=3, writing close reason [DEV_PING_TIMEOUT]
Nov 24 22:07:12 F300-25_2827f0 DEVICE-AGENT[4238]: send_close_frame_to_cnmaestro: Sent CLOSE frame
Nov 24 22:07:12 F300-25_2827f0 DEVICE-AGENT[4238]: Missed 5 consecutive PONGS, disconnecting with server
Nov 24 22:07:12 F300-25_2827f0 DEVICE-AGENT[4238]: Not received PONG for the last ping (5)
Nov 24 22:06:47 F300-25_2827f0 DEVICE-AGENT[4238]: Not received PONG for the last ping (4)
Nov 24 22:06:28 F300-25_2827f0 DEVICE-AGENT[4238]: Not received PONG for the last ping (3)
Nov 24 22:05:59 F300-25_2827f0 DEVICE-AGENT[4238]: Not received PONG for the last ping (2)
Nov 24 22:05:32 F300-25_2827f0 DEVICE-AGENT[4238]: Not received PONG for the last ping (1)
Nov 24 21:57:50 F300-25_2827f0 admin[190.42.216.130] web_interface: User: 'admin' role: 'admin' is logged in…
Nov 24 20:47:29 F300-25_2827f0 DEVICE-AGENT[4238]: Trap data received: name SYS_UP timestamp 1606268849 mac (null) status 1 msg [The Initialization State]
Nov 24 20:46:54 F300-25_2827f0 kernel: [ 98.912515] SM[00:04:56:28:56:49] aid=1 associated with AP
Nov 24 20:46:54 F300-25_2827f0 DEVICE-AGENT[4238]: Trap data received: name STA_REG timestamp 1606268814 mac 00:04:56:28:56:49 status 0 msg []
Nov 24 20:46:54 F300-25_2827f0 hostapd: ath0: STA 00:04:56:28:56:49 WPA: pairwise key handshake completed (RSN)
Nov 24 20:46:54 F300-25_2827f0 hostapd: ath0: STA 00:04:56:28:56:49 RADIUS: starting accounting session 85F4365163CF2EF5
Nov 24 20:46:54 F300-25_2827f0 hostapd: ath0: STA 00:04:56:28:56:49 IEEE 802.11: associated
Nov 24 20:46:24 F300-25_2827f0 DEVICE-AGENT[4238]: platform_set_cns_connection_state: New CNS_STATE cns_serv_stat Connected(6)
Nov 24 20:46:19 F300-25_2827f0 )
Nov 24 20:46:19 F300-25_2827f0 DEVICE-AGENT[4238]: handle_cns_msg: MSG_REGISTER_SUCCESS received
Nov 24 20:46:19 F300-25_2827f0 DEVICE-AGENT[4238]: platform_set_cns_connection_state: New CNS_STATE cns_serv_stat Device Approval Pending(5)
Nov 24 20:46:19 F300-25_2827f0 DEVICE-AGENT[4238]: Primary NTP server [193.5.216.14]
Nov 24 20:46:19 F300-25_2827f0 DEVICE-AGENT[4238]: SessionID unavailable, regenerating
Nov 24 20:46:19 F300-25_2827f0 DEVICE-AGENT[4238]: Connected to cnMaestro (0)
Nov 24 20:46:18 F300-25_2827f0 /OU=Domain Control Validated/OU=Issued through Cambium Networks Ltd E-PKI Manager/OU=COMODO SSL Wildcard/CN=.cloud.cambiumnetworks.com
Nov 24 20:46:18 F300-25_2827f0 DEVICE-AGENT[4238]: Server cert validation is enabled
Nov 24 20:46:18 F300-25_2827f0 DEVICE-AGENT[4238]: da_lws_client_connect: Trying connection with ip [3.232.226.205], ai_next 0x349b90
Nov 24 20:46:18 F300-25_2827f0 DEVICE-AGENT[4238]: Device-Agent Waiting for connect… to cnMaestro:[us-e1-s15-ojfthf7zs0.cloud.cambiumnetworks.com] ctimer=(nil)
Nov 24 20:46:18 F300-25_2827f0 DEVICE-AGENT[4238]: SSL_connect successful
Nov 24 20:46:18 F300-25_2827f0 DEVICE-AGENT[4238]: SSL_ERROR_WANT_READ try again
Nov 24 20:46:17 F300-25_2827f0 /OU=Domain Control Validated/OU=Issued through Cambium Networks Ltd E-PKI Manager/OU=COMODO SSL Wildcard/CN=
.cloud.cambiumnetworks.com
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: Server cert validation is enabled
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: SSL_ERROR_WANT_READ try again
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: Openssl connection to cloud.cambiumnetworks.com : 443
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: OpenConnection: Trying connection with ip [2600:1f18:1bb:f401:fdb2:574a:d8bf:3a3e], ai_next 0x349208
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: OpenConnection: Trying connection with ip [52.206.40.231], ai_next 0x349250
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: connect() Network is unreachable
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: Resolved cloud.cambiumnetworks.com to IPv4 address
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: connect() Network is unreachable
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: Resolved cloud.cambiumnetworks.com to IPv6 address
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: OpenConnection: Trying connection with ip [2600:1f18:1bb:f401:3629:79fb:b358:1c9], ai_next 0x3491a0
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: Resolved cloud.cambiumnetworks.com to IPv6 address
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: connect() Network is unreachable
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: OpenConnection: Trying connection with ip [2600:1f18:1bb:f400:fc5f:1e1d:87e9:9da3], ai_next 0x349138
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: Resolved cloud.cambiumnetworks.com to IPv6 address
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: connect() Network is unreachable
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: OpenConnection: Trying connection with ip [2600:1f18:1bb:f400:8be0:3a3f:51de:6b5c], ai_next 0x3490d0
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: Resolved cloud.cambiumnetworks.com to IPv6 address
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: Resolving URL cloud.cambiumnetworks.com
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: OpenConnection: hostname [cloud.cambiumnetworks.com] port [443/443]
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: platform_set_cns_connection_state: New CNS_STATE cns_serv_stat Connecting(4)
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: build_http_get_request: No cambium_id available
Nov 24 20:46:17 F300-25_2827f0 DEVICE-AGENT[4238]: build_http_get_request: Data serialNo: &serialNo=E6UA014GD500
Nov 23 05:24:44 F300-25_2827f0 firewall: Reloading firewall due to ifup of wan6 (ath0)
Nov 23 05:24:44 F300-25_2827f0 procd: - init complete -
Nov 23 05:24:42 F300-25_2827f0 mactelnetd[4408]: Bound to 0.0.0.0:20561
Nov 23 05:24:42 F300-25_2827f0 DEVICE-AGENT[4238]: platform_set_cns_connection_state: New CNS_STATE cns_serv_stat Connecting(4)
Nov 23 05:24:42 F300-25_2827f0 DEVICE-AGENT[4238]: Attempting (re)connection in 5 seconds
Nov 23 05:24:42 F300-25_2827f0 DEVICE-AGENT[4238]: platform_set_cns_connection_state: New CNS_STATE cns_serv_stat Not Connected(0)
Nov 23 05:24:36 F300-25_2827f0 firewall: Reloading firewall due to ifup of wan (ath0)
Nov 23 05:24:29 F300-25_2827f0 snmpd[3346]: DFS status: N/A
Nov 23 05:24:27 F300-25_2827f0 netifd: Network device 'ath1' link is up
Nov 23 05:24:27 F300-25_2827f0 dropbear[3322]: Not backgrounding
Nov 23 05:24:26 F300-25_2827f0 kernel: [ 38.698118] All STAs disassociated. IEEE80211_REASON_TDD_STOP (20)
Nov 23 05:24:26 F300-25_2827f0 kernel: [ 38.368073] All STAs disassociated. IEEE80211_REASON_TDD_STOP (20)
Nov 23 05:24:26 F300-25_2827f0 kernel: [ 38.048204] All STAs disassociated. IEEE80211_REASON_TDD_STOP (20)

And what are you wanting us to help you with? That log block says a lot but also nothing about your issue.

Please state your question, possibly in a new thread.

1 Like