Guys,
Has anyone noticed that once SMs are upgraded to 8.1.5.1 the stability of their link seems to take a beating?
We have had clients who were rock solid on 7.3.6 suddenly have 30 sessions in 4 days.
It does not matter whether the client is on NAT or Bridge. Also, it seems that a 7.3.6 SM will get many more Time sets once the AP as been upgraded to 8.1.5.1 and these sets stop once the SM is also upgraded to 8.1.5.1
See here:
00:00:00 UT : 01/01/01 : File root.c : Line 946 Software Version : CANOPY 7.3.6 Oct 24 2005 12:06:56 SM-DES
00:00:00 UT : 01/01/01 : File root.c : Line 950 Software Boot Version : CANOPYBOOT 3.0
00:00:00 UT : 01/01/01 : File root.c : Line 956 FPGA Version : 070605
00:00:00 UT : 01/01/01 : File root.c : Line 960 FPGA Features : DES Sched
08:23:24 UT : 02/09/07 : File C:/ISIPPC/pssppc.250/bsps/devices/whisp/syslog.c : Line 1062 Time set
23:42:20 UT : 02/27/07 : File C:/ISIPPC/pssppc.250/bsps/devices/whisp/syslog.c : Line 1062 Time set
23:53:07 UT : 02/27/07 : File C:/ISIPPC/pssppc.250/bsps/devices/whisp/syslog.c : Line 1062 Time set
17:14:26 UT : 02/28/07 : File C:/ISIPPC/pssppc.250/bsps/devices/whisp/syslog.c : Line 1062 Time set
20:44:18 UT : 02/28/07 : File C:/ISIPPC/pssppc.250/bsps/devices/whisp/syslog.c : Line 1062 Time set
21:44:03 UT : 02/28/07 : File C:/ISIPPC/pssppc.250/bsps/devices/whisp/syslog.c : Line 1062 Time set
22:32:46 UT : 02/28/07 : File C:/ISIPPC/pssppc.250/bsps/devices/whisp/syslog.c : Line 1062 Time set
22:42:46 UT : 02/28/07 : File C:/ISIPPC/pssppc.250/bsps/devices/whisp/syslog.c : Line 1062 Time set
22:52:46 UT : 02/28/07 : File C:/ISIPPC/pssppc.250/bsps/devices/whisp/syslog.c : Line 1062 Time set
23:02:46 UT : 02/28/07 : File C:/ISIPPC/pssppc.250/bsps/devices/whisp/syslog.c : Line 1062 Time set
23:12:46 UT : 02/28/07 : File C:/ISIPPC/pssppc.250/bsps/devices/whisp/syslog.c : Line 1062 Time set
23:22:46 UT : 02/28/07 : File C:/ISIPPC/pssppc.250/bsps/devices/whisp/syslog.c : Line 1062 Time set
23:52:46 UT : 02/28/07 : File C:/ISIPPC/pssppc.250/bsps/devices/whisp/syslog.c : Line 1062 Time set
00:02:46 UT : 03/01/07 : File C:/ISIPPC/pssppc.250/bsps/devices/whisp/syslog.c : Line 1062 Time set
00:12:46 UT : 03/01/07 : File C:/ISIPPC/pssppc.250/bsps/devices/whisp/syslog.c : Line 1062 Time set
00:22:46 UT : 03/01/07 : File C:/ISIPPC/pssppc.250/bsps/devices/whisp/syslog.c : Line 1062 Time set
00:32:46 UT : 03/01/07 : File C:/ISIPPC/pssppc.250/bsps/devices/whisp/syslog.c : Line 1062 Time set
The AP was upgraded on 02/27/2007 and until we upgraded the SM to 8.1.5.1 there was a time set every hour or so.
Here is what happens after the SM upgrade:
23:10:55 UT : 03/01/07 : File C:/ISIPPC/pssppc.250/bsps/devices/whisp/update.c : Line 2160 Burnfile App from AutoUpdate.
23:12:16 UT : 03/01/07 : File C:/ISIPPC/pssppc.250/bsps/devices/whisp/update.c : Line 2193 POReset from AutoUpdate.
23:12:16 UT : 03/01/07 : File root.c : Line 3183 Reset from Telnet command line.
00:00:00 UT : 01/01/70 : File src/syslog.c : Line 997 System Reset Exception – External Hard Reset Watchdog Reset
00:00:00 UT : 01/01/70 : File src/root.c : Line 409 System Startup
00:00:00 UT : 01/01/70 : File src/root.c : Line 414 Software Version : CANOPY 8.1.5.1 SM-DES
00:00:00 UT : 01/01/70 : File src/root.c : Line 418 Software Boot Version : CANOPYBOOT 3.0
00:00:00 UT : 01/01/70 : File src/root.c : Line 424 FPGA Version : 041006
00:00:00 UT : 01/01/70 : File src/root.c : Line 428 FPGA Features : DES Sched
00:14:19 UT : 03/02/07 : File src/syslog.c : Line 1099 Time set
06:25:17 UT : 03/02/07 : File src/syslog.c : Line 1099 Time set
07:15:35 UT : 03/02/07 : File src/http_utils.c : Line 32 Reboot from Webpage.
07:15:35 UT : 03/02/07 : File src/syslog.c : Line 997 System Reset Exception – External Hard Reset Watchdog Reset
07:15:35 UT : 03/02/07 : File src/root.c : Line 409 System Startup
07:15:35 UT : 03/02/07 : File src/root.c : Line 414 Software Version : CANOPY 8.1.5.1 SM-DES
07:15:35 UT : 03/02/07 : File src/root.c : Line 418 Software Boot Version : CANOPYBOOT 3.0
07:15:35 UT : 03/02/07 : File src/root.c : Line 424 FPGA Version : 041006
07:15:35 UT : 03/02/07 : File src/root.c : Line 428 FPGA Features : DES Sched
07:16:19 UT : 03/02/07 : File src/syslog.c : Line 1099 Time set
00:00:00 UT : 01/01/01 : File src/syslog.c : Line 997 System Reset Exception – External Hard Reset
00:00:00 UT : 01/01/01 : File src/root.c : Line 409 System Startup
00:00:00 UT : 01/01/01 : File src/root.c : Line 414 Software Version : CANOPY 8.1.5.1 SM-DES
00:00:00 UT : 01/01/01 : File src/root.c : Line 418 Software Boot Version : CANOPYBOOT 3.0
00:00:00 UT : 01/01/01 : File src/root.c : Line 424 FPGA Version : 041006
00:00:00 UT : 01/01/01 : File src/root.c : Line 428 FPGA Features : DES Sched
00:00:17 UT : 01/01/01 : File src/syslog.c : Line 1099 Time set
10:10:05 UT : 03/09/07 : File src/syslog.c : Line 1099 Time set
11:00:05 UT : 03/09/07 : File src/syslog.c : Line 1099 Time set
12:00:05 UT : 03/09/07 : File src/syslog.c : Line 1099 Time set
13:00:05 UT : 03/09/07 : File src/syslog.c : Line 1099 Time set
15:00:05 UT : 03/09/07 : File src/syslog.c : Line 1099 Time set
00:00:00 UT : 01/01/01 : File src/syslog.c : Line 997 System Reset Exception – External Hard Reset
00:00:00 UT : 01/01/01 : File src/root.c : Line 409 System Startup
00:00:00 UT : 01/01/01 : File src/root.c : Line 414 Software Version : CANOPY 8.1.5.1 SM-DES
00:00:00 UT : 01/01/01 : File src/root.c : Line 418 Software Boot Version : CANOPYBOOT 3.0
00:00:00 UT : 01/01/01 : File src/root.c : Line 424 FPGA Version : 041006
00:00:00 UT : 01/01/01 : File src/root.c : Line 428 FPGA Features : DES Sched
14:36:00 UT : 03/13/07 : File src/syslog.c : Line 1099 Time set
00:00:00 UT : 01/01/01 : File src/syslog.c : Line 997 System Reset Exception – External Hard Reset
00:00:00 UT : 01/01/01 : File src/root.c : Line 409 System Startup
00:00:00 UT : 01/01/01 : File src/root.c : Line 414 Software Version : CANOPY 8.1.5.1 SM-DES
00:00:00 UT : 01/01/01 : File src/root.c : Line 418 Software Boot Version : CANOPYBOOT 3.0
00:00:00 UT : 01/01/01 : File src/root.c : Line 424 FPGA Version : 041006
00:00:00 UT : 01/01/01 : File src/root.c : Line 428 FPGA Features : DES Sched
14:36:45 UT : 03/13/07 : File src/syslog.c : Line 1099 Time set
00:00:00 UT : 01/01/01 : File src/syslog.c : Line 997 System Reset Exception – External Hard Reset
00:00:00 UT : 01/01/01 : File src/root.c : Line 409 System Startup
00:00:00 UT : 01/01/01 : File src/root.c : Line 414 Software Version : CANOPY 8.1.5.1 SM-DES
00:00:00 UT : 01/01/01 : File src/root.c : Line 418 Software Boot Version : CANOPYBOOT 3.0
00:00:00 UT : 01/01/01 : File src/root.c : Line 424 FPGA Version : 041006
00:00:00 UT : 01/01/01 : File src/root.c : Line 428 FPGA Features : DES Sched
14:38:36 UT : 03/13/07 : File src/syslog.c : Line 1099 Time set
00:00:00 UT : 01/01/01 : File src/syslog.c : Line 997 System Reset Exception – External Hard Reset
00:00:00 UT : 01/01/01 : File src/root.c : Line 409 System Startup
00:00:00 UT : 01/01/01 : File src/root.c : Line 414 Software Version : CANOPY 8.1.5.1 SM-DES
00:00:00 UT : 01/01/01 : File src/root.c : Line 418 Software Boot Version : CANOPYBOOT 3.0
00:00:00 UT : 01/01/01 : File src/root.c : Line 424 FPGA Version : 041006
00:00:00 UT : 01/01/01 : File src/root.c : Line 428 FPGA Features : DES Sched
00:00:00 UT : 01/01/01 : File src/syslog.c : Line 997 System Reset Exception – External Hard Reset
00:00:00 UT : 01/01/01 : File src/root.c : Line 409 System Startup
00:00:00 UT : 01/01/01 : File src/root.c : Line 414 Software Version : CANOPY 8.1.5.1 SM-DES
00:00:00 UT : 01/01/01 : File src/root.c : Line 418 Software Boot Version : CANOPYBOOT 3.0
00:00:00 UT : 01/01/01 : File src/root.c : Line 424 FPGA Version : 041006
00:00:00 UT : 01/01/01 : File src/root.c : Line 428 FPGA Features : DES Sched
14:41:27 UT : 03/13/07 : File src/syslog.c : Line 1099 Time set
00:00:00 UT : 01/01/01 : File src/syslog.c : Line 997 System Reset Exception – External Hard Reset
00:00:00 UT : 01/01/01 : File src/root.c : Line 409 System Startup
00:00:00 UT : 01/01/01 : File src/root.c : Line 414 Software Version : CANOPY 8.1.5.1 SM-DES
00:00:00 UT : 01/01/01 : File src/root.c : Line 418 Software Boot Version : CANOPYBOOT 3.0
00:00:00 UT : 01/01/01 : File src/root.c : Line 424 FPGA Version : 041006
00:00:00 UT : 01/01/01 : File src/root.c : Line 428 FPGA Features : DES Sched
15:41:36 UT : 03/13/07 : File src/syslog.c : Line 1099 Time set
00:00:00 UT : 01/01/01 : File src/syslog.c : Line 997 System Reset Exception – External Hard Reset
See how the reliability suddenly dipped?
Signal strenght is -74db with a jitter of 2.
Are we alone in seeing this?
I received a response from technical support ( i sent them this issue by email) and was told that upgrading from 7.3.6 directly to 8.1.5.1 is not supported and i was advised to re-downgrade to 7.3.6 and upgrade again going through 8.1.4 as an intermediate step.
Doing that now and will post any results over the next couple of days.
I followed the suggestings given by Tech Support yet in just under 12 hours, the pattern is visibly the same. Lots of sessions by the clients on this AP.
I will switch them back to 7.3.6 and see if the session count stabilises. If not, it’s time to start looking at other issues on the AP maybe.
Update on this:
Change the AP’s frequency and the re-regs stopped. Must have been an interference issue. Strange though because nothing was showing up on the frequency either AP end or SM end.
Based on your reports it appears that 7.3.6 is more robust than 8.1.5.1.
Makes me even LESS likely to make a change any time soon as the spectrum is already crowded and my network is running better than ever. I don’t need the headaches.
Actually Jerry, that is not quite true.
The re-regs persisted under 7.3.6 until i changed the AP frequency.
What i don’t like about the error codes is that we get no info as to what the issues might be and have to constantly guess and troubleshoot.
A case in point… two clients were given the same public IP. Both had intermittent diconnections for obvious reasons. No indication from the event logs, just pot luck that we noticed.
I think rjk had a nifty script for finding duplicate IP’s on your network. I wonder if thats a script (or one can be made) to run 24/7 and report conflicts. before i went to a dhcp network i constantly has static problems.
vanilla wrote:
We have had clients who were rock solid on 7.3.6 suddenly have 30 sessions in 4 days.
I must have mis-interpreted.....I thought your AP was solid until you tried 8.1.5.1
It was… but the re-regs and the 8.1.5.1 upgrade were a coincidence.
The re-regs continued after I downgraded back to 7.3.6 and only stopped when we changed the APs frequency.
Interesting…
Thanks
I’m with Jerry, our plant has never ran better 7.3.6(knock on wood)… even with the colocated backhauls. I’m not updating till there are several posts that indicate there is an improvement. We have plenty of work without creating more.