PMP450 Fatal Errors

Seeing something strange in the system logs with a PMP450 radio.

Task Stack Dump:
0x010b8180: (PrintStackDump)
0x010b8254: 004ea71c 0000015a 010b8264 00191680
0x010b8264: 004ea71c 0000015a 00000000 010b8278
0x010b8274: 00133164 010b8280 0011859c 00b063f8
0x010b8284: 0000003e 00000000 0000000c 00000003
0x010b8294: 00000000 00000000 00000000 00000000
0x010b82a4: 00000000 00000000 00000000 00000000
0x010b82b4: 00000003 08000d38 00000000 00000000
0x010b82c4: 004e4218 00134460 ffffffbf 00000002
0x010b82d4: 010b831c 00000000 010b8654 00000000
0x010b82e4: 08001474 08000584 010b831c 00000000
0x010b82f4: 00000000 00000000 004e4218 00000000
0x010b8304: 00000000 010b8654 00000000 010b8708
0x010b8314: 00000000 00000308 00000000 00000000
0x010b8324: 00000079 00010000 00000011 00000000
0x010b8334: 00000000 00000000 010b86b8 0000008c
0x010b8344: 003fd898 00000000 deadbeef 00000004
0x010b8354: 003fd834 010b8708 010b8654 004e4218
0x010b8364: 00000001 010b86b8 00000010 00000001
0x010b8374: 0055eba3 010b849a 004e421e 00000000
0x010b8384: 00000002 010b8654 010b8498 00404a84
0x010b8394: 00000000 00000000 00000000 00000000
0x010b83a4: 00000000 00000000 00000000 00000000
0x010b83b4: 00000000 00000000 00000000 00000000
0x010b83c4: 00000000 00000000 00000000 00000000
0x010b83d4: 00000000 00000000 00000000 00000000
0x010b83e4: 00000000 00000000 00000000 00000000
0x010b83f4: 00000000 00000000 00000000 00000000
0x010b8404: 00000000 00000000 00000000 00000000
0x010b8414: 00000000 00000000 00000000 00000000
0x010b8424: 00000000 00000000 00000000 00000000
0x010b8434: 00000000 00000000 00000000 00000000
0x010b8444: 00000000 00000000 00000000 00000000
0x010b8454: 00000000 00000000 00000000 00000000
0x010b8464: 00000000 00000000 00000000 00000000
0x010b8474: 00000000 00000000 00000000 00000000
0x010b8484: 00000000 00000000 00000000 00000000
0x010b8494: 00000000 30440000 00000000 00000000
0x010b84a4: 00000000 00000000
03/04/2001 : 13:40:25 MST : :Forced reset;
03/04/2001 : 13:40:25 MST :
System Startup
System Reset Exception – Reset due to FatalError (MPU Violation)
Software Version : CANOPY 16.2.2 (Build STA-1) AP
Board Type : P12
Boot Bank : 1
Board Temperature : 38 C / 101 F
Device Setting : 5.4GHz MIMO OFDM - Access Point - 0a-00-3e-a1-24-d5 - 5530.0 MHz - 20.0 MHz - 1/16 - CC 215 - 2.5 ms - North America/United States
FPGA Version : 032720

After a few hours, there’s another error occurring.

10/18/2020 : 17:09:10 MST : :Time Set
03/04/2001 : 17:09:10 MST : :Time Set
10/18/2020 : 17:14:14 MST : :Time Set
03/04/2001 : 17:14:14 MST : :Time Set
03/04/2001 : 17:19:13 MST : :MPU DATA VIOLATION: addr: 0x003fdda0, inst: 0x28800003, code: 17, badaddr: 0x00000000, retaddr: 0x00118598
03/04/2001 : 17:19:13 MST : :FatalError()
03/04/2001 : 17:19:13 MST : :Last 25 Debug Messages:
03/04/2001 : 17:19:14 MST :
03/04/2001 : 16:48:51 MST : 1128347: NTP : _tm_set: Time Set, CurTime: 3/4/2001 : 23:48:51 NewTime: 10/18/2020 : 23:48:52
03/04/2001 : 16:48:52 MST : 1128400: GPSI: PermLog:Time Set
03/04/2001 : 16:48:52 MST : 1128400: GPSI: _tm_set: Time Set, CurTime: 10/18/2020 : 23:48:53 NewTime: 3/4/2001 : 23:48:52
03/04/2001 : 16:53:55 MST : 1158796: NTP : PermLog:Time Set
03/04/2001 : 16:53:55 MST : 1158797: NTP : _tm_set: Time Set, CurTime: 3/4/2001 : 23:53:55 NewTime: 10/18/2020 : 23:53:56
03/04/2001 : 16:53:56 MST : 1158803: GPSI: PermLog:Time Set
03/04/2001 : 16:53:56 MST : 1158803: GPSI: _tm_set: Time Set, CurTime: 10/18/2020 : 23:53:57 NewTime: 3/4/2001 : 23:53:56
03/04/2001 : 16:59:00 MST : 1189246: NTP : PermLog:Time Set
03/04/2001 : 16:59:00 MST : 1189246: NTP : _tm_set: Time Set, CurTime: 3/4/2001 : 23:59:0 NewTime: 10/18/2020 : 23:59:1
03/04/2001 : 16:59:01 MST : 1189304: GPSI: PermLog:Time Set
03/04/2001 : 16:59:01 MST : 1189305: GPSI: _tm_set: Time Set, CurTime: 10/18/2020 : 23:59:2 NewTime: 3/4/2001 : 23:59:1
03/04/2001 : 17:00:02 MST : 1195423: VC_RxGet: DataHdr mismatch before and after cache inval: 02c078f8, 04000000, 18e4000b, RFLength = 256
03/04/2001 : 17:04:04 MST : 1219696: NTP : PermLog:Time Set
03/04/2001 : 17:04:04 MST : 1219697: NTP : _tm_set: Time Set, CurTime: 3/5/2001 : 0:4:4 NewTime: 10/19/2020 : 0:4:5
03/04/2001 : 17:04:05 MST : 1219703: GPSI: PermLog:Time Set
03/04/2001 : 17:04:05 MST : 1219703: GPSI: _tm_set: Time Set, CurTime: 10/19/2020 : 0:4:6 NewTime: 3/5/2001 : 0:4:5
03/04/2001 : 17:09:09 MST : 1250146: NTP : PermLog:Time Set
03/04/2001 : 17:09:09 MST : 1250146: NTP : _tm_set: Time Set, CurTime: 3/5/2001 : 0:9:9 NewTime: 10/19/2020 : 0:9:10
03/04/2001 : 17:09:10 MST : 1250202: GPSI: PermLog:Time Set
03/04/2001 : 17:09:10 MST : 1250202: GPSI: _tm_set: Time Set, CurTime: 10/19/2020 : 0:9:11 NewTime: 3/5/2001 : 0:9:10
03/04/2001 : 17:14:13 MST : 1280597: NTP : PermLog:Time Set
03/04/2001 : 17:14:13 MST : 1280597: NTP : _tm_set: Time Set, CurTime: 3/5/2001 : 0:14:13 NewTime: 10/19/2020 : 0:14:14
03/04/2001 : 17:14:14 MST : 1280623: GPSI: PermLog:Time Set
03/04/2001 : 17:14:14 MST : 1280624: GPSI: _tm_set: Time Set, CurTime: 10/19/2020 : 0:14:15 NewTime: 3/5/2001 : 0:14:14
03/04/2001 : 17:19:13 MST : 1310596: GPSI: PermLog:MPU DATA VIOLATION: addr: 0x003fdda0, inst: 0x28800003, code: 17, badaddr: 0x00000000, retaddr: 0x00118598

current cticks: 1310599
03/04/2001 : 17:19:14 MST :
Stack Dump information:
Current context Task: GPSI
Current Stack: 2%
Max Stack: 35%
r0: 00000000 r1: deadbeef r2: 00000002 r3: 007095d2
r4: 007095d2 r5: 00000000 r6: 010b869c r7: 004e4228
r8: 00000000 r9: 0000002c r10: 006fb670 r11: 0043fa55
r12: 08088d04 r13: 815d34e0 r14: 08080174 r15: 08088d04
r16: 008eba70 r17: 00000000 r18: 00000000 r19: 00000000
r20: 00000000 r21: 00000000 r22: 00000000 r23: 00000000
r24: 00000000 r25: deadbeef r26: 0098b288 r27: 010b8274
r28: 010b8278 r29: 00133140 r30: deadbeef r31: 00133154
Task Control Block:
OSTCBTaskName: GPSI
OSTCBStkPtr: 0x010b8048
OSTCBStkBottom: 0x010b4a88
OSTCBStkSize: 4095
OSTCBStkBase: 0x010b8a84
OSTCBStkUsed: 268
OSTCBStkUsedMax: 5684
OSTCBExtPtr: 0x01100f3c
OSTCBOpt: 3
OSTCBId: 43
OSTCBNext: 0x01023898
OSTCBPrev: 0x01023960
OSTCBEventPtr: 0x00000000
OSTCBMsg: 0x00000000
OSTCBFlagNode: 0x00000000
OSTCBFlagsRdy: 0
OSTCBDly: 0
OSTCBStat: 0
OSTCBPendTO: 0
OSTCBPrio: 43
OSTCBX: 3
OSTCBY: 5
OSTCBBitX: 8
OSTCBBitY: 32
OSTCBDelReq: 0
OSTCBCtxSwCtr: 4431177
OSTCBCyclesTot: 0
OSTCBCyclesMax: 0
OSTCBPreemptions: 0
OSTCBCyclesStart: 0
03/04/2001 : 17:19:14 MST :
Task Stack Dump:
0x010b8180: (PrintStackDump)
0x010b8254: 004ea71c 0000015a 010b8264 00191680
0x010b8264: 004ea71c 0000015a 00000000 010b8278
0x010b8274: 00133164 010b8280 0011859c 00b063f8
0x010b8284: 00000036 00000000 0000000c 00000003
0x010b8294: 572c3233 34003400 0034380d 0a000000
0x010b82a4: 00000000 00000000 00000000 00000000
0x010b82b4: 00000000 00000000 00000000 00000000
0x010b82c4: 00000000 00000000 00000000 00000000
0x010b82d4: 00000000 00000000 00000000 00000000
0x010b82e4: 00000000 00000000 00000000 00000000
0x010b82f4: 00000000 00000000 00000000 00000000
0x010b8304: 00000000 00000000 00000000 00000000
0x010b8314: 00000000 00000000 00000000 00000000
0x010b8324: 00000000 00000000 00000000 00000000
0x010b8334: 00000000 00000000 00000000 00000000
0x010b8344: 00000000 00000000 00000000 00000000
0x010b8354: 00000000 00000000 00000000 00000000
0x010b8364: 00000001 010b86b8 00000010 00000001
0x010b8374: 0055eba3 010b849a 004e421e 00000000
0x010b8384: 00000002 010b8654 010b8498 00404a84
0x010b8394: 00000000 00000000 00000000 00000000
0x010b83a4: 00000000 00000000 00000000 00000000
0x010b83b4: 00000000 00000000 00000000 00000000
0x010b83c4: 00000000 00000000 00000000 00000000
0x010b83d4: 00000000 00000000 00000000 00000000
0x010b83e4: 00000000 00000000 00000000 00000000
0x010b83f4: 00000000 00000000 00000000 00000000
0x010b8404: 00000000 00000000 00000000 00000000
0x010b8414: 00000000 00000000 00000000 00000000
0x010b8424: 00000000 00000000 00000000 00000000
0x010b8434: 00000000 00000000 00000000 00000000
0x010b8444: 00000000 00000000 00000000 00000000
0x010b8454: 00000000 00000000 00000000 00000000
0x010b8464: 00000000 00000000 00000000 00000000
0x010b8474: 00000000 00000000 00000000 00000000
0x010b8484: 00000000 00000000 00000000 00000000
0x010b8494: 00000000 30340000 00000000 00000000
0x010b84a4: 00000000 00000000
03/04/2001 : 17:19:14 MST : :Forced reset;
03/04/2001 : 17:19:14 MST :
System Startup
System Reset Exception – Reset due to FatalError (MPU Violation)

I’m open to ideas on to what could be causing this? Bad AP? Firmware issue? Radioactive ants?

Hi, in the new firmware version 16.2.3, there is a bug fix that may be relevant to your situation:

450 AP CPY-16735 PMP 450 AP Reset due to MPU Violation

Maybe try the new firmware version and see if that fixes the issue?

1 Like

Thanks, we found another post that says a reboot may help, but we’ll try this route if it persists. Thank you!

Sometimes we see the error log output like this due to the PMP 450 AP taking in water. Is it a regular 450 AP? Has it rained a lot lately?

Haven’t seen any rain in about 2 months.

We are seeing this same issue across multiple sectors. 450m and 450. We created a ticket. They told us to migrate to 16.2.3 and then a short time later sent an update saying it’s still an issue hoping to be resolved with 16.2.4 or R20