SYSLOG errors - trying to decode

Products ePMP
1

I get a ton of errors (pasted below) in our syslog. They come in bursts and seem to be from most of our APs in each burst.  It looks like it is a problem with the APs trying to connect to cnMaestro so I tend to ignore them, but I'm not positive. What leads me to believe that is I was in cnMaestro at the same time I got a syslog error message and many of my APs suddenly showed offline (even though they were not) and then it cleared up a few seconds later.

Recent Syslog Errors

Date Time	Source	Message	Hostname	Timestamp (Device)	Facility	Tag	Severity	App Name	Proc Id	Msg Id	Data

3/9/2017 8:31:24 AM	10.10.10.13	handle_cns_msg: UNKNOWN message received	Harmony	2017 03-09 08:31:27-07:00	16		3	DEVICE-AGENT	16117	-	[meta sequenceId=“229”]

3/9/2017 8:31:21 AM	10.10.10.11	handle_cns_msg: UNKNOWN message received	Lookout	2017 03-09 08:31:23-07:00	16		3	DEVICE-AGENT	2299	-	[meta sequenceId=“59”]

3/9/2017 8:31:09 AM	10.10.10.29	handle_cns_msg: UNKNOWN message received	Easley	2017 03-09 09:31:11-06:00	16		3	DEVICE-AGENT	2139	-	[meta sequenceId=“193”]

3/9/2017 8:31:06 AM	10.10.10.19	handle_cns_msg: UNKNOWN message received	Belvedere	2017 03-09 08:31:08-07:00	16		3	DEVICE-AGENT	2796	-	[meta sequenceId=“187”]

3/9/2017 8:30:11 AM	10.10.10.11	lws_connect_timeout_cb: Unable to connect websocket to cnMaestro, trying again	Lookout	2017 03-09 08:30:13-07:00	16		3	DEVICE-AGENT	2299	-	[meta sequenceId=“58”]

3/9/2017 8:30:09 AM	10.10.10.13	lws_connect_timeout_cb: Unable to connect websocket to cnMaestro, trying again	Harmony	2017 03-09 08:30:11-07:00	16		3	DEVICE-AGENT	16117	-	[meta sequenceId=“228”]

3/9/2017 8:30:06 AM	10.10.10.29	lws_connect_timeout_cb: Unable to connect websocket to cnMaestro, trying again	Easley	2017 03-09 09:30:08-06:00	16		3	DEVICE-AGENT	2139	-	[meta sequenceId=“192”]

3/9/2017 8:30:04 AM	10.10.10.19	lws_connect_timeout_cb: Unable to connect websocket to cnMaestro, trying again	Belvedere	2017 03-09 08:30:07-07:00	16		3	DEVICE-AGENT	2796	-	[meta sequenceId=“186”]

3/9/2017 8:29:23 AM	10.10.10.12	handle_cns_msg: UNKNOWN message received	Lookout	2017 03-09 08:29:25-07:00	16		3	DEVICE-AGENT	2772	-	[meta sequenceId=“181”]

3/9/2017 8:29:22 AM	10.10.10.28	handle_cns_msg: UNKNOWN message received	Easley	2017 03-09 08:29:25-07:00	16		3	DEVICE-AGENT	2029	-	[meta sequenceId=“257”]

3/9/2017 8:29:09 AM	10.10.10.12	Attempting (re)connection in 5 seconds	Lookout	2017 03-09 08:29:12-07:00	16		3	DEVICE-AGENT	2772	-	[meta sequenceId=“180”]

3/9/2017 8:29:09 AM	10.10.10.12	callback_websocket: LWS_CALLBACK_CLOSED	Lookout	2017 03-09 08:29:12-07:00	16		3	DEVICE-AGENT	2772	-	[meta sequenceId=“179”]

3/9/2017 8:29:06 AM	10.10.10.28	callback_websocket: LWS_CALLBACK_CLOSED	Easley	2017 03-09 08:29:08-07:00	16		3	DEVICE-AGENT	2029	-	[meta sequenceId=“256”]

3/9/2017 8:29:04 AM	10.10.10.29	SMs pmac [00:04:56:FF:80:A4]	Easley	2017 03-09 09:29:07-06:00	16		3	DEVICE-AGENT	2139	-	[meta sequenceId=“191”]

3/9/2017 8:29:03 AM	10.10.10.11	callback_websocket: LWS_CALLBACK_CLOSED	Lookout	2017 03-09 08:29:05-07:00	16		3	DEVICE-AGENT	2299	-	[meta sequenceId=“57”]

3/9/2017 8:29:02 AM	10.10.10.13	Attempting (re)connection in 5 seconds	Harmony	2017 03-09 08:29:04-07:00	16		3	DEVICE-AGENT	16117	-	[meta sequenceId=“227”]

3/9/2017 8:29:02 AM	10.10.10.13	callback_websocket: LWS_CALLBACK_CLOSED	Harmony	2017 03-09 08:29:04-07:00	16		3	DEVICE-AGENT	16117	-	[meta sequenceId=“226”]

3/9/2017 8:28:58 AM	10.10.10.29	callback_websocket: LWS_CALLBACK_CLOSED	Easley	2017 03-09 09:29:00-06:00	16		3	DEVICE-AGENT	2139	-	[meta sequenceId=“190”]

3/9/2017 8:28:57 AM	10.10.10.19	Attempting (re)connection in 5 seconds	Belvedere	2017 03-09 08:29:00-07:00	16		3	DEVICE-AGENT	2796	-	[meta sequenceId=“185”]

3/9/2017 8:28:57 AM

2

Hi,

You are right, this messages are produced by cnMaestro daemon.

Device has lost connectivity with cnMaestro server.

Looks like some issue happens on cnMaestro server side or in the networks between devices and cnMaestro server which caused connection drop.

Do you use cnMaestro on premises or Cloud version?

Thank you.

3

We are cloud version.

I also notice from time to time our e400 WiFi APs get an orange light - they are also talking to the same instance of cloud cnMaestro. 

It happens a whole bunch all at once and then will stop happening for hours.  While it is happening, we are still passing all kinds of network traffic without issues and our oputbound ping times are consistent so I don't think we are experiencing network issues internally.