External E2E setup New Link

Atheer · September 11, 2023, 8:19am

Hi all,

I’m doing my first field test and I need help. In my setup I have a server running external E2E controller and On-prem cnMaestro, I have two PoP DNs(V5000) connected to my E2E and both are online. I tried to connect one CN (v1000) to one of the PoPs (tried to connect to both) however I have failed !

cnmaestro x have enough licenses tier4 and tier5 and have connected to the cloud (anchor account).

there is a wired connection between the two PoPs(same broadcast domain).

I have configured the E2E IPv6 address and configuration on both PoPs.

I have tried different channels and priorities on the link but didn’t succeed unfortunately.

any suggestions ?

Regards

Prasanna_TM · September 11, 2023, 9:03am

Hi Atheer,
Ensure CN node details are correct.
as seen in cnMaestro,
Is link from POP to CN is down? (or)
Is the link from POP to CN is UP. but CN node is down?

e2e_minion logs would get you adequate clues.

Can you invite me (ptm100) to your cloud account (as super administrator)so that I could quickly share appropriate suggestion.

Atheer · September 11, 2023, 11:47am

Hi Parasanna,

I have invited you to the cloud account.

below is the logs from DN01 e2e_minion:

I0730 05:24:08.273056 17770 Received SetNodeParams (type GPS)
I0730 05:24:08.273087 17770 Sending NodeParams to driver for MAC: 22:04:56:88:67:38
I0730 05:24:08.273094 17770 Enabling GPS…
I0730 05:24:08.273238 17770 Sending NodeParams to driver for MAC: 12:04:56:88:67:38
I0730 05:24:08.273252 17770 Enabling GPS…
E0730 05:24:08.277738 17754 Bad length of driver response, len: 0, expected: 32
E0730 05:24:08.281621 17754 Bad length of driver response, len: 0, expected: 32
I0730 05:24:13.273583 17770 Received SetNodeParams (type GPS)
I0730 05:24:13.273615 17770 Sending NodeParams to driver for MAC: 22:04:56:88:67:38
I0730 05:24:13.273623 17770 Enabling GPS…
I0730 05:24:13.273777 17770 Sending NodeParams to driver for MAC: 12:04:56:88:67:38
I0730 05:24:13.273789 17770 Enabling GPS…
E0730 05:24:13.278272 17754 Bad length of driver response, len: 0, expected: 32
E0730 05:24:13.282181 17754 Bad length of driver response, len: 0, expected: 32
I0730 05:24:18.278291 17770 Received SetNodeParams (type GPS)
I0730 05:24:18.278323 17770 Sending NodeParams to driver for MAC: 22:04:56:88:67:38
I0730 05:24:18.278331 17770 Enabling GPS…
I0730 05:24:18.278481 17770 Sending NodeParams to driver for MAC: 12:04:56:88:67:38
I0730 05:24:18.278494 17770 Enabling GPS…
E0730 05:24:18.283020 17754 Bad length of driver response, len: 0, expected: 32
E0730 05:24:18.286896 17754 Bad length of driver response, len: 0, expected: 32
I0730 05:24:23.279067 17770 Received SetNodeParams (type GPS)
I0730 05:24:23.279096 17770 Sending NodeParams to driver for MAC: 22:04:56:88:67:38
I0730 05:24:23.279104 17770 Enabling GPS…
I0730 05:24:23.279243 17770 Sending NodeParams to driver for MAC: 12:04:56:88:67:38
I0730 05:24:23.279258 17770 Enabling GPS…
E0730 05:24:23.283740 17754 Bad length of driver response, len: 0, expected: 32
E0730 05:24:23.287622 17754 Bad length of driver response, len: 0, expected: 32
I0730 05:24:28.280328 17770 Received SetNodeParams (type GPS)
I0730 05:24:28.280361 17770 Sending NodeParams to driver for MAC: 22:04:56:88:67:38
I0730 05:24:28.280368 17770 Enabling GPS…
I0730 05:24:28.280520 17770 Sending NodeParams to driver for MAC: 12:04:56:88:67:38
I0730 05:24:28.280534 17770 Enabling GPS…
E0730 05:24:28.285048 17754 Bad length of driver response, len: 0, expected: 32
E0730 05:24:28.288924 17754 Bad length of driver response, len: 0, expected: 32
I0730 05:24:33.280460 17770 Received SetNodeParams (type GPS)
I0730 05:24:33.280491 17770 Sending NodeParams to driver for MAC: 22:04:56:88:67:38
I0730 05:24:33.280499 17770 Enabling GPS…
I0730 05:24:33.280640 17770 Sending NodeParams to driver for MAC: 12:04:56:88:67:38
I0730 05:24:33.280652 17770 Enabling GPS…
E0730 05:24:33.285112 17754 Bad length of driver response, len: 0, expected: 32
E0730 05:24:33.288987 17754 Bad length of driver response, len: 0, expected: 32
I0730 05:24:38.281981 17770 Received SetNodeParams (type GPS)
I0730 05:24:38.282014 17770 Sending NodeParams to driver for MAC: 22:04:56:88:67:38
I0730 05:24:38.282022 17770 Enabling GPS…
I0730 05:24:38.282160 17770 Sending NodeParams to driver for MAC: 12:04:56:88:67:38
I0730 05:24:38.282173 17770 Enabling GPS…
E0730 05:24:38.286726 17754 Bad length of driver response, len: 0, expected: 32
E0730 05:24:38.290612 17754 Bad length of driver response, len: 0, expected: 32
I0730 05:24:43.282312 17770 Received SetNodeParams (type GPS)
I0730 05:24:43.282347 17770 Sending NodeParams to driver for MAC: 22:04:56:88:67:38
I0730 05:24:43.282356 17770 Enabling GPS…
I0730 05:24:43.282510 17770 Sending NodeParams to driver for MAC: 12:04:56:88:67:38
I0730 05:24:43.282523 17770 Enabling GPS…
E0730 05:24:43.287014 17754 Bad length of driver response, len: 0, expected: 32
E0730 05:24:43.291038 17754 Bad length of driver response, len: 0, expected: 32
I0730 05:24:48.286420 17770 Received SetNodeParams (type GPS)
I0730 05:24:48.286450 17770 Sending NodeParams to driver for MAC: 22:04:56:88:67:38
I0730 05:24:48.286458 17770 Enabling GPS…
I0730 05:24:48.286597 17770 Sending NodeParams to driver for MAC: 12:04:56:88:67:38
I0730 05:24:48.286609 17770 Enabling GPS…
E0730 05:24:48.291088 17754 Bad length of driver response, len: 0, expected: 32
E0730 05:24:48.294962 17754 Bad length of driver response, len: 0, expected: 32
I0730 05:24:53.287881 17770 Received SetNodeParams (type GPS)
I0730 05:24:53.287914 17770 Sending NodeParams to driver for MAC: 22:04:56:88:67:38
I0730 05:24:53.287921 17770 Enabling GPS…
I0730 05:24:53.288060 17770 Sending NodeParams to driver for MAC: 12:04:56:88:67:38
I0730 05:24:53.288074 17770 Enabling GPS…
E0730 05:24:53.292549 17754 Bad length of driver response, len: 0, expected: 32
E0730 05:24:53.296427 17754 Bad length of driver response, len: 0, expected: 32
I0730 05:24:58.288751 17770 Received SetNodeParams (type GPS)
I0730 05:24:58.288784 17770 Sending NodeParams to driver for MAC: 22:04:56:88:67:38
I0730 05:24:58.288792 17770 Enabling GPS…
I0730 05:24:58.288936 17770 Sending NodeParams to driver for MAC: 12:04:56:88:67:38
I0730 05:24:58.288949 17770 Enabling GPS…
E0730 05:24:58.293502 17754 Bad length of driver response, len: 0, expected: 32
E0730 05:24:58.297494 17754 Bad length of driver response, len: 0, expected: 32
I0730 05:25:03.289659 17770 Received SetNodeParams (type GPS)
I0730 05:25:03.289690 17770 Sending NodeParams to driver for MAC: 22:04:56:88:67:38
I0730 05:25:03.289698 17770 Enabling GPS…
I0730 05:25:03.289846 17770 Sending NodeParams to driver for MAC: 12:04:56:88:67:38
I0730 05:25:03.289860 17770 Enabling GPS…
E0730 05:25:03.294426 17754 Bad length of driver response, len: 0, expected: 32
E0730 05:25:03.298303 17754 Bad length of driver response, len: 0, expected: 32
I0730 05:25:08.291390 17770 Received SetNodeParams (type GPS)
I0730 05:25:08.291420 17770 Sending NodeParams to driver for MAC: 22:04:56:88:67:38
I0730 05:25:08.291428 17770 Enabling GPS…
I0730 05:25:08.291572 17770 Sending NodeParams to driver for MAC: 12:04:56:88:67:38
I0730 05:25:08.291585 17770 Enabling GPS…
E0730 05:25:08.296075 17754 Bad length of driver response, len

below is the logs from DN02 e2e_minion:

I0730 05:27:33.657930 3845 Sending NodeParams to driver for MAC: 12:04:56:88:65:41
I0730 05:27:33.657940 3845 Enabling GPS…
E0730 05:27:33.662473 3819 Bad length of driver response, len: 0, expected: 32
E0730 05:27:33.666394 3819 Bad length of driver response, len: 0, expected: 32
I0730 05:27:38.659734 3845 Received SetNodeParams (type GPS)
I0730 05:27:38.659765 3845 Sending NodeParams to driver for MAC: 22:04:56:88:65:41
I0730 05:27:38.659772 3845 Enabling GPS…
I0730 05:27:38.659914 3845 Sending NodeParams to driver for MAC: 12:04:56:88:65:41
I0730 05:27:38.659927 3845 Enabling GPS…
E0730 05:27:38.664431 3819 Bad length of driver response, len: 0, expected: 32
E0730 05:27:38.668308 3819 Bad length of driver response, len: 0, expected: 32
I0730 05:27:38.944845 4138 Advertising ttl update (key, version, originatorId, ttlVersion) (e2e-network-allocations, 3, node-00.04.56.88.65.41-minion, 193)
I0730 05:27:38.945673 4138 Scheduling ttl timer after 75000ms.
I0730 05:27:39.671715 4138 Received request to set prefixes from ctrl-app-TOPOLOGY_APP
I0730 05:27:43.661509 3845 Received SetNodeParams (type GPS)
I0730 05:27:43.661540 3845 Sending NodeParams to driver for MAC: 22:04:56:88:65:41
I0730 05:27:43.661548 3845 Enabling GPS…
I0730 05:27:43.661688 3845 Sending NodeParams to driver for MAC: 12:04:56:88:65:41
I0730 05:27:43.661701 3845 Enabling GPS…
E0730 05:27:43.666210 3819 Bad length of driver response, len: 0, expected: 32
E0730 05:27:43.670091 3819 Bad length of driver response, len: 0, expected: 32
I0730 05:27:48.662989 3845 Received SetNodeParams (type GPS)
I0730 05:27:48.663019 3845 Sending NodeParams to driver for MAC: 22:04:56:88:65:41
I0730 05:27:48.663028 3845 Enabling GPS…
I0730 05:27:48.663166 3845 Sending NodeParams to driver for MAC: 12:04:56:88:65:41
I0730 05:27:48.663179 3845 Enabling GPS…
E0730 05:27:48.667646 3819 Bad length of driver response, len: 0, expected: 32
E0730 05:27:48.671521 3819 Bad length of driver response, len: 0, expected: 32
I0730 05:27:53.220783 4138 Received request for routing adjacencies from ctrl-app-TOPOLOGY_APP
I0730 05:27:53.663208 3845 Received SetNodeParams (type GPS)
I0730 05:27:53.663237 3845 Sending NodeParams to driver for MAC: 22:04:56:88:65:41
I0730 05:27:53.663245 3845 Enabling GPS…
I0730 05:27:53.663389 3845 Sending NodeParams to driver for MAC: 12:04:56:88:65:41
I0730 05:27:53.663403 3845 Enabling GPS…
E0730 05:27:53.667901 3819 Bad length of driver response, len: 0, expected: 32
E0730 05:27:53.671804 3819 Bad length of driver response, len: 0, expected: 32
I0730 05:27:54.672551 4138 Received request to set prefixes from ctrl-app-TOPOLOGY_APP
I0730 05:27:58.664638 3845 Received SetNodeParams (type GPS)
I0730 05:27:58.664669 3845 Sending NodeParams to driver for MAC: 22:04:56:88:65:41
I0730 05:27:58.664676 3845 Enabling GPS…
I0730 05:27:58.664831 3845 Sending NodeParams to driver for MAC: 12:04:56:88:65:41
I0730 05:27:58.664844 3845 Enabling GPS…
E0730 05:27:58.669384 3819 Bad length of driver response, len: 0, expected: 32
E0730 05:27:58.673264 3819 Bad length of driver response, len: 0, expected: 32
I0730 05:28:03.669536 3845 Received SetNodeParams (type GPS)
I0730 05:28:03.669567 3845 Sending NodeParams to driver for MAC: 22:04:56:88:65:41
I0730 05:28:03.669575 3845 Enabling GPS…
I0730 05:28:03.669728 3845 Sending NodeParams to driver for MAC: 12:04:56:88:65:41
I0730 05:28:03.669740 3845 Enabling GPS…
E0730 05:28:03.674345 3819 Bad length of driver response, len: 0, expected: 32
E0730 05:28:03.678251 3819 Bad length of driver response, len: 0, expected: 32
I0730 05:28:08.670396 3845 Received SetNodeParams (type GPS)
I0730 05:28:08.670428 3845 Sending NodeParams to driver for MAC: 22:04:56:88:65:41
I0730 05:28:08.670436 3845 Enabling GPS…
I0730 05:28:08.670574 3845 Sending NodeParams to driver for MAC: 12:04:56:88:65:41
I0730 05:28:08.670588 3845 Enabling GPS…
E0730 05:28:08.675058 3819 Bad length of driver response, len: 0, expected: 32
E0730 05:28:08.678931 3819 Bad length of driver response, len: 0, expected: 32
I0730 05:28:09.673306 4138 Received request to set prefixes from ctrl-app-TOPOLOGY_APP
I0730 05:28:13.672415 3845 Received SetNodeParams (type GPS)
I0730 05:28:13.672446 3845 Sending NodeParams to driver for MAC: 22:04:56:88:65:41
I0730 05:28:13.672472 3845 Enabling GPS…
I0730 05:28:13.672616 3845 Sending NodeParams to driver for MAC: 12:04:56:88:65:41
I0730 05:28:13.672628 3845 Enabling GPS…
E0730 05:28:13.677114 3819 Bad length of driver response, len: 0, expected: 32
E0730 05:28:13.680994 3819 Bad length of driver response, len: 0, expected: 32
I0730 05:28:18.673310 3845 Received SetNodeParams (type GPS)
I0730 05:28:18.673341 3845 Sending NodeParams to driver for MAC: 22:04:56:88:65:41
I0730 05:28:18.673347 3845 Enabling GPS…
I0730 05:28:18.673486 3845 Sending NodeParams to driver for MAC: 12:04:56:88:65:41
I0730 05:28:18.673499 3845 Enabling GPS…
E0730 05:28:18.678071 3819 Bad length of driver response, len: 0, expected: 32
E0730 05:28:18.681946 3819 Bad length of driver response, len: 0, expected: 32
I0730 05:28:23.222272 4138 Received request for routing adjacencies from ctrl-app-TOPOLOGY_APP
I0730 05:28:23.674501 3845 Received SetNodeParams (type GPS)
I0730 05:28:23.674532 3845 Sending NodeParams to driver for MAC: 22:04:56:88:65:41
I0730 05:28:23.674540 3845 Enabling GPS…
I0730 05:28:23.674683 3845 Sending NodeParams to driver for MAC: 12:04:56:88:65:41
I0730 05:28:23.674696 3845 Enabling GPS…
E0730 05:28:23.679159 3819 Bad length of driver response, len: 0, expected: 32
E0730 05:28:23.683038 3819 Bad length of driver response, len: 0, expected: 32
I0730 05:28:24.674862 4138 Received request to set prefixes from ctrl-app-TOPOLOGY_APP
I0730 05:28:28.674665 3845 Received SetNodeParams (type GPS)
I0730 05:28:28.674696 3845 Sending NodeParams to driver for MAC: 22:04:56:88:65:41
I0730 05:28:28.674705 3845 Enabling GPS…
I0730 05:28:28.674849 3845 Sending NodeParams to driver for MAC: 12:04:56:88:65:41
I0730 05:28:28.674862 3845 Enabling GPS…
E0730 05:28:28.679332 3819 Bad length of driver response, len: 0, expected: 32
E0730 05:28:28.683231 3819 Bad length of driver response, len: 0, expected: 32
I0730 05:28:33.675326 3845 Received SetNodeParams (type GPS)
I0730 05:28:33.675357 3845 Sending NodeParams to driver for MAC: 22:04:56:88:65:41
I0730 05:28:33.675366 3845 Enabling GPS…
I0730 05:28:33.675513 3845 Sending NodeParams to driver for MAC: 12:04:56:88:65:41
I0730 05:28:33.675526 3845 Enabling GPS…
E0730 05:28:33.679957 3819 Bad length of driver response, len: 0, expected: 32
E0730 05:28:33.683830 3819 Bad length of driver response, len: 0, expected: 32
I0730 05:28:38.676379 3845 Received SetNodeParams (type GPS)
I0730 05:28:38.676414 3845 Sending NodeParams to driver for MAC: 22:04:56:88:65:41
I0730 05:28:38.676422 3845 Enabling GPS…
I0730 05:28:38.676569 3845 Sending NodeParams to driver for MAC: 12:04:56:88:65:41
I0730 05:28:38.676578 3845 Enabling GPS…
E0730 05:28:38.681499 3819 Bad length of driver response, len: 0, expected: 32
E0730 05:28:38.685389 3819 Bad length of driver response, len: 0, expected: 32
I0730 05:28:39.675781 4138 Received request to set prefixes from ctrl-app-TOPOLOGY_APP
I0730 05:28:43.677641 3845 Received SetNodeParams (type GPS)
I0730 05:28:43.677666 3845 Sending NodeParams to driver for MAC: 22:04:56:88:65:41
I0730 05:28:43.677675 3845 Enabling GPS…
I0730 05:28:43.677816 3845 Sending NodeParams to driver for MAC: 12:04:56:88:65:41
I0730 05:28:43.677829 3845 Enabling GPS…
E0730 05:28:43.682312 3819 Bad length of driver response, len: 0, expected: 32
E0730 05:28:43.686188 3819 Bad length of driver response, len: 0, expected: 32
I0730 05:28:48.679805 3845 Received SetNodeParams (type GPS)
I0730 05:28:48.679836 3845 Sending NodeParams to driver for MAC: 22:04:56:88:65:41
I0730 05:28:48.679844 3845 Enabling GPS…
I0730 05:28:48.679993 3845 Sending NodeParams to driver for MAC: 12:04:56:88:65:41
I0730 05:28:48.680006 3845 Enabling GPS…
E0730 05:28:48.684497 3819 Bad length of driver response, len: 0, expected: 32
E0730 05:28:48.688374 3819 Bad length of driver response, len: 0, expected: 32
I0730 05:28:53.224334 4138 Received request for routing adjacencies from ctrl-app-TOPOLOGY_APP
I0730 05:28:53.680271 3845 Received SetNodeParams (type GPS)
I0730 05:28:53.680303 3845 Sending NodeParams to driver for MAC: 22:04:56:88:65:41
I0730 05:28:53.680311 3845 Enabling GPS…
I0730 05:28:53.680460 3845 Sending NodeParams to driver for MAC: 12:04:56:88:65:41
I0730 05:28:53.680473 3845 Enabling GPS…
E0730 05:28:53.684962 3819 Bad length of driver response, len: 0, expected: 32
E0730 05:28:53.688836 3819 Bad length of driver response, len: 0, expected: 32
I0730 05:28:53.946185 4138 Advertising ttl update (key, version, originatorId, ttlVersion) (e2e-network-allocations, 3, node-00.04.56.88.65.41-minion, 194)
I0730 05:28:53.947032 4138 Scheduling ttl timer after 75000ms.
I0730 05:28:54.676705 4138 Received request to set prefixes from ctrl-app-TOPOLOGY_APP
I0730 05:28:58.683105 3845 Received SetNodeParams (type GPS)
I0730 05:28:58.683137 3845 Sending NodeParams to driver for MAC: 22:04:56:88:65:41

added notes:

1- the CN is still onboarding and I see:
Waiting for Cloud Sync under onboarding status.

2- I’m using a 30m cat7 to connect the cn v1000 to the PoE injector.

3- I can connect to the v1000 locally and access the webpage.

It is my first External E2E deployment, is there a thing different compared to the onboard E2E in terms of creating a new node and making a new link ? do i need to configure the CN with any configuration manually like the PoP ?

Regards

Atheer · September 11, 2023, 9:53pm

I have managed to create a link between one of the PoPs and the CN, however the cn is still onboarding and not online !!

based on some suggestions I have enabled the Auto Manage Routes option.

notice that cn1 is still onboarding and it has an active link with dn01 at the same time:

DaveClelland · September 12, 2023, 1:44pm

Atheer,
The only device you onnboard into cnMaestro is the E2E controller. If you are using the onboard E2E, the POP will be configured, and be online, then when the E2E onbards, the POP will show up also. If you are using external E2E, then onboard the E2E to cnMaestro. Then add a site, and node for the POP under the E2E in cnMaestro, and you need to manually configure the POP to communicate with the E2E. When the POP and E2E are communicating, the POP will come online in cnMaestro. Any additional sites, nodes and links you create are done in cnMaestro only, and will be added to the E2E network as they come online. As for routing, the UL route from DN’s or CN’s is from the fd00:ceed:: (if you’ve left the IPv6 addressing default) subnet to the IPv6 address of the POP interface (which by default is on the fd00:ba5e:: /48 or /56 subnet). On most networks, auto route, and auto IPv6 assignment looks after this.

Your links are alive, which means the DN and CN are communicating, but I’d just delete both these entries from the onbarding list.