nomad icon indicating copy to clipboard operation
nomad copied to clipboard

Please explain how one can able to use Project Calico for CNI in my nomad cluster

Open codesiddhant opened this issue 2 years ago • 3 comments

Reference -> https://www.hashicorp.com/blog/multi-interface-networking-and-cni-plugins-in-nomad-0-12

image

My Problem -> I want to connect all My containers across multiple clients(Nodes) in the nomad cluster. In my current Kubernetes cluster, all pods can communicate to each other based on IP address no matter they are deployed in different machines (worker) using CNI (Calico / Cilium / Funnel, etc).

The same thing I want to achieve in Nomad Cluster not only for docker containers but other plugins also including firecracker, qemu, etc.

What I want -> All Resources (Container, MicroVm, Vms) should be able to communicate with each other based on IP Addresses under the same subnet across the entire cluster| Simply speaking I want SDN Solution in my cluster.

What I am trying to do actually I trying to make my own private cloud that can support multiple types of technology including docker, microVM, LXC/LXD container, and KVM as like Opennebula. with the help of the Nomad cluster.

how will I be able to access instances (VMs) for accessing VMS through (SSH/VNC/RDP) with the help of open-source tool Apache Guacamole but the condition is that every VM should be able to communicate with each other to make Guacd proxy work possible.

What is my expectation I am wondering how will one can use Calico as CNI in the nomad cluster. I searched the entire internet but still didn't find any conclusive.

There is mention of Calico in nomad official documentation (Blog) but I want a more detailed explanation about that.

Please someone help me out with this including all alternative possibilities. Billion thanks in advance :innocent:

codesiddhant avatar Dec 24 '21 10:12 codesiddhant

Hi @codesiddhant and thanks for raising this request. Documenting how to use Calico, as well as other CNI tooling, is something I would love to see. This is made more important as many projects, including Calico, focus their documentation for running on Kubernetes.

jrasell avatar Jan 03 '22 09:01 jrasell

Where does this sit currently?

l-monninger avatar Sep 15 '22 21:09 l-monninger

On calico I have no idea, but for other CNIs there are some users (me among them) with somewhat working or work-in-progress setup of nomad+cilium (see: https://github.com/hashicorp/nomad/issues/12120). I am still polishing things and may make a write up or at least publish a github repo with sample configs, jobs, etc. but not there yet.

pruiz avatar Sep 15 '22 22:09 pruiz