modernisation-platform [SPIKE] Visualise network traffic flows

User Story

As a Modernisation Platform customer I want to visualise my traffic flows through a centralised dashboard So that I can understand how my resources are consuming network bandwidth

User Type(s)

Modernisation Platform Customer Modernisation Platform Engineer

Value

On a recent call around the CCMS-EBS migration, questions were raised around how instances were consuming bandwidth. We log network traffic through AWS VPC Flow Logs but do not have an easy way of interrogating them to retrieve aggregated figures; our use case has historically been to confirm if flows have been successful, or if they have been blocked by security groups.

It is possible to review these flow logs to give us information on bandwidth consumed by an instance in a certain time window, or even to show us how much bandwidth is in use to or from certain endpoints. AWS have an example architecture published here which could be adapted by us into Terraform, or another option that uses AWS OpenSearch.

This would then allow us, or potentially our customers, to review flow log information in a more granular fashion than a simple CloudWatch metric like NetworkIn or NetworkOut.

Is this a useful starting point - https://g-9d213fbc19.grafana-workspace.eu-west-2.amazonaws.com/d/JQYqhgXSk/core-vpc?orgId=1&from=1723705276457&to=1723726876458