cncf
[Initiative]: Cloud Native AI Sustainability Papers
Name
Cloud Native AI & Sustainability
Short description
Two white papers for the AI sustainability
Responsible group
TOC
Does the initiative belong to a subproject?
Yes
Subproject name
Cloud Native AI Working Group
Primary contact
@zanetworker
Additional contacts
@raravena80
Initiative description
Paper 1: The paper aims to provide a framework and recommendations for building and managing AI systems with sustainability in mind, emphasizing resource optimization and reducing the environmental footprint.
Paper 2: The paper discusses the challenges and opportunities for making Generative AI more sustainable in cloud-native systems. It highlights the high energy consumption of AI training and inference, issues like inefficient GPU usage and data management, and proposes strategies for optimization. Key areas of focus include energy tracking, power capping, efficient resource scheduling, and the use of tools like Kepler, Kueue, and KEDA to manage AI workloads more sustainably.
Original issue: https://github.com/cncf/tag-runtime/issues/168
Source: https://docs.google.com/document/d/1tNfR5yxnqfu9fduEb3108oBGXQ6spyRzA6cBTs9zbnQ/edit?tab=t.fwj647zi37u1#heading=h.a2csx0fpflu3
Deliverable(s) or exit criteria
Final draft versions for both papers to be handed off to the CNCF publishing staff.
Background. We broke up the paper into two, originally it was just one.
@zanetworker all papers require TOC review and approval prior to handling off to CNCF staff.
Please break this initiative up into the two separate Papers and outline how many pages are expected then vote can be opened. Shorter initiatives are prioritized first 🙏
We are starting with meetings to review and push these whitepapers to the finish line. Our goal is to start finalizing the first whitepaper here on this Github issue, and then the second on #1918 . Here are the meeting links and calendar for next scheduled calls. Meetings will be recorded and meeting notes will be published.
https://calendar.google.com/calendar/embed?src=c_90d4740d5a131b095d5d07ed639439c32e6b92303d54ddeba1d1f5497880e8eb%40group.calendar.google.com&ctz=Europe%2FBerlin
