toc icon indicating copy to clipboard operation
toc copied to clipboard

[Initiative]: TOC AI Cloud-Native Standards Checklist

Open joshhalley opened this issue 6 months ago • 2 comments

Name

Kubernetes Agentic Standards Checklist Creation

Short description

Creation of a best practice recommendation checklist for Agentic AI micro-services

Responsible group

TOC

Does the initiative belong to a subproject?

Yes

Subproject name

Kubernetes Agentic Standards Checklist

Primary contact

joshhalley

Additional contacts

Nina Polshakova

Initiative description

The objective of this initiative is to provide a concise checklist in under 10 pages associated with best practices which have been learned around the deployment and creation of micro-services in the domain of AI Agentic containers.

Key topics are based of the pre-work that the team pursued in the below working document:

working document

Deliverable(s) or exit criteria

The objective is to create concise and easy to understand checklist covering the topics described in the Document Link that can support individuals and teams that are developing agents to consider important topics, in domains of security and observability.

The objective from the team is to have the document concluded by the end of July 2025.

joshhalley avatar Jun 10 '25 01:06 joshhalley

This reads a bit like a talk proposal 😄 could be a great blog too!

leonardpahlke avatar Jun 19 '25 22:06 leonardpahlke

+1 @leonardpahlke -- looks like it could also be a short, concise Initiative that the TOC is looking for (versus the longer whitepapers)

okay to open vote @riaankleinhans

angellk avatar Jun 24 '25 04:06 angellk

This initiative has been approved by the TOC and is ready to be worked on with the appropriate TAG and TOC liaison.

riaankleinhans avatar Jul 07 '25 15:07 riaankleinhans

Kubernetes Agentic AI Standards:

Document Link: https://docs.google.com/document/d/1pH7b2IKNg6lDcHNHZJoDdWNoe8jvp3Kd0Aoy7vTdAOA/edit?tab=t.0

Attendees: Deep Patel Claudia Misale Victor Lu

cc: Ricardo Aravena Nina Polshakova Vincent Caldeira Nimisha Mehta

Meeting Minutes - Tuesday July the 10th - 08:00 PT:

Hi Team,

please find the minutes from todays session:

  • Overview was shared for the format of the document

    • Max 10 pages - short abstract followed by checklist
  • Described how supporting or reference documentation associated with checklist should be handled

    • Links for these documents to be included at the bottom of each sections checklist
  • How do we handle disclaimers for fair use, to indicate that this document does not mean that users are not at risk of security breach etc...

    • Disclaimer can be included in document, however there is an expectation that something exists already (boilerplate) from the CNCF
  • Deep volunteered to support Vincent on Governance section

    • Deep to reach out to Vincent
  • Victor indicated that a section on trust is missing and should be added

    • Added to the governance section of the document
  • Topic of up and coming / future research was discussed

    • For future topics, limited abstracts can be added at the end of each section, however given the pace of change in this domain, it is expected that change revision is high
  • Meeting Schedule Tue / Thu at 08:00 AM Pacific

    • Josh to reach out to Riaan to make the meeting series less restrictive and get the Tuesday slot on the schedule

In case any topics were missed or misrepresented let me know.

Kind Regards,

Josh

joshhalley avatar Jul 10 '25 16:07 joshhalley

Kubernetes Agentic AI Standards:

Document Link: https://docs.google.com/document/d/1pH7b2IKNg6lDcHNHZJoDdWNoe8jvp3Kd0Aoy7vTdAOA/edit?tab=t.0

Attendees: Nimisha Mehta Claudia Misale Victor Lu Nina Polshkova

cc: Ricardo Aravena Deep Patel Vincent Caldeira

Meeting Minutes - Tuesday July the 15th - 08:00 PT:

Hi Team,

please find the minutes from the session:

  • Discussed the General section, indicating that it should set the stage and cross reference other links to avoid base jumping into content which is too heavy
  • Low Level Hardware topics (i.e. Metrics for NVIDIA vs AMD etc...) will be called out as out of scope, as this domain is quite exhausive and goes well beyond agents
  • Various topics converge across domains in terms of trust and security (such as accounting for audit trails, arguably could also be a observability metric), team agreed should work with the current format and we can always reshuffle the final to make it more readable

Target delivery remains end of July

Meeting Schedule Tue / Thu at 08:00 AM Pacific, until the end of the month

In case any topics were missed or misrepresented let me know.

Kind Regards,

Josh

joshhalley avatar Jul 16 '25 15:07 joshhalley

Kubernetes Agentic AI Standards:

Document Link: https://docs.google.com/document/d/1pH7b2IKNg6lDcHNHZJoDdWNoe8jvp3Kd0Aoy7vTdAOA/edit?tab=t.0

Attendees: Nimisha Mehta Victor Lu Vincent Caldeira

cc: Ricardo Aravena Deep Patel Claudia Misale Nina Polshkova

Meeting Minutes - Thursday July the 17th - 08:00 PT:

Hi Team,

Thanks to those of you who were able to make the meeting yesterday.

Please find the topics discussed

Team agreed with the current format, with the understanding that during final review certain points will reshuffle to make a more consistent flow and narative.

Discussed the General section: - Given the main topics, security, observability, governance and communications, the team discussed headlining the checkboxes to make things stand out more clearly (Nimisha to discuss with Nina) Control Communications Section: - Since there is heavy churn in this domain at the moment, reference material (footnotes) is needed to highlight the different solutions that are in play today - In scenarios where there are undecided standards, calling out the topic themselves for consideration may sometimes be the most prudent approach Observability: - Section has been split into metrics, traces, spans and logs to simplify messaging Governance: - Plenty of content is present, this collateral needs to be narrowed down to be more concise to support in fitting within our page limit - Vincent and Deep to align on the current format and content to ensure that they have a common view Security: - A lot of collateral present in this space Victor and Nina to align on content

Target delivery remains end of July

Meetings scheduled Tue / Thu at 08:00 AM Pacific, until the end of the month

In case any topics were missed or misrepresented let me know.

Kind Regards,

Josh

joshhalley avatar Jul 18 '25 05:07 joshhalley

Kubernetes Agentic AI Standards:

Document Link: https://docs.google.com/document/d/1pH7b2IKNg6lDcHNHZJoDdWNoe8jvp3Kd0Aoy7vTdAOA/edit?tab=t.0

Attendees:

Victor Lu Nina Polshkova Josh Halley

cc: Ricardo Aravena Deep Patel Claudia Misale Nimisha Mehta Vincent Caldeira

Meeting Minutes - Tuesday July the 22nd - 08:00 PT:

Hi Team,

Thanks to those of you who were able to make the meeting today.

Please find the topics discussed in todays session:

Ongoing efforts are underway to refine different domains, with the understanding that there may be a level of overlap and excess material which needs to be reduced eventually.

Discussed the General section:

  • General section is being cleaned up and further reference material being added. Victor indicated that there may be a need to set the stage more in this section to ensure that the expectations are properly described and clear.

Control Communications Section:

  • Further additions have been added into this section, further updates are still needed. Given the protocol sprawl at the moment, a limited subset will be described, with reference material to other items.

Observability:

  • Section has been split into metrics, traces, spans and logs to simplify messaging - further updates are still needed here.

Governance:

  • Plenty of content is present, this collateral needs to be narrowed down to be more concise to support in fitting within our page limit

Security:

  • Some of the sections have been updated, Victor and Nina continue to work on this section being consolidated.

Target delivery remains end of July

Meetings scheduled Tue / Thu at 08:00 AM Pacific, until the end of the month

In case any topics were missed or misrepresented let me know.

Kind Regards,

Josh

joshhalley avatar Jul 22 '25 17:07 joshhalley

cc: @raravena80

Hi All,

the team have concluded their work on the checklist and are ready for proceed with the next steps towards publishing.

The final collateral can be found in the Final Document tab in the link below:

Final Version

This document was authored jointly by the following contributors:

Document Leads: Josh Halley Nina Polshakova

Section Contributors:

General: Nina Polshakova / Nimisha Mehta Communication: Josh Halley / Nimisha Mehta Observability: Josh Halley / Claudia Misale Security: Nina Polshakova / Victor Lu Governance: Vincent Caldeira / Deep Patel

@riaankleinhans @angellk would you be so kind as to support the documents transition towards publishing.

Please advise if there are any follow on steps needed from our side.

joshhalley avatar Aug 05 '25 03:08 joshhalley

/vote

riaankleinhans avatar Aug 14 '25 13:08 riaankleinhans

Vote created

@riaankleinhans has called for a vote on [Initiative]: TOC AI Cloud-Native Standards Checklist (#1749).

The members of the following teams have binding votes:

Team
@cncf/cncf-toc-voters

Non-binding votes are also appreciated as a sign of support!

How to vote

You can cast your vote by reacting to this comment. The following reactions are supported:

In favor Against Abstain
👍 👎 👀

Please note that voting for multiple options is not allowed and those votes won't be counted.

The vote will be open for 5months 29days 19h 12m. It will pass if at least 66% of the users with binding votes vote In favor 👍. Once it's closed, results will be published here as a new comment.

git-vote[bot] avatar Aug 14 '25 13:08 git-vote[bot]

/check-vote

riaankleinhans avatar Aug 18 '25 14:08 riaankleinhans

Vote status

So far 36.36% of the users with binding vote are in favor and 0.00% are against (passing threshold: 66%).

Summary

In favor Against Abstain Not voted
4 0 0 7

Binding votes (4)

User Vote Timestamp
angellk In favor 2025-08-14 13:47:49.0 +00:00:00
jeremyrickard In favor 2025-08-15 18:32:12.0 +00:00:00
kevin-wangzefeng In favor 2025-08-18 0:20:16.0 +00:00:00
kfaseela In favor 2025-08-15 18:51:36.0 +00:00:00
@dims Pending
@rochaporto Pending
@linsun Pending
@chadbeaudin Pending
@chira001 Pending
@TheFoxAtWork Pending
@kgamanji Pending

git-vote[bot] avatar Aug 18 '25 14:08 git-vote[bot]

Vote closed

The vote passed! 🎉

72.73% of the users with binding vote were in favor and 0.00% were against (passing threshold: 66%).

Summary

In favor Against Abstain Not voted
8 0 0 3

Binding votes (8)

User Vote Timestamp
@TheFoxAtWork In favor 2025-08-18 22:25:06.0 +00:00:00
@angellk In favor 2025-08-14 13:47:49.0 +00:00:00
@chadbeaudin In favor 2025-08-22 14:42:19.0 +00:00:00
@chira001 In favor 2025-08-19 10:47:30.0 +00:00:00
@dims In favor 2025-08-18 15:55:56.0 +00:00:00
@jeremyrickard In favor 2025-08-15 18:32:12.0 +00:00:00
@kevin-wangzefeng In favor 2025-08-18 0:20:16.0 +00:00:00
@kfaseela In favor 2025-08-15 18:51:36.0 +00:00:00

git-vote[bot] avatar Aug 23 '25 08:08 git-vote[bot]