referentiel-evaluation-dsrc

referentiel-evaluation-dsrc copied to clipboard

Update sections to make a clearer split between data scientist activities vs. org/processes

1

So far the 6 sections follow roughly the data scientist activities: data, bias/modeling, evaluation, usage in production. However that is not that clear, as: - section 2 and 3 cover...

bowni

Improvements and additions to modelisation and evaluation elements

1

List of topics to study to improve/complement the existing eval elements and answer items: [ME] Modélisation, éval de perf. ME1- Qualité de l’apprentissage : limiter l’overfitting, l’évaluer ME2- Si biais...

bowni

List of topics to study to improve/complement the existing eval elements and answer items: [GCI] Gouvernance des projets, carte d’identité des modèles GCI1- Spécifications/Objectifs du modèle ou système d’IA :...

bowni

List of topics to study to improve/complement the existing eval elements and answer items: [U] Usages en production U1- Si usage en production, quelle procédure de validation pour passage en...

bowni

When only one answer possible, do not inform about possibility on other items

1

Exemple : Question 2.5 Nous ne traitons pas de thématique ou ne portons pas de projet correspondant à des cas de figure avec des risques de discrimination à l'encontre de...

ClementMayer

- [Intro into AI ethics by kaggle](https://www.kaggle.com/learn/intro-to-ai-ethics) - [LearnQuest: Ethics in the age of AI ](https://www.coursera.org/specializations/ethics-in-ai#courses) - [LearnQuest: Artificial Intelligence Ethics in Action](https://www.coursera.org/learn/ai-ethics-analysis?specialization=ethics-in-ai#syllabus) - [University of Michigan course: Data Science...

HeytemBou

- https://www.coursera.org/learn/data-science-ethics#syllabus - https://www.coursera.org/specializations/ethics-in-ai#courses - https://courses.openmined.org - https://training.linuxfoundation.org/resources/free-courses/ethics-in-ai-and-big-data

bowni

Check UNESCO AI ethics principles

1

See [this link](https://en.unesco.org/artificial-intelligence/ethics) for the general initiative and [this link for the draft document](https://unesdoc.unesco.org/ark:/48223/pf0000373434_fre)

bowni

Etudier la possibilité de réaliser une évaluation au niveau d'un projet ? d'un produit ?

1

Nous avions eu la remarque lors de l'atelier n°1 et la question est revenue : est-il possible de pouvoir appliquer le référentiel au niveau du projet et non d'une organisation...

ClementMayer

Reorganise sections and elements

1

Reorganise sections and elements to provide a clearer structure (addresses #148)

bowni