Example notebook images have incompatible kfp sdk

[ca-scribner]

As filed in kubeflow/kubeflow#6327, the notebook images included by default have kfp==1.6.3 which is incompatible with our deployed kfp-api. This leads to errors that look like authentication problems, but are really version mismatches.

[ca-scribner]

cc @DomFleischmann @Barteus

[DomFleischmann]

I think we should consider building our own images to fix this.

[Barteus]

As a temporary workaround, we can suggest using this line at the start of notebooks. As I recall some time ago this was in many of KFP tutorials and notebooks.

!pip install kfp --upgrade -q

[ca-scribner]

I think with the 1.6 release this should no longer be an issue. We can reopen if it comes back up