scylla-machine-image icon indicating copy to clipboard operation
scylla-machine-image copied to clipboard

cloud-init[387]: 2023-04-29 17:05:45,277 - __init__.py[WARNING]: Unhandled unknown content-type (x-scylla/json) userdata: 'b'{'...'

Open mykaul opened this issue 2 years ago • 4 comments

Saw in a log file:

2023-04-29T17:05:51+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | cloud-init[387]: 2023-04-29 17:05:45,277 - __init__.py[WARNING]: Unhandled unknown content-type (x-scylla/json) userdata: 'b'{'...'
...
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]: 2023-04-29 17:06:23,619 - [user_data] - INFO - Got user-data: Content-Type: multipart/mixed; boundary="===============1212770131587456580=="
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]: MIME-Version: 1.0
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]: --===============1212770131587456580==
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]: Content-Type: x-scylla/json
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]: MIME-Version: 1.0
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]: Content-Disposition: attachment; filename="scylla_machine_image.json"
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]: {
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]:     "cluster_name": "longevity-lwt-3h-2023-1-db-cluster-8f772d9e",
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]:     "data_device": "instance_store",
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]:     "raid_level": 0,
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]:     "scylla_yaml": {
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]:         "cluster_name": "longevity-lwt-3h-2023-1-db-cluster-8f772d9e"
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]:     },
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]:     "start_scylla_on_first_boot": false
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]: }
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]: --===============1212770131587456580==
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]: Content-Type: text/cloud-config
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]: MIME-Version: 1.0
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]: Content-Disposition: attachment; filename="cloud-config.txt"
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]:         #cloud-config
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]:         cloud_final_modules:
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]:         - [scripts-user, always]
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]:         
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]: --===============1212770131587456580==
2023-04-29T17:06:23+00:00 longevity-lwt-3h-2023-1-db-node-8f772d9e-3     !INFO | scylla_post_start.py[904]: Content-Type: text/x-shellscript

Should the Content-Type be json/x-scylla? or application/json ?

mykaul avatar May 11 '23 08:05 mykaul

Yeah, we should do better here.

But I suggest doing it gradually, and with advancing smi_version

fruch avatar May 11 '23 12:05 fruch

@roydahan How is it related to us? it's in SCT,

yaronkaikov avatar Mar 04 '24 18:03 yaronkaikov

I assume it's from https://github.com/scylladb/scylla-cluster-tests/blob/a609915e4a590659835a17058c5b4c3c52f6522a/sdcm/sct_provision/aws/user_data.py#L77

mykaul avatar Mar 05 '24 08:03 mykaul

this is an issue for SMI

https://github.com/scylladb/scylla-machine-image/blob/6e926239e7928906b53026fc0d98f394419f8310/lib/user_data.py#L37

this is o.k. for cloud-init to complain on our own define mime type it probably can be change to something that won't get those errors, but the idea that only our code would read those parts, i.e. other mime types that might be used by cloud-init itself shouldn't be used.

anyhow it's not an issue with SCT

fruch avatar Mar 05 '24 09:03 fruch