Library for ORT execution

[ChSonnabend]

Adding a library for the execution of ONNX models with GPU execution provider and float16 datatype (OrtDataType::Float16_t -> a wrapper around a uint16_t)

[ChSonnabend]

Ping @davidrohr

[github-actions[bot]]

REQUEST FOR PRODUCTION RELEASES: To request your PR to be included in production software, please add the corresponding labels called "async-" to your PR. Add the labels directly (if you have the permissions) or add a comment of the form (note that labels are separated by a ",")

+async-label <label1>, <label2>, !<label3> ...

This will add <label1> and <label2> and removes <label3>.

The following labels are available async-2023-pbpb-apass3 async-2023-pbpb-apass4 async-2023-pp-apass4 async-2024-pp-apass1 async-2022-pp-apass7 async-2024-pp-cpass0

[davidrohr]

Ideally, we should not have merge commits. Can you rebase without merge commits. Also, you should squash cleanups. If you don't intend to keep the history, please ignore, then we'll just squash-merge.

[ChSonnabend]

Ideally, we should not have merge commits. Can you rebase without merge commits. Also, you should squash cleanups. If you don't intend to keep the history, please ignore, then we'll just squash-merge.

I won't need the history afterwards. For now I'm just pushing the recent changes into this branch. I will also soon add the code in the actual clusterization code (although I might open a separate PR for that)

[github-actions[bot]]

This PR did not have any update in the last 30 days. Is it still needed? Unless further action in will be closed in 5 days.