Feat: Add sharegpt multirole

[NanoCode012]

See below for update: https://github.com/OpenAccess-AI-Collective/axolotl/pull/1137#issuecomment-1959436662

---

Description: Allow multiple roles for input and output.

NOTE: Beta and hardcoded values for now!

How to use:

- type: sharegpt
+ type: sharegpt.load_multirole

Only supports conversation: (chatml|zephyr)

[NanoCode012]

Rebased! For those using this branch earlier, you will need to delete and repull due to rebase.

Breaking change: We do not need the type: sharegpt.load_multirole anymore!

How to use:

datasets:
  - path:
    type: sharegpt
    conversation: chatml
    roles:
      input: ['human', 'funcresponse', ...]
      output: ['gpt', 'tool_caller', ...]

Same as above, only chatml and zephyr role supported, but it's easy to add more in future!

Edit: Waiting for Pydantic PR to be merged.

[xiechengmude]

Rebased! For those using this branch earlier, you will need to delete and repull due to rebase.

Breaking change: We do not need the type: sharegpt.load_multirole anymore!

How to use:

datasets:
  - path:
    type: sharegpt
    conversation: chatml
    roles:
      input: ['human', 'funcresponse', ...]
      output: ['gpt', 'tool_caller', ...]

Same as above, only chatml and zephyr role supported, but it's easy to add more in future!

Edit: Waiting for Pydantic PR to be merged.

Amazing ! Waiting for the merge processing. Is there any timeline here?