Trials for supporting AOAI endpoint, Phi2

[abgoswam]

trafficstars

Why are these changes needed?

• AML support
• AOAI endpoint
• Phi2 model eval

Related issue number (if applicable)

Checks

• [ ] I've run format.sh to lint the changes in this PR.
• [ ] I've included any doc changes needed.
• [ ] I've made sure the relevant tests are passing (if applicable).