SPARKNLP Introducing LLAMA 3

[prabod]

This PR Integrates LLAMA 3 family models into SparkNLP

Description

The Llama 3 release introduces a new family of pretrained and fine-tuned LLMs, ranging in scale from 8B to 70B parameters. Llama 3 models are designed with enhanced efficiency, performance, and safety, making them more capable than previous versions. These models are trained on a more diverse and expansive dataset, offering improved contextual understanding and generation quality.

The fine-tuned models, known as Llama 3-instruct, are optimized for dialogue applications using an advanced version of Reinforcement Learning from Human Feedback (RLHF). Llama 3-instruct models demonstrate superior performance across multiple benchmarks, outperforming Llama 2 and even matching or exceeding the capabilities of some closed-source models.

Types of changes

• [x] New feature (non-breaking change which adds functionality)

Checklist:

• [x] My code follows the code style of this project.
• [x] My change requires a change to the documentation.
• [x] I have updated the documentation accordingly.
• [x] I have read the CONTRIBUTING page.
• [x] I have added tests to cover my changes.
• [x] All new and existing tests passed.