bigtop
bigtop copied to clipboard
BIGTOP-4055. Add Spark History Server Smoke Test
Description of PR
Add Spark History Server Smoke Test
How was this patch tested?
We can use docker-hadoop.sh to test it
- modify the config_centos-7.yaml as following example
docker:
memory_limit: "4g"
image: "bigtop/puppet:trunk-centos-7"
repo: "http://repos.bigtop.apache.org/releases/3.2.1/centos/7/$basearch"
distro: centos
components: [hdfs, yarn, mapreduce, spark]
enable_local_repo: false
smoke_test_components: [hdfs, yarn, mapreduce]
- create hadoop cluster
./docker-hadoop.sh -dcp -c 3
- smoke test spark
./docker-hadoop.sh -dcp -s spark
I have tested it on centos-7 and debian-11
For code changes:
- [x] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'BIGTOP-3638. Your PR title ...')?
- [x] Make sure that newly added files do not have any licensing issues. When in doubt refer to https://www.apache.org/licenses/