bigtop icon indicating copy to clipboard operation
bigtop copied to clipboard

BIGTOP-4055. Add Spark History Server Smoke Test

Open vivostar opened this issue 1 year ago • 0 comments

Description of PR

Add Spark History Server Smoke Test

How was this patch tested?

We can use docker-hadoop.sh to test it

  1. modify the config_centos-7.yaml as following example
docker:
        memory_limit: "4g"
        image: "bigtop/puppet:trunk-centos-7"

repo: "http://repos.bigtop.apache.org/releases/3.2.1/centos/7/$basearch"
distro: centos
components: [hdfs, yarn, mapreduce, spark]
enable_local_repo: false
smoke_test_components: [hdfs, yarn, mapreduce]
  1. create hadoop cluster
./docker-hadoop.sh -dcp -c 3
  1. smoke test spark
./docker-hadoop.sh -dcp -s spark

I have tested it on centos-7 and debian-11

For code changes:

  • [x] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'BIGTOP-3638. Your PR title ...')?
  • [x] Make sure that newly added files do not have any licensing issues. When in doubt refer to https://www.apache.org/licenses/

vivostar avatar Dec 24 '23 07:12 vivostar