Optimize the Dockerfile

[skiffer-git]

🔍 What type of PR is this?

👀 What this PR does / why we need it:

• [ ] My pull request adheres to the code style of this project
• [ ] My code requires changes to the documentation
• [ ] I have updated the documentation as required
• [ ] All the tests have passed

🅰 Which issue(s) this PR fixes:

Fixes #504

📝 Special notes for your reviewer:

🎯 Describe how to verify it

📑 Additional documentation e.g., RFC, notion, Google docs, usage docs, etc.: