raven icon indicating copy to clipboard operation
raven copied to clipboard

[UNDER-DISCUSSION] RAVEN Workshop July 2022

Open wangcj05 opened this issue 2 years ago • 3 comments


Under Discussion Topic

Summary of the topic to be discussed with the development team A clear and concise description of the topic to be discusses

Describe the solution you'd like to be implemented A clear and concise description of what you want to happen.

Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.


For Change Control Board: Issue Review

This review should occur before any development is performed as a response to this issue.

  • [ ] 1. Is it tagged with the under_discussion type?
  • [ ] 2. If implemented, it will add a new requirement?
  • [ ] 3. Is a rationale provided? (Such as explaining why the improvement is needed )

For Change Control Board: Issue Closure

This review should occur when the issue is imminently going to be closed.

  • [ ] 1. The discussion determined the addition of a new task issue?

wangcj05 avatar Jul 25 '22 22:07 wangcj05

There is a discrepancy in GA documentation. The beginning of the GAParams section shows that swapMutator is an available option for mutation type:

image

If you scroll down to the next page where we typically have the node information it does not show up as a possibility:

image

dylanjm avatar Jul 26 '22 21:07 dylanjm

Problems that are found by @joshua-cogliati-inl:

Problems with install in workshop:

    Not finding python in when running ./scripts/establish_conda_env.sh --install
Sometimes establish conda would error when trying to find python.  One solution was to run
conda activate base
before running establish conda install.
before running establish conda.

One person had two miniconda's and had an error when trying to activate because the environment was defined in the other miniconda. (Hint, if you want to run in the raven environment, run:

source ./scripts/establish_conda_env.sh --load
)

Several people did not have a compiler installed in windows.

Unless we eliminate that need (either with a pure python crow or with a pre-compiled raven pip wheel) we should emphasis the need to have that installed first. Note that Microsoft C++ Build Tools might be easier to install compared to Microsoft Visual Studio: https://visualstudio.microsoft.com/visual-cpp-build-tools/ (Note that installing both Microsoft Visual Studio and the Build Tools might not work.)

Others

In our windows install instructions, we recommend that people install Git and Conda with set environment parameters so they are always in the path, but that seemed to have caused one user's cmd to fail to work. Possibly we should stop recommending that. (Side note, we should try and install on as clean a computer as possible in windows before a workshop to try and find out these problems.)

wangcj05 avatar Jul 27 '22 16:07 wangcj05

Questions

  1. Difference between RAVEN and Dakota

Issues

  • [ ] 1. Add a figure about projectile model, and add some descriptions about the projectile model
  • [ ] 2. Split hands-on tests into basic users and advanced users
  • [ ] 3. Multi-collinearity identified in projectile model, better explaining why there is multi-collinearity in the sensitivity calculations.
  • [ ] 4. Suggest to compute covariance, correlation, variance dependent sensitivity
  • [ ] 5. The sensitivity calculated by MC and Grid are different, add explanation for that.
  • [ ] 6. Error on Grid sampler, see PR #1915
  • [ ] 7. Better explanation about HistorySetSync postprocessor in the user manual
  • [ ] 8. Extend cross validation to dump the best pickled rom, and plot the validation process, may also dump the training and test data.
  • [ ] 9. Switch to user RAVEN plot system to plot ARMA results, instead of script
  • [ ] 10. Show plots for Fourier decomposition for Ex. 2 of ARMA
  • [ ] 11. Explain the naming in RAVEN (Entities names, user given names, etc.)
  • [ ] 12. Update type used in Optimizer in MultiStep
  • [ ] 13. Update "Constrain" to "Constraint" both in manual and code
  • [ ] 14. GA, change "SwapMutation" to "SwapMutator" in the manual
  • [ ] 15. Disable profile="job" in the hand on tests
  • [ ] 16. Better error handling for withReplacement when the Len of data is less than range of distribution provided range
  • [ ] 17. when obj variable is not defined, the External model crashed, a better error handling there.

Improvement

wangcj05 avatar Jul 28 '22 22:07 wangcj05