moonshot

moonshot copied to clipboard

When we run benchmarks on the same endpoint repeatedly in the same runner, the results will be cached. All the tests will receive the same score since they are cached....

imda-lseokmin

When the response is in Chinese, CLI version does not print out the entire response. See screenshot below:  ### Produce Issue 1. Create a new red team session 2....

imda-lseokmin

## Description As categories and tags has been added to the property of cookbook, there requires a change in the schema of the cookbook. This PR changes the schema of...

imda-normanchia

## Description As a dev, I want to test my RAG application on its capability so that I can evaluate how well it performs. Acceptance Criteria Implementation of the following...

imda-lionelteo

## Description Bug is causing view_bookmark not to show an existing bookmark ## Motivation and Context Bug fix ## Type of Change A bug fix ## How to Test 1....

imda-kelvinkok

## Description There were remnants of attack module codes in view_cookbook that caused an error while viewing cookbooks. ## Motivation and Context Bug fix ## Type of Change A bug...

imda-kelvinkok

[MS-427] Add persistent volume to data

1

## Description Currently, when EKS instance crashes, all endpoints gets deleted and/or resetting to default settings and benchmark runs and sessions gets deleted. ## Motivation and Context Currently, when EKS...

imda-lionelteo

## Description Updated FAQ with suggested solution for utf-8 charmap problem for Windows ## Motivation and Context Update FAQ ## Type of Change Documentation updates ## How to Test ##...

imda-kelvinkok

## Description Add unit tests to connectors-endpoints and connectors. This PR will cover changes in MS-632. ## Motivation and Context Add unit tests 1. test_connector_endpoint_arguments.py 2. test_connector_endpoint.py 3. test_connector_prompt_arguments.py 4....

imda-lionelteo

## Description Update retrying mechanism and making user experience better ## Motivation and Context While doing the unit tests for the connector endpoints, there are some key, values that are...

imda-lionelteo