Learn_Prompting icon indicating copy to clipboard operation
Learn_Prompting copied to clipboard

Update ensembling.md

Open wesmare opened this issue 2 years ago • 8 comments

Clarified weak supervision, much more spelled out example

wesmare avatar Feb 17 '23 22:02 wesmare

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated
learn-prompting ✅ Ready (Inspect) Visit Preview 💬 Add your feedback Mar 1, 2023 at 7:20PM (UTC)

vercel[bot] avatar Feb 17 '23 22:02 vercel[bot]



SyntaxError: /vercel/path0/docs/reliability/ensembling.md: Expected corresponding JSX closing tag for <div>. (133:0)
--
19:48:36.558 | 131 \| <div>Question: "What is the capital of France?"</div>
19:48:36.558 | 132 \| <div>Answer: "Paris"</div>

trigaten avatar Feb 18 '23 01:02 trigaten

If pulling SyntaxErrors was cool, I’d be Miles Davis. Will fix and commit.

Get Outlook for iOShttps://aka.ms/o0ukef


From: trigaten @.> Sent: Friday, February 17, 2023 8:15:36 PM To: trigaten/Learn_Prompting @.> Cc: Shields, William (Wes) (LCDR) @.>; Author @.> Subject: Re: [trigaten/Learn_Prompting] Update ensembling.md (PR #316)

NPS WARNING: external sender verify before acting.

SyntaxError: /vercel/path0/docs/reliability/ensembling.md: Expected corresponding JSX closing tag for
. (133:0)

19:48:36.558 | 131 |

Question: "What is the capital of France?"
19:48:36.558 | 132 |
Answer: "Paris"

— Reply to this email directly, view it on GitHubhttps://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Ftrigaten%2FLearn_Prompting%2Fpull%2F316%23issuecomment-1435437649&data=05%7C01%7Cwilliam.shields%40nps.edu%7C7cce2117c1d24589495c08db114da42c%7C6d936231a51740ea9199f7578963378e%7C0%7C0%7C638122797431558904%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=%2Bl1bnbMSfh3dKfyaltRJmuI7wEJZ7%2BEzQnxg1FOKB5Y%3D&reserved=0, or unsubscribehttps://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAQPYDLFEAAKYBYYOFMVACHTWYAPDRANCNFSM6AAAAAAU75IH54&data=05%7C01%7Cwilliam.shields%40nps.edu%7C7cce2117c1d24589495c08db114da42c%7C6d936231a51740ea9199f7578963378e%7C0%7C0%7C638122797431558904%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=yTHzRnm1cMupGkLM%2FIVbTAzjjdEiK1GBhGLfNXUdKV4%3D&reserved=0. You are receiving this because you authored the thread.Message ID: @.***>

wesmare avatar Feb 18 '23 01:02 wesmare

Combines…that’s the one.

Get Outlook for iOShttps://aka.ms/o0ukef


From: trigaten @.> Sent: Saturday, February 18, 2023 11:21:05 AM To: trigaten/Learn_Prompting @.> Cc: Shields, William (Wes) (LCDR) @.>; Author @.> Subject: Re: [trigaten/Learn_Prompting] Update ensembling.md (PR #316)

NPS WARNING: external sender verify before acting.

@trigaten commented on this pull request.


In docs/reliability/ensembling.mdhttps://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Ftrigaten%2FLearn_Prompting%2Fpull%2F316%23discussion_r1111056237&data=05%7C01%7Cwilliam.shields%40nps.edu%7Cc63bfc280ca544ad447d08db11cc22dc%7C6d936231a51740ea9199f7578963378e%7C0%7C0%7C638123340695218910%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=POozf%2Fy3nw7sERzI5gkw9bqPod1WmbRBuZcBZyFN9wc%3D&reserved=0:

@@ -151,49 +151,75 @@ I will not cover here. Read section 3.3 of the paper for more @.***

In the same multi-input style as DiVeRSe prompting, Ask Me Anything (AMA) @.***) is an approach that uses multiple imperfect prompts—rather than one painstakingly crafted prompt.

-The AMA prompting strategy combines the results from the different prompts by utilizing weak supervision to aggregate their output @.***) to get an effective best answer.

+The AMA prompting strategy combinds the results from the multiple different prompts by utilizing weak supervision to aggregate their output @.***) to get an effective best answer.

combines?

— Reply to this email directly, view it on GitHubhttps://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Ftrigaten%2FLearn_Prompting%2Fpull%2F316%23pullrequestreview-1304611534&data=05%7C01%7Cwilliam.shields%40nps.edu%7Cc63bfc280ca544ad447d08db11cc22dc%7C6d936231a51740ea9199f7578963378e%7C0%7C0%7C638123340695218910%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=NjcRgeVBSe%2FHyZdJhgPhJGOjI0ZIXQpGUTFr0YsHejE%3D&reserved=0, or unsubscribehttps://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAQPYDLFZZ3EIMVNZHJ4735LWYDZHDANCNFSM6AAAAAAU75IH54&data=05%7C01%7Cwilliam.shields%40nps.edu%7Cc63bfc280ca544ad447d08db11cc22dc%7C6d936231a51740ea9199f7578963378e%7C0%7C0%7C638123340695218910%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=DhR08cmX9CMhOR%2FIsDkwDadrJyu0Pbw9epR9AMzsHJg%3D&reserved=0. You are receiving this because you authored the thread.Message ID: @.***>

wesmare avatar Feb 18 '23 18:02 wesmare

Removed some confusing language about "Combining" prompt outputs. should be more clear now

wesmare avatar Feb 21 '23 19:02 wesmare

@trigaten let me know if you need/want any other changes to merge and post

wesmare avatar Feb 23 '23 15:02 wesmare

Hey I don't really understand the example. Could you provide more context for it? Why are input and context outside of the prompt? Shouldn't the be included in the `s, but just not be highlighted?

trigaten avatar Feb 23 '23 16:02 trigaten

I don't understand how weak supervision is being used. When you define it as relating to creating large sets of training data, this very much confuses me as I thought it had to do with deciding the final output.

trigaten avatar Feb 23 '23 16:02 trigaten

Im reading the paper and there is a lot more to this method. How much of it did you read?

trigaten avatar Feb 28 '23 18:02 trigaten