NeMo icon indicating copy to clipboard operation
NeMo copied to clipboard

Published 20 hours ago • verified publisher icon NVIDIA

adapter tuning for Megatron GPT models

Open arendu opened this issue 2 years ago • 1 comments

What does this PR do ?

Add a one line overview of what this PR aims to accomplish.

Collection: [Note which collection this PR will affect]

Changelog

  • Add specific line by line info of high level changes in this PR.

Usage

  • You can potentially add a usage example below
# Add a code snippet demonstrating how to use this

Before your PR is "Ready for review"

Pre checks:

  • [ ] Make sure you read and followed Contributor guidelines
  • [ ] Did you write any new necessary tests?
  • [ ] Did you add or update any necessary documentation?
  • [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
    • [ ] Reviewer: Does the PR have correct import guards for all optional libraries?

PR Type:

  • [ ] New Feature
  • [ ] Bugfix
  • [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.

Who can review?

Anyone in the community is free to review the PR once the checks have passed. Contributor guidelines contains specific people who can review PRs to various areas.

Additional Information

  • Related to # (issue)

arendu avatar Aug 10 '22 05:08 arendu

This pull request introduces 4 alerts when merging 3629f6abcfb74e820a304782d0c4929e4141017c into f921ebe0436e55f7547b183ca83a623f6678422d - view on LGTM.com

new alerts:

  • 3 for Unused import
  • 1 for Unreachable code

lgtm-com[bot] avatar Aug 10 '22 05:08 lgtm-com[bot]

This pull request introduces 4 alerts when merging 2a56940a8ac01caee5bd90e1096f104929297cb7 into f921ebe0436e55f7547b183ca83a623f6678422d - view on LGTM.com

new alerts:

  • 3 for Unused import
  • 1 for Unreachable code

lgtm-com[bot] avatar Aug 10 '22 18:08 lgtm-com[bot]

This pull request introduces 4 alerts when merging de9f7abf10ad49a41dfafab106372fbe28c2d83a into 66c7677cd4a68d78965d4905dd1febbf5385dff3 - view on LGTM.com

new alerts:

  • 3 for Unused import
  • 1 for Unreachable code

lgtm-com[bot] avatar Aug 10 '22 23:08 lgtm-com[bot]

This pull request introduces 4 alerts when merging 44f988668597a2d6b47b1329c004676f0f88e7f0 into 4cd9b3449cbfedc671348fbabbe8e3a55fbd659d - view on LGTM.com

new alerts:

  • 3 for Unused import
  • 1 for Unreachable code

lgtm-com[bot] avatar Aug 11 '22 19:08 lgtm-com[bot]

This pull request introduces 4 alerts when merging 14008e885d4cc179e9fd566a542634cf5d66d4f9 into 4cd9b3449cbfedc671348fbabbe8e3a55fbd659d - view on LGTM.com

new alerts:

  • 3 for Unused import
  • 1 for Unreachable code

lgtm-com[bot] avatar Aug 12 '22 07:08 lgtm-com[bot]

This pull request introduces 4 alerts when merging b53604abbeb773f4d9e3605d0fe6b82dfba2952e into f8ca550967a83473aa2c20267690ac59c4fb640f - view on LGTM.com

new alerts:

  • 3 for Unused import
  • 1 for Unreachable code

lgtm-com[bot] avatar Aug 15 '22 16:08 lgtm-com[bot]

This pull request introduces 4 alerts when merging 56af30f11f3d1c06d1a5a4228243abbaaf3f84ed into 06ad865454e8007836659d26a99f4ce4c2e2905c - view on LGTM.com

new alerts:

  • 3 for Unused import
  • 1 for Unreachable code

lgtm-com[bot] avatar Aug 16 '22 19:08 lgtm-com[bot]

This pull request introduces 7 alerts when merging 95643fc2234bab03451382b834a0827c1e0e866d into 4bf54b715b1ba8832ec3beedcb6983acf55ff096 - view on LGTM.com

new alerts:

  • 5 for Unused import
  • 1 for Unused local variable
  • 1 for Unreachable code

lgtm-com[bot] avatar Aug 17 '22 20:08 lgtm-com[bot]

This pull request introduces 7 alerts when merging 3754d94d38371207b58668565ff7b11cf6310f54 into 8845addc6562f2df3740c95ee496a26849b526d0 - view on LGTM.com

new alerts:

  • 5 for Unused import
  • 1 for Unused local variable
  • 1 for Unreachable code

lgtm-com[bot] avatar Aug 18 '22 05:08 lgtm-com[bot]

This pull request introduces 7 alerts when merging fbce7c56b09a927d7af9b8b659009390b7667faa into 8845addc6562f2df3740c95ee496a26849b526d0 - view on LGTM.com

new alerts:

  • 5 for Unused import
  • 1 for Unused local variable
  • 1 for Unreachable code

lgtm-com[bot] avatar Aug 18 '22 16:08 lgtm-com[bot]

This pull request introduces 7 alerts when merging 728772d78756a8065224f569f6ede7bc6ea659bb into 6abfbbfda654f44313068b950edb0f70b01449b1 - view on LGTM.com

new alerts:

  • 5 for Unused import
  • 1 for Unused local variable
  • 1 for Unreachable code

lgtm-com[bot] avatar Aug 18 '22 21:08 lgtm-com[bot]

This pull request introduces 3 alerts when merging 819782f58879c4a59f42113ec517df5e8ed176d4 into 6127d79dfa42ba8a2f0f70dab42372d20d353b33 - view on LGTM.com

new alerts:

  • 2 for Unused import
  • 1 for Unused local variable

lgtm-com[bot] avatar Aug 19 '22 21:08 lgtm-com[bot]

This pull request introduces 3 alerts when merging 0dbcba33542e118a912b9065fddea6a35c9ed92e into 6127d79dfa42ba8a2f0f70dab42372d20d353b33 - view on LGTM.com

new alerts:

  • 2 for Unused import
  • 1 for Unused local variable

lgtm-com[bot] avatar Aug 19 '22 22:08 lgtm-com[bot]

This pull request introduces 3 alerts when merging 9ad5d4c6ceda4fecc6e85e3e9b1d99a9bd7d5e7b into 6127d79dfa42ba8a2f0f70dab42372d20d353b33 - view on LGTM.com

new alerts:

  • 2 for Unused import
  • 1 for Unused local variable

lgtm-com[bot] avatar Aug 19 '22 22:08 lgtm-com[bot]

This pull request introduces 6 alerts when merging 03715293091868af05ed9668f1483440b1d18db2 into 6127d79dfa42ba8a2f0f70dab42372d20d353b33 - view on LGTM.com

new alerts:

  • 5 for Unused import
  • 1 for Unused local variable

lgtm-com[bot] avatar Aug 20 '22 00:08 lgtm-com[bot]

This pull request introduces 6 alerts when merging 3a9566db408b430e1c8ed6711e8c48425fecc484 into 6127d79dfa42ba8a2f0f70dab42372d20d353b33 - view on LGTM.com

new alerts:

  • 5 for Unused import
  • 1 for Unused local variable

lgtm-com[bot] avatar Aug 20 '22 01:08 lgtm-com[bot]

This pull request introduces 6 alerts when merging 219b403c76d927ba731000bc1a034ef1dc47013c into 6127d79dfa42ba8a2f0f70dab42372d20d353b33 - view on LGTM.com

new alerts:

  • 5 for Unused import
  • 1 for Unused local variable

lgtm-com[bot] avatar Aug 20 '22 02:08 lgtm-com[bot]

This pull request introduces 6 alerts when merging 29d0f2278ebb5fb1baf75d34df8328f6771b4533 into 3ba267290927b1a2e78d82c7afbc538874c01bcc - view on LGTM.com

new alerts:

  • 5 for Unused import
  • 1 for Unused local variable

lgtm-com[bot] avatar Aug 20 '22 15:08 lgtm-com[bot]

This pull request introduces 6 alerts when merging b50a35d8a313d54b64a6615445ed9f03a149971d into 3ba267290927b1a2e78d82c7afbc538874c01bcc - view on LGTM.com

new alerts:

  • 5 for Unused import
  • 1 for Unused local variable

lgtm-com[bot] avatar Aug 20 '22 16:08 lgtm-com[bot]

This pull request introduces 6 alerts when merging 2a9dd8526de324ef2fb9af0c71e0aa1be685cd0f into 3ba267290927b1a2e78d82c7afbc538874c01bcc - view on LGTM.com

new alerts:

  • 5 for Unused import
  • 1 for Unused local variable

lgtm-com[bot] avatar Aug 22 '22 16:08 lgtm-com[bot]

This pull request introduces 6 alerts when merging b9e8e1a082f8c5227475ca425584958f022cccce into 3ba267290927b1a2e78d82c7afbc538874c01bcc - view on LGTM.com

new alerts:

  • 5 for Unused import
  • 1 for Unused local variable

lgtm-com[bot] avatar Aug 22 '22 18:08 lgtm-com[bot]

This pull request introduces 6 alerts when merging c47069387cf9df23aa8d505b6306d48bc63e2d13 into 3ba267290927b1a2e78d82c7afbc538874c01bcc - view on LGTM.com

new alerts:

  • 5 for Unused import
  • 1 for Unused local variable

lgtm-com[bot] avatar Aug 22 '22 19:08 lgtm-com[bot]

This pull request introduces 6 alerts when merging ebb30830f56e028e6433a7191d7089e84c9df699 into 3ba267290927b1a2e78d82c7afbc538874c01bcc - view on LGTM.com

new alerts:

  • 5 for Unused import
  • 1 for Unused local variable

lgtm-com[bot] avatar Aug 22 '22 20:08 lgtm-com[bot]

This pull request introduces 6 alerts when merging b5da2259986493dce7cd66f1b842c13f1d3b0a0f into 3ba267290927b1a2e78d82c7afbc538874c01bcc - view on LGTM.com

new alerts:

  • 5 for Unused import
  • 1 for Unused local variable

lgtm-com[bot] avatar Aug 22 '22 21:08 lgtm-com[bot]

This pull request introduces 6 alerts when merging 6d4f556a642dde6e805352fc25408909382f9dd5 into 4a1fcc62971de89db283334c0dd4aa112e473cbf - view on LGTM.com

new alerts:

  • 5 for Unused import
  • 1 for Unused local variable

lgtm-com[bot] avatar Aug 22 '22 22:08 lgtm-com[bot]

This pull request introduces 6 alerts when merging 36a3428d7db0518fe9c7cf56b7d8531036ca1c09 into 4a1fcc62971de89db283334c0dd4aa112e473cbf - view on LGTM.com

new alerts:

  • 5 for Unused import
  • 1 for Unused local variable

lgtm-com[bot] avatar Aug 23 '22 00:08 lgtm-com[bot]

This pull request introduces 6 alerts when merging 0007792529160d55c3e01944d7b8cc06ac8055ed into 1d9adcfbe64a3f4866750f14b515ac8dc595c7fa - view on LGTM.com

new alerts:

  • 5 for Unused import
  • 1 for Unused local variable

lgtm-com[bot] avatar Aug 23 '22 20:08 lgtm-com[bot]

This pull request introduces 1 alert when merging 0967382393f964e937b16a51141260c85f1a90f8 into 265f7b17876aef7937cf0fedf7a76885bdc63288 - view on LGTM.com

new alerts:

  • 1 for Unused import

lgtm-com[bot] avatar Aug 23 '22 23:08 lgtm-com[bot]

This pull request introduces 1 alert when merging 172d680065126318c99774a05d8006abf3dcba20 into 265f7b17876aef7937cf0fedf7a76885bdc63288 - view on LGTM.com

new alerts:

  • 1 for Unused import

lgtm-com[bot] avatar Aug 24 '22 17:08 lgtm-com[bot]

This pull request introduces 1 alert when merging 8f7316ca486e44930460db592fbed8eef0d64f8e into af7bea421cd61d0e90f24f4c7d132ae35077a374 - view on LGTM.com

new alerts:

  • 1 for Unused import

lgtm-com[bot] avatar Aug 24 '22 21:08 lgtm-com[bot]