BioGPT icon indicating copy to clipboard operation
BioGPT copied to clipboard

Add the link to the QA model to huggingface

Open espoirMur opened this issue 1 year ago • 0 comments

I have converted the QA checkpoint model to a Huggingface model! Please, have a look and test If it works.

The full model is here: https://huggingface.co/espoir/BioGPT-Large-QA-PubMedQA!

Canvas:

The main prompt model was outputting a sequence of words learned1, learned2, ... learned9 before output the answer of the question! I checked this my be due to the way prompt was set up during training.

Before adding the model to huggingface and to make it work I have added 9 extras words to the embedding layers to accommodate the fairseq model weight.

With that below are the difference output of the two models:

FairseqOne:


('Do mitochondria play a role in remodelling lace plant leaves during '
 'programmed cell death? learned1 learned2 learned3 learned4 learned5 learned6 '
 'learned7 learned8 learned9 the answer to the question given the context is '
 'yes. context: Programmed cell death (PCD) is the regulated death of cells '
 'within an organism. The lace plant (Aponogeton madagascariensis) produces '
 'perforations in its leaves through PCD. The leaves of the plant consist of a '
 'latticework of longitudinal and transverse veins enclosing areoles. PCD '
 'occurs in the cells at the center of these areoles and progresses outwards, '
 'stopping approximately five cells from the vasculature. The role of '
 'mitochondria during PCD has been recognized in animals; however, it has been '
 'less studied during PCD in plants. The following paper elucidates the role '
 'of mitochondrial dynamics during developmentally regulated PCD in vivo in A. '
 'madagascariensis. A single areole within a window stage leaf (PCD is '
 'occurring) was divided into three areas based on the progression of PCD; '
 'cells that will not undergo PCD (NPCD), cells in early stages of PCD (EPCD), '
 'and cells in late stages of PCD (LPCD). Window stage leaves were stained '
 'with the mitochondrial dye MitoTracker Red CMXRos and examined. '
 'Mitochondrial dynamics were delineated into four categories (M1-M4) based on '
 'characteristics including distribution, motility, and membrane potential '
 '(ΔΨm). Chloroplasts and transvacuolar strands were also examined using live '
 'cell imaging. Chloroplasts were examined for signs of swelling and [/](https://file+.vscode-resource.vscode-cdn.net/) or '
 'membrane potential loss. A TUNEL assay was performed to detect fragmented '
 'nDNA. Chloroplasts in cells undergoing PCD were also examined using live '
 'cell imaging. The role of mitochondrial permeability transition pore (PTP) '
 'formation during PCD was examined using cyclosporine A (CsA). A single '
 'areole within a window stage leaf (PCD is occurring) was divided into three '
 'areas based on the progression of PCD; cells that will not undergo PCD '
 '(NPCD), cells in early stages of PCD (EPCD), and cells in late stages of PCD '
 '(LPCD). Mitochondrial dynamics were delineated into four categories (M1-M4) '
 'based on characteristics including distribution, motility, and ΔΨm. '
 'Chloroplasts in cells undergoing PCD were also examined using live cell '
 'imaging. Mitochondrial dynamics were characterized into four categories '
 '(M1-M4) based on characteristics including swelling and [/](https://file+.vscode-resource.vscode-cdn.net/) or ΔΨm. '
 'Chloroplasts in cells undergoing PCD were also examined using live cell '
 'imaging. CsA treatment resulted in mitochondrial permeability transition '
 'pore (PTP) formation and cell death. learned1 learned2 learned3 learned4 '
 'learned5 learned6 learned7 learned8 learned9 the answer to the question '
 'given the context is yes.'

The one with hugginface:

('Question: Do mitochondria play a role in remodelling lace plant leaves '
 'during programmed cell death? Context: Programmed cell death (PCD) is the '
 'regulated death of cells within an organism. The lace plant (Aponogeton '
 'madagascariensis) produces perforations in its leaves through PCD. The '
 'leaves of the plant consist of a latticework of longitudinal and transverse '
 'veins enclosing areoles. PCD occurs in the cells at the center of these '
 'areoles and progresses outwards, stopping approximately five cells from the '
 'vasculature. The role of mitochondria during PCD has been recognized in '
 'animals; however, it has been less studied during PCD in plants. The '
 'following paper elucidates the role of mitochondrial dynamics during '
 'developmentally regulated PCD in vivo in A. madagascariensis. A single '
 'areole within a window stage leaf (PCD is occurring) was divided into three '
 'areas based on the progression of PCD; cells that will not undergo PCD '
 '(NPCD), cells in early stages of PCD (EPCD), and cells in late stages of PCD '
 '(LPCD). Window stage leaves were stained with the mitochondrial dye '
 'MitoTracker Red CMXRos and examined. Mitochondrial dynamics were delineated '
 'into four categories (M1-M4) based on characteristics including '
 'distribution, motility, and membrane potential (ΔΨm). A TUNEL assay showed '
 'fragmented nDNA in a gradient over these mitochondrial stages. Chloroplasts '
 'and transvacuolar strands were also examined using live cell imaging. The '
 'possible importance of mitochondrial permeability transition pore (PTP) '
 'formation during PCD was indirectly examined via in vivo cyclosporine A '
 '(CsA) treatment. This treatment resulted in lace plant leaves with a '
 'significantly lower number of perforations compared to controls, and that '
 'displayed mitochondrial dynamics similar to that of non-PCD cells. '
 '<unk><unk><unk><unk><unk><unk><unk><unk><unk>the answer to the question '
 'given the context is yes.

espoirMur avatar Feb 17 '24 05:02 espoirMur