BioGPT
BioGPT copied to clipboard
Add the link to the QA model to huggingface
I have converted the QA checkpoint model to a Huggingface model! Please, have a look and test If it works.
The full model is here: https://huggingface.co/espoir/BioGPT-Large-QA-PubMedQA!
Canvas:
The main prompt model was outputting a sequence of words learned1, learned2, ... learned9 before output the answer of the question! I checked this my be due to the way prompt was set up during training.
Before adding the model to huggingface and to make it work I have added 9 extras words to the embedding layers to accommodate the fairseq model weight.
With that below are the difference output of the two models:
FairseqOne:
('Do mitochondria play a role in remodelling lace plant leaves during '
'programmed cell death? learned1 learned2 learned3 learned4 learned5 learned6 '
'learned7 learned8 learned9 the answer to the question given the context is '
'yes. context: Programmed cell death (PCD) is the regulated death of cells '
'within an organism. The lace plant (Aponogeton madagascariensis) produces '
'perforations in its leaves through PCD. The leaves of the plant consist of a '
'latticework of longitudinal and transverse veins enclosing areoles. PCD '
'occurs in the cells at the center of these areoles and progresses outwards, '
'stopping approximately five cells from the vasculature. The role of '
'mitochondria during PCD has been recognized in animals; however, it has been '
'less studied during PCD in plants. The following paper elucidates the role '
'of mitochondrial dynamics during developmentally regulated PCD in vivo in A. '
'madagascariensis. A single areole within a window stage leaf (PCD is '
'occurring) was divided into three areas based on the progression of PCD; '
'cells that will not undergo PCD (NPCD), cells in early stages of PCD (EPCD), '
'and cells in late stages of PCD (LPCD). Window stage leaves were stained '
'with the mitochondrial dye MitoTracker Red CMXRos and examined. '
'Mitochondrial dynamics were delineated into four categories (M1-M4) based on '
'characteristics including distribution, motility, and membrane potential '
'(ΔΨm). Chloroplasts and transvacuolar strands were also examined using live '
'cell imaging. Chloroplasts were examined for signs of swelling and [/](https://file+.vscode-resource.vscode-cdn.net/) or '
'membrane potential loss. A TUNEL assay was performed to detect fragmented '
'nDNA. Chloroplasts in cells undergoing PCD were also examined using live '
'cell imaging. The role of mitochondrial permeability transition pore (PTP) '
'formation during PCD was examined using cyclosporine A (CsA). A single '
'areole within a window stage leaf (PCD is occurring) was divided into three '
'areas based on the progression of PCD; cells that will not undergo PCD '
'(NPCD), cells in early stages of PCD (EPCD), and cells in late stages of PCD '
'(LPCD). Mitochondrial dynamics were delineated into four categories (M1-M4) '
'based on characteristics including distribution, motility, and ΔΨm. '
'Chloroplasts in cells undergoing PCD were also examined using live cell '
'imaging. Mitochondrial dynamics were characterized into four categories '
'(M1-M4) based on characteristics including swelling and [/](https://file+.vscode-resource.vscode-cdn.net/) or ΔΨm. '
'Chloroplasts in cells undergoing PCD were also examined using live cell '
'imaging. CsA treatment resulted in mitochondrial permeability transition '
'pore (PTP) formation and cell death. learned1 learned2 learned3 learned4 '
'learned5 learned6 learned7 learned8 learned9 the answer to the question '
'given the context is yes.'
The one with hugginface:
('Question: Do mitochondria play a role in remodelling lace plant leaves '
'during programmed cell death? Context: Programmed cell death (PCD) is the '
'regulated death of cells within an organism. The lace plant (Aponogeton '
'madagascariensis) produces perforations in its leaves through PCD. The '
'leaves of the plant consist of a latticework of longitudinal and transverse '
'veins enclosing areoles. PCD occurs in the cells at the center of these '
'areoles and progresses outwards, stopping approximately five cells from the '
'vasculature. The role of mitochondria during PCD has been recognized in '
'animals; however, it has been less studied during PCD in plants. The '
'following paper elucidates the role of mitochondrial dynamics during '
'developmentally regulated PCD in vivo in A. madagascariensis. A single '
'areole within a window stage leaf (PCD is occurring) was divided into three '
'areas based on the progression of PCD; cells that will not undergo PCD '
'(NPCD), cells in early stages of PCD (EPCD), and cells in late stages of PCD '
'(LPCD). Window stage leaves were stained with the mitochondrial dye '
'MitoTracker Red CMXRos and examined. Mitochondrial dynamics were delineated '
'into four categories (M1-M4) based on characteristics including '
'distribution, motility, and membrane potential (ΔΨm). A TUNEL assay showed '
'fragmented nDNA in a gradient over these mitochondrial stages. Chloroplasts '
'and transvacuolar strands were also examined using live cell imaging. The '
'possible importance of mitochondrial permeability transition pore (PTP) '
'formation during PCD was indirectly examined via in vivo cyclosporine A '
'(CsA) treatment. This treatment resulted in lace plant leaves with a '
'significantly lower number of perforations compared to controls, and that '
'displayed mitochondrial dynamics similar to that of non-PCD cells. '
'<unk><unk><unk><unk><unk><unk><unk><unk><unk>the answer to the question '
'given the context is yes.