DeepPavlov

DeepPavlov copied to clipboard

fix: issues 1418, 1420

[]

Resolves #1418, #1420

Ihab-Asaad

Проблемы с зависимостями

[{"_id":"6322d6d5a49e0e1da50a12cb","body":"\u0414\u043e\u0431\u0440\u044b\u0439 \u0434\u0435\u043d\u044c.\r\n\r\n@hadrizi, \u0441\u043f\u0430\u0441\u0438\u0431\u043e \u0437\u0430 issue, \u043c\u044b \u0437\u043d\u0430\u0435\u043c \u043e\u0431 \u044d\u0442\u043e\u0439 \u043f\u0440\u043e\u0431\u043b\u0435\u043c\u0435 \u0438 \u0440\u0435\u0448\u0430\u0435\u043c \u0435\u0451.\r\n\u0412 \u043f\u0440\u0435-\u0440\u0435\u043b\u0438\u0437\u0435 `1.0.0rc0` \u043c\u044b \u043f\u0435\u0440\u0435\u0448\u043b\u0438 \u043d\u0430 range versioning \u0434\u043b\u044f \u043e\u0441\u043d\u043e\u0432\u043d\u044b\u0445 \u0437\u0430\u0432\u0438\u0441\u0438\u043c\u043e\u0441\u0442\u0435\u0439. \u041a\u0440\u043e\u043c\u0435 \u0442\u043e\u0433\u043e, \u0431\u0438\u0431\u043b\u0438\u043e\u0442\u0435\u043a\u0430 \u0438 \u043c\u043e\u0434\u0435\u043b\u0438, \u043d\u0435 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u0443\u044e\u0449\u0438\u0435 tensorflow, \u0441\u0442\u0430\u043b\u0438 \u043f\u043e\u0434\u0434\u0435\u0440\u0436\u0438\u0432\u0430\u0442\u044c python3.8\/3.9.\r\n\u0423\u0441\u0442\u0430\u043d\u043e\u0432\u0438\u0442\u044c \u043f\u0440\u0435-\u0440\u0435\u043b\u0438\u0437 \u043c\u043e\u0436\u043d\u043e \u0447\u0435\u0440\u0435\u0437 pip, \u044f\u0432\u043d\u043e \u0443\u043a\u0430\u0437\u0430\u0432 `==1.0.0rc0`, \u0438\u043b\u0438 \u0438\u0437 \u0438c\u0445\u043e\u0434\u043d\u0438\u043a\u043e\u0432, \u043f\u0435\u0440\u0435\u043a\u043b\u044e\u0447\u0438\u0432\u0448\u0438\u0441\u044c \u043d\u0430 \u0441\u043e\u043e\u0442\u0432\u0435\u0442\u0441\u0442\u0432\u0443\u044e\u0449\u0438\u0439 \u0442\u044d\u0433. \u0411\u0443\u0434\u0435\u043c \u0440\u0430\u0434\u044b \u0432\u0430\u0448\u0435\u043c\u0443 \u043e\u0442\u0437\u044b\u0432\u0443 \u043d\u0430 \u043f\u0440\u0435-\u0440\u0435\u043b\u0438\u0437.","issue_id":1660116270812,"origin_id":1100578431,"user_origin_id":11364929,"create_time":1650087324,"update_time":1650087324,"id":1663227605361,"updated_at":"2022-09-15T07:40:05.360000Z","created_at":"2022-09-15T07:40:05.360000Z"},{"_id":"6322d6d5a49e0e1da50a12cc","body":"\u042d\u0442\u043e \u0440\u0435\u0448\u0430\u0435\u0442 \u043f\u0440\u043e\u0431\u043b\u0435\u043c\u0443 _\u0432 \u0446\u0435\u043b\u043e\u043c_, \u043e\u0434\u043d\u0430\u043a\u043e \u043d\u0435\u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u0437\u0430\u0432\u0438\u0441\u0438\u043c\u043e\u0441\u0442\u0438 \u0432\u044b\u0433\u043b\u044f\u0434\u044f\u0442 \u043d\u0435\u043c\u043d\u043e\u0433\u043e \u0441\u0442\u0440\u0430\u043d\u043d\u043e. \u041d\u0430\u043f\u0440\u0438\u043c\u0435\u0440 [`uvicorn<=0.17.4`](https:\/\/github.com\/deepmipt\/DeepPavlov\/blob\/1.0.0rc0\/requirements.txt#L24) \u043f\u043e\u0437\u0432\u043e\u043b\u044f\u0435\u0442 \u043f\u043e\u0441\u0442\u0430\u0432\u0438\u0442\u044c \u0432\u0440\u0435\u0441\u0438\u044e **\u043c\u0435\u043d\u044c\u0448\u0435 \u0438\u043b\u0438 \u0440\u0430\u0432\u043d\u0443\u044e** `0.17.4`, \u0442\u0430\u043a\u0438\u043c \u043e\u0431\u0440\u0430\u0437\u043e\u043c \u043c\u043e\u0436\u043d\u043e \u043f\u043e\u0441\u0442\u0430\u0432\u0438\u0442\u044c \u0432\u0435\u0440\u0441\u0438\u044e `0.0.1`, \u043a\u043e\u0442\u043e\u0440\u0430\u044f \u044f\u0432\u043d\u043e \u0441\u043b\u043e\u043c\u0430\u0435\u0442 \u043c\u043e\u0434\u0443\u043b\u044c DeepPavlov, \u043d\u043e \u043d\u0435\u043b\u044c\u0437\u044f \u043f\u043e\u0441\u0442\u0430\u0432\u0438\u0442\u044c [PATCH'\u0438](https:\/\/semver.org\/#summary) \u0432 \u0440\u0430\u043c\u043a\u0430\u0445 `0.17`, \u0432\u043e\u0437\u043c\u043e\u0436\u043d\u043e:\r\n- \u0441\u0442\u043e\u0438\u0442 \u043e\u0433\u0440\u0430\u043d\u0438\u0447\u0438\u0442\u044c \u043e\u0431\u043d\u043e\u0432\u043b\u0435\u043d\u0438\u044f \u0432 \u0440\u0430\u043c\u043a\u0430\u0445 [MINOR \u0438\u043b\u0438 MAJOR](https:\/\/semver.org\/#summary) \u0432\u0435\u0440\u0441\u0438\u0439, \u0442\u043e \u0435\u0441\u0442\u044c `uvicorn~=0.17.4`, \u0447\u0442\u043e \u0442\u0440\u0430\u043d\u0441\u0438\u043b\u0440\u0443\u0435\u0442\u0441\u044f \u0432 `uvicorn>=0.17.4, ==0.17.*`, \u0438\u043b\u0438 `uvicorn~=0.17`, \u0447\u0442\u043e \u0442\u0440\u0430\u043d\u0441\u0438\u043b\u0440\u0443\u0435\u0442\u0441\u044f \u0432 `uvicorn>=0.17, ==0.*`. **NB!** \u0432\u0442\u043e\u0440\u043e\u0439 \u0432\u0430\u0440\u0438\u0430\u043d\u0442 \u043b\u0443\u0447\u0448\u0435 \u043f\u043e\u0434\u0445\u043e\u0434\u0438\u0442 \u0434\u043b\u044f \u0443\u0436\u0435 \u0440\u0435\u043b\u0438\u0437\u043d\u0443\u0442\u044b\u0445 \u043c\u043e\u0434\u0443\u043b\u0435\u0439, \u0442\u043e \u0435\u0441\u0442\u044c \u0442\u0435\u0445, \u0443 \u043a\u043e\u0442\u043e\u0440\u044b\u0445 [MAJOR](https:\/\/semver.org\/#summary) \u0432\u0435\u0440\u0441\u0438\u044f \u0431\u043e\u043b\u044c\u0448\u0435 `0`, \u0442\u0430\u043a \u043a\u0430\u043a \u0432 \u0441\u043e\u043e\u0442\u0432\u0435\u0441\u0442\u0432\u0438\u0438 \u0441 [Semantic Versioning](https:\/\/semver.org\/#spec-item-4) \u044d\u0442\u0438 \u0432\u0435\u0440\u0441\u0438\u0438 \u043f\u043e\u0434\u0432\u0435\u0440\u0436\u0435\u043d\u044b \u0438\u0437\u043c\u0435\u043d\u0435\u043d\u0438\u044e \u043f\u0443\u0431\u043b\u0438\u0447\u043d\u043e\u0433\u043e \u0438\u043d\u0442\u0435\u0440\u0444\u0435\u0439\u0441\u0430\r\n- \u0441\u044b\u043c\u0438\u0442\u0430\u0440\u043e\u0432\u0430\u0442\u044c [caret requirements](https:\/\/python-poetry.org\/docs\/dependency-specification\/#caret-requirements)\r\n\r\ncc @IgnatovFedor ","issue_id":1660116270812,"origin_id":1100605322,"user_origin_id":28650696,"create_time":1650097348,"update_time":1650097901,"id":1663227605373,"updated_at":"2022-09-15T07:40:05.373000Z","created_at":"2022-09-15T07:40:05.373000Z"}]

**DeepPavlov version**: 0.17.2 **Python version**: 3.10.17 **Operating system**: несущественно для проблемы **Issue**: DeepPavlov использует довольно устаревшую форму контроля зависимостей(обычный [requirements.txt](https://github.com/deepmipt/DeepPavlov/blob/master/requirements.txt)), что создает ряд проблем при использовании модуля в проектах с...

hadrizi

8bit optimizers

[]

Added 8bit optimizers from https://github.com/facebookresearch/bitsandbytes to the DeepPavlov library. To be tested yet.

dimakarp1996

AttributeError: module 'numpy.linalg.lapack_lite' has no attribute '_ilp64'

[{"_id":"6322da090d68a95f041b0698","body":"Me too, spent 2 hours to find where I can get \"numpy.linalg.lapack_lite._ilp64\", but failure. At first I want to add # ahead \"HAS_LAPACK64 = numpy.linalg.lapack_lite._ilp64\", but others will use HAS_LAPACK64. \r\n","issue_id":1660116270818,"origin_id":915843326,"user_origin_id":68911446,"create_time":1631173316,"update_time":1631173316,"id":1663228425495,"updated_at":"2022-09-15T07:53:45.495000Z","created_at":"2022-09-15T07:53:45.495000Z"},{"_id":"6322da090d68a95f041b069a","body":"well I too have same error \r\ni unistall numpy and again installed it.\r\nafter that i faced the same error so, i checked whether my numpy folder is in packages or not \r\nsince latest version is installed in site-packages. it is not in packages folder so, i pasted the same in packages folder too \r\nthis time it didn't raise attribute error\r\n","issue_id":1660116270818,"origin_id":1021503770,"user_origin_id":61183363,"create_time":1643136752,"update_time":1643136837,"id":1663228425500,"updated_at":"2022-09-15T07:53:45.499000Z","created_at":"2022-09-15T07:53:45.499000Z"},{"_id":"6322da090d68a95f041b069b","body":"problem solved with :\r\n\r\n1 - pip uninstall -y numpy\r\n2 - pip uninstall -y setuptools\r\n3 - pip install setuptools or conda install setuptools\r\n4 - pip install bumpy or conda install numpy\r\nAny one will work. Conda\/pip","issue_id":1660116270818,"origin_id":1094190974,"user_origin_id":40356827,"create_time":1649570827,"update_time":1649570827,"id":1663228425504,"updated_at":"2022-09-15T07:53:45.504000Z","created_at":"2022-09-15T07:53:45.504000Z"},{"_id":"6616b07123eede2dcf04a195","body":"> pip install bumpy\r\n\r\nGot me an error:\r\n\r\n```\r\nCollecting bumpy\r\n Using cached bumpy-0.4.3.tar.gz (8.9 kB)\r\n Preparing metadata (setup.py) ... error\r\n error: subprocess-exited-with-error\r\n \r\n \u00d7 python setup.py egg_info did not run successfully.\r\n \u2502 exit code: 1\r\n \u2570\u2500> [9 lines of output]\r\n Traceback (most recent call last):\r\n File \"<string>\", line 2, in <module>\r\n File \"<pip-setuptools-caller>\", line 34, in <module>\r\n File \"\/tmp\/pip-install-djv1nl8s\/bumpy_2b89f09fec8d4303a4b34a84a5223c7f\/setup.py\", line 1, in <module>\r\n import bumpy\r\n File \"\/tmp\/pip-install-djv1nl8s\/bumpy_2b89f09fec8d4303a4b34a84a5223c7f\/bumpy.py\", line 157\r\n except Exception, ex:\r\n ^^^^^^^^^^^^^\r\n SyntaxError: multiple exception types must be parenthesized\r\n [end of output]\r\n \r\n note: This error originates from a subprocess, and is likely not a problem with pip.\r\nerror: metadata-generation-failed\r\n\r\n\u00d7 Encountered error while generating package metadata.\r\n\u2570\u2500> See above for output.\r\n\r\nnote: This is an issue with the package mentioned above, not pip.\r\nhint: See above for details.\r\n```","issue_id":1660116270818,"origin_id":1804438919,"user_origin_id":17604849,"create_time":1699556959,"update_time":1699556959,"id":1712762993598,"updated_at":"2024-04-10T15:29:53.598000Z","created_at":"2024-04-10T15:29:53.598000Z"},{"_id":"6616b07123eede2dcf04a196","body":"@IgnatovFedor plz reopen it","issue_id":1660116270818,"origin_id":1804440043,"user_origin_id":17604849,"create_time":1699556985,"update_time":1699556985,"id":1712762993602,"updated_at":"2024-04-10T15:29:53.601000Z","created_at":"2024-04-10T15:29:53.601000Z"},{"_id":"6616b07123eede2dcf04a197","body":"@kopyl it was a typo, change from `bumpy` to `numpy`.","issue_id":1660116270818,"origin_id":1806400624,"user_origin_id":47569716,"create_time":1699648635,"update_time":1699648635,"id":1712762993605,"updated_at":"2024-04-10T15:29:53.604000Z","created_at":"2024-04-10T15:29:53.604000Z"},{"_id":"6616b07123eede2dcf04a198","body":"@Psyhackological thank you. Unfortunately i don't even remember what i needed this thing for :(","issue_id":1660116270818,"origin_id":1807441591,"user_origin_id":17604849,"create_time":1699848079,"update_time":1699848079,"id":1712762993608,"updated_at":"2024-04-10T15:29:53.607000Z","created_at":"2024-04-10T15:29:53.607000Z"},{"_id":"6616b07123eede2dcf04a199","body":"> problem solved with :\r\n> \r\n> 1 - pip uninstall -y numpy 2 - pip uninstall -y setuptools 3 - pip install setuptools or conda install setuptools 4 - pip install bumpy or conda install numpy Any one will work. Conda\/pip\r\n\r\nThis also works in Google Colab as of 1\/10\/2024.","issue_id":1660116270818,"origin_id":1886246055,"user_origin_id":26101303,"create_time":1704949180,"update_time":1704949180,"id":1712762993611,"updated_at":"2024-04-10T15:29:53.611000Z","created_at":"2024-04-10T15:29:53.611000Z"},{"_id":"6616b07123eede2dcf04a19a","body":"for me, this worked using Colab on 29\/02\/24:\r\npip install numpy==1.24.4","issue_id":1660116270818,"origin_id":1972083517,"user_origin_id":13047683,"create_time":1709245958,"update_time":1709245958,"id":1712762993615,"updated_at":"2024-04-10T15:29:53.614000Z","created_at":"2024-04-10T15:29:53.614000Z"}]

**DeepPavlov version** : 0.15.0 **Python version**: 3.8.5 **Operating system**: Linux Ubuntu 20.04 **Issue**: **Command that led to error**: ``` from deeppavlov import configs, build_model ner_model = build_model(configs.ner.ner_rus_bert, download=True) #This will...

alyhalo

Deeppavlov fixes

[]

1) Added tqdm in trainer 2) Added handling separate-class labels as float labels if specified 3) Addled handling quotes while reading dataset if specified

dimakarp1996

PAL-BERT with NER

[]

Work in progress.

dimakarp1996

Fix NumpyArrayEncoder

[]

This PR solves the problem with class NumpyArrayEncoder,that does not correctly handle all types of possible inputs.

dimakarp1996

Add TripPy to GoBot

[]

danielkornev

Update tokenizers and minor multi-gpu refactor

[]

slowwavesleep

add roberta support

[{"_id":"6322d7f10d68a95f041b0624","body":"Now distilbert, roberta, xlm, bart and longformer-like models can be trained correctly (confirmed on a GPU)","issue_id":1660116270831,"origin_id":979455217,"user_origin_id":43185527,"create_time":1637871884,"update_time":1637871884,"id":1663227889289,"updated_at":"2022-09-15T07:44:49.289000Z","created_at":"2022-09-15T07:44:49.289000Z"}]

Add RoBERTa support in `squad_torch_bert` config. The changes concern the shape of `token_type_ids` specific for RoBERTa

BunnyNoBugs