keras-nlp
keras-nlp copied to clipboard
keras-team
Modular Natural Language Processing workflows with Keras
The current text generation implementation relies on tf.concat, which is not XLA compatible. Instead we can use a pre-allocated buffer to hold generated tokens. As we are currently using generation...
This is not necessarily a bug, but I find it confusing. I tried to tokenize a sequence like `"[start] have a nice day"`, but it appears that with the default...
As title suggests.
To actually run a GLUE submission (including tasks with private labels), we need to output a number of .tsv files per GLUE task. See the first item here: https://gluebenchmark.com/faq We...
All examples should be runnable on cloud with a each to use set of commands.
We recently had a bug https://github.com/keras-team/keras-nlp/issues/159 where a PR was missing an `__init__` file. This meant the installed library was fully broken. However, this did not lead to any failures...
Run the preprocessing pipeline, and upload the output to cloud storage bucket so that data preparation part is detached from the training part. This is a requirement from Vertex AI...
Since issue #39 is very broad I've created this to specifically discuss the Synonym Replacement Layer - [ ] Parse WordNet - [ ] Work On Integrating With KerasNLP So...
We should replace the entire embedding code in this file with keras_nlp and keras components. https://github.com/keras-team/keras-nlp/blob/master/examples/bert/bert_model.py
Building on https://github.com/keras-team/keras-nlp/blob/master/keras_nlp/layers/preprocessing/mlm_mask_generator.py which dynamically masks tokens, I was wondering if we can implement a layer for how XLNet generates permutation masks for its inputs (Permutation Language Modelling). This is...
Metadata
Owner
Metadata
Modular Natural Language Processing workflows with Keras