bert

bert copied to clipboard

inclues in line 131 was replaced to includes

debanath

Is BERT capable of producing semantically close word embeddings for synonyms?

1

Hello everyone, I am currently working on my undergraduate thesis on matching job descriptions to resumes based on the contents of both. Recently, I came across the following statement by...

maxbuf

OtherHorizon

To reshape the input, the code is: ``` if input_ids.shape.ndims == 2: input_ids = tf.expand_dims(input_ids, axis=[-1] ``` I'm wondering why we set axis = [-1] instead of -1 and how...

futuresing

Question: What does "pooler layer" mean? Why it called pooler?

6

This question is just about the term "pooler", and maybe more of an English question than a question about BERT. By reading this repository and its issues, I found the...

miyamonz

tensorflow/core/framework/op_kernel.cc:1651] OP_REQUIRES failed at example_parsing_ops.cc:240 : Invalid argument: Key: masked_lm_positions. Can't parse serialized Example.

2

When I run the run_pretraining.py file, the code runs well, but this error occurs. I don't know what the problem is. I set max_predictions_per_seq=20 and ran. In the create_pretraining_data.py file,...

ghost

I am writing a thesis which references mBERT a lot. And would be really great to know data sizes of English, Nepali, and Hindi used for training. In other papers,...

mani-rai

Windows fatal exception: access violation

2

When I was running the MRPC example, this line of code reported a fatal error. ` with tf.io.gfile.GFile(FLAGS.input_meta_data_path, 'rb') as reader: input_meta_data = json.loads(reader.read().decode('utf-8')) `

BruceLee66

Hidden snake

1

Please don't track nor stalk me.

Smmfh223

Smmfh223