seabass1248 comments

Results 7 comments of


seabass1248

Multilingual Albert

We are actively working on this. I'll post back to this thread when we have some news to share.

race score using run_race.py with albert base v2 is so much higher than score in table(66.8)

@MaybeLL what Python version are you using?

ValueError: Shape of variable bert/pooler/dense/bias:0 ((128,)) doesn't match with shape of tensor bert/pooler/dense/bias ([768]) from checkpoint reader.

What was `this error`? Can you post a stacktrace?

Need to upgrade the model published on tfhub.dev to the newer SavedModel format

Stay tuned, we are working on TF2.0

When fine-tuning ALBERT on SQUAD 1.1 - TypeError: Expected binary or unicode string, got None

Can you give the whole command, so that we can attempt to reproduce it? Also, if you could give your TF and PY version numbers.

When fine-tuning ALBERT on SQUAD 1.1 - TypeError: Expected binary or unicode string, got None

I can't fix this right now, but I believe it is a bug with the default value of `--predict_feature_file`. It defaults to None, but should default to empty string: https://github.com/google-research/ALBERT/blob/master/run_squad_v1.py#L77

Fine-tuning Albert large

@dhruvsakalley that was due to a bug in the TF-Hub UI, which should be resolved now. Also, please switch to the "/3" path for TF-Hub modules (see Jan 7 update...