keras-io icon indicating copy to clipboard operation
keras-io copied to clipboard

Value error fixed in keras-io/guides/keras_nlp /transformer_pretraining.py documentation

Open debrupf2946 opened this issue 1 year ago • 6 comments
trafficstars

This code fixes the small bug in the transformer_pretraining.py documentation which leads to Value error,It has been tested

pooled_tokens = keras.layers.GlobalAveragePooling1D()(encoded_tokens[0]) encoded_tokens[0] is giving the following error line 437

ValueError`                                Traceback (most recent call last)
[<ipython-input-23-599e891a0cf7>](https://localhost:8080/#) in <cell line: 8>()
      6 # Encode and pool the tokens.
      7 encoded_tokens = encoder_model(inputs)
----> 8 pooled_tokens = keras.layers.GlobalAveragePooling1D()(encoded_tokens[0])
      9 
     10 # Predict an output label.

1 frames
[/usr/local/lib/python3.10/dist-packages/keras/src/engine/input_spec.py](https://localhost:8080/#) in assert_input_compatibility(input_spec, inputs, layer_name)
    233             ndim = shape.rank
    234             if ndim != spec.ndim:
--> 235                 raise ValueError(
    236                     f'Input {input_index} of layer "{layer_name}" '
    237                     "is incompatible with the layer: "

ValueError: Input 0 of layer "global_average_pooling1d" is incompatible with the layer: expected ndim=3, found ndim=2. Full shape received: (128, 256)

pooled_tokens = keras.layers.GlobalAveragePooling1D()(encoded_tokens) fixes the code

debrupf2946 avatar Feb 06 '24 05:02 debrupf2946