cehr-bert

cehr-bert copied to clipboard

- Upload Tensorflow to 2.12 so we can use TensorFlow's version of MultiHeadAttention - Replace our own implementation of [MultiHeadAttention](https://github.com/cumc-dbmi/cehr-bert/blob/8862fd6a1f026839d301625fb30a1ba7e19a4672/models/custom_layers.py#L81) with the Tensorflow version of [MultiHeadAttention](https://www.tensorflow.org/api_docs/python/tf/keras/layers/MultiHeadAttention) - Toggle `mask` at...

ChaoPang

Use-case of the model

3

Hi, Can you please add a simple notebook for a use-case of the models and going about training the network from scratch with sample Temporal data X, and prediction label...

Shahriarnz14

Unable to finish tutorial: can run prediction evaluation

1

I've been able to follow the tutorial in the README just fine, except for the last line. I've downloaded the Synthea data, converted it to the training data format, and...

schuemie

ChaoPang

The current normalization method for age is applied on the entire dataset before splitting up which might cause age information leakage for the future so it isn't aligned with the...

xj2193

ChaoPang