kenneys-bot

processing of the pre-training dataset IIT CDIP 1.0

1

Can you please provide the code used to process the pre-training dataset IIT CDIP 1.0? I am now trying to do retraining weights for use with a new encoder. Any...

some questions about embedding in the code and in the paper

1

 if inputs_embeds is None: inputs_embeds = self.word_embeddings(input_ids) token_type_embeddings = self.token_type_embeddings(token_type_ids) embeddings = inputs_embeds + token_type_embeddings if self.position_embedding_type == "absolute": position_embeddings = self.position_embeddings(position_ids) embeddings += position_embeddings if "line_bbox" in kwargs:...

Problems with H1, H2, and H3 calculations in the code in the paper

1

 Thank you very much for your help before, I've been working on your model recently, but I'm confused about the calculation of H1, H2, and H3 in the graph,...