MDF icon indicating copy to clipboard operation
MDF copied to clipboard

Create a version in MDF of PyTorch RNN tutorial model

Open pgleeson opened this issue 3 years ago • 2 comments

https://pytorch.org/tutorials/intermediate/char_rnn_classification_tutorial.html

Possible steps for @Ivy8127:

  • [ ] Create a standalone repo with a python script version of the model
  • [ ] Add tests/Github actions for training/using the model
  • [ ] Start converting parts to MDF, e.g. lineToTensor method (string in, tensor out), the predictor (tensor in, dict out with prediction scores)
  • [ ] Try to export the trained PyTorch RNN core to MDF
  • [ ] Try connecting this to the other parts to make MDF model with just: string in, prediction out
  • [ ] Investigate options to train model when it is in MDF form...

pgleeson avatar Aug 03 '22 16:08 pgleeson

The lineToTensor function takes in a string input and returns a tensor that can be fed into the RNN. My question is this, how do I think about modeling this function in an MDF way? I'm currently stuck here.

Also trying to get acquainted with some of Parikshit's work here: https://github.com/ModECI/MDF/tree/development/examples/PyTorch

Ivy8127 avatar Aug 18 '22 13:08 Ivy8127

@Ivy8127, it seems that supporting strings as parameters will be a bit more involved than expected... Currently the execution engine treats a string parameter as an expression to evaluate (like "a + b"), and will give an error if it can't parse it.

There needs to be something like a dtype attribute on parameters which can state they they can be strings, and treat them differently. I'll try to prototype somethign early next week. For now, try using the standard pytorch->mdf examples to export the core RNN model to MDF and see how that goes...

pgleeson avatar Aug 19 '22 13:08 pgleeson