moniel icon indicating copy to clipboard operation
moniel copied to clipboard

Add support for PyTorch

Open mlajtos opened this issue 8 years ago • 2 comments

Generating executable code is a top priority. PyTorch is currently the top DL framework (because of the define-by-run nature), so naturally it would be very suiting to combine the two.

Moniel should provide easy way to define weird architectures and PyTorch is cabable of representing them. However, user must be able to interfere with the generated code, because high-level description often does not capture all the neccesities of the idea.

mlajtos avatar Mar 04 '17 06:03 mlajtos

Since code is the best representation for computational graphs, output should be generated Python code using PyTorch infrastructure. Again, output WILL NOT be any JSON/YAML/PB stuff, but actual runnable code.

Since user will be able to change generated code (or maybe inject it from Moniel?), result will be the best of the both worlds.

mlajtos avatar Mar 09 '17 22:03 mlajtos

There is a proof-of-concept code that constructs code that resembles PyTorch, but there are a few questions that need to be discussed:

  • Generate torch.nn.Modules or just dump everything in one block of code?
  • How to handle Tensors in a functional way? Something like tf.get_variable..?
  • ...more to come

mlajtos avatar Jun 23 '17 11:06 mlajtos