QI JUN
QI JUN
# Data Parallelism Data parallelism replicates the model on every device to generates gradients independently and then communicates those gradients at each iteration to keep model replicas consistent. Following is...
The `image-recordio-gen` command converts an image folder with label txt to recordio file format. Let's take mnist dataset as an example. We could download the dataset from https://github.com/myleott/mnist_png.git. The dataset...
This PR depends on #375 First, install gotorch ```bash go install ./... ``` Then, use launch tool to run 2 processes in a single node: ```bash $GOPATH/bin/launch -nprocPerNode=2 -masterAddr=127.0.0.1 -masterPort=11111...
[Here](https://github.com/wangkuiyi/gotorch/blob/allreduce_design/doc/allreduce.md) is for beter review
- Case 1: type inference Go code: ```go x = torch.View(x, []int64{-1, 28 * 28}) ``` Go+ code: ``` x = torch.View(x, {-1, 28 * 28}) ``` - Case 2:...
## Image preprocessing pipeline in GoTorch a jpg image file ---> image.YCbCr format --> image.NRGBA format ---> Go array --> GoTorch Tensor 1. Use `image.Decode` method to read a jpg...
We are trying to compare the GPU memory consumption between GoTorch and PyTorch with the Resnet50 model. The scripts locate at https://github.com/wangkuiyi/gotorch/tree/develop/example/resnet. The GPU card is P100 with 16G memory....
[`NewFunctional`](https://github.com/wangkuiyi/gotorch/blob/develop/nn/container.go#L59) only accepts functions with `func(torch.Tensor) torch.Tensor` type. We could write the following codes: ```go nn.NewFunctional(torch.Tanh) ``` However, `LeakyRelu` takes two input parameters. ```go func LeakyRelu(t Tensor, negativeSlope float64) Tensor...
We want to compare the DCGAN example with different frontend languages: Python/C++/Go/Go+ Python version: https://github.com/pytorch/examples/blob/master/dcgan/main.py C++ version: https://github.com/pytorch/examples/blob/master/cpp/dcgan/dcgan.cpp We will add the Go version and Go+ version later.