lrmr icon indicating copy to clipboard operation
lrmr copied to clipboard

Would you help me to solve a problem with sample codes?

Open otheng03 opened this issue 4 years ago • 0 comments

Hi~

This project is interesting.

I'm trying to run sample codes to get some insight into this project.

However, a problem arose. Unknown desc = panic: runtime error: invalid memory address or nil pointer dereference.

Would you take a look at my problem?

golang version: go1.16.3
source version: tag: v0.3.46

8 workers and 1 master and etcd in localhost.

workers port : 12341 ~ 12348
worker command: go run ./test/cmd/workertest/main.go <port>
master command: go run ./test/cmd/mastertest/main.go

I got the below log messages when executed the master.

2021-06-02 19:07:59.375 V │ lrmr.cluster: master node registered as localhost:7600
2021-06-02 19:07:59.376 V │ lrmr: Planned 1 partitions on GroupByApp/_input (output with *lrmr.localInput):
  localhost:7600: _input

2021-06-02 19:07:59.376 V │ lrmr: Planned 96 partitions on GroupByApp/csvDecoder0 (output with *partitions.hashKeyPartitioner):
  127.0.0.1:12341: 5, 13, 21, 29, 37, 45, 53, 61, 69, 77, 85, 93
  127.0.0.1:12342: 7, 15, 23, 31, 39, 47, 55, 63, 71, 79, 87, 95
  127.0.0.1:12343: 2, 10, 18, 26, 34, 42, 50, 58, 66, 74, 82, 90
  127.0.0.1:12344: 6, 14, 22, 30, 38, 46, 54, 62, 70, 78, 86, 94
  127.0.0.1:12345: 1, 9, 17, 25, 33, 41, 49, 57, 65, 73, 81, 89
  127.0.0.1:12346: 0, 8, 16, 24, 32, 40, 48, 56, 64, 72, 80, 88
  127.0.0.1:12347: 3, 11, 19, 27, 35, 43, 51, 59, 67, 75, 83, 91
  127.0.0.1:12348: 4, 12, 20, 28, 36, 44, 52, 60, 68, 76, 84, 92

2021-06-02 19:07:59.376 V │ lrmr: Planned 96 partitions on GroupByApp/counter1 (output with *partitions.PreservePartitioner):
  127.0.0.1:12341: 5, 13, 21, 29, 37, 45, 53, 61, 69, 77, 85, 93
  127.0.0.1:12342: 7, 15, 23, 31, 39, 47, 55, 63, 71, 79, 87, 95
  127.0.0.1:12343: 2, 10, 18, 26, 34, 42, 50, 58, 66, 74, 82, 90
  127.0.0.1:12344: 6, 14, 22, 30, 38, 46, 54, 62, 70, 78, 86, 94
  127.0.0.1:12345: 1, 9, 17, 25, 33, 41, 49, 57, 65, 73, 81, 89
  127.0.0.1:12346: 0, 8, 16, 24, 32, 40, 48, 56, 64, 72, 80, 88
  127.0.0.1:12347: 3, 11, 19, 27, 35, 43, 51, 59, 67, 75, 83, 91
  127.0.0.1:12348: 4, 12, 20, 28, 36, 44, 52, 60, 68, 76, 84, 92

2021-06-02 19:07:59.385 F │ master: failed to run session: rpc error: code = Unknown desc = panic: runtime error: invalid memory address or nil pointer dereference
    runtime.panicmem (panic.go:212)
    runtime.sigpanic (signal_unix.go:734)
    github.com/ab180/lrmr/internal/serialization.Type.New (type.go:48)
    github.com/ab180/lrmr/internal/serialization.DeserializeStruct (struct.go:38)
    github.com/ab180/lrmr/partitions.(*SerializablePartitioner).UnmarshalJSON (partitioner.go:41)
    github.com/ab180/lrmr/internal/pbtypes.(*JSON).UnmarshalJSON (types.go:18)
    github.com/ab180/lrmr/worker.(*Worker).createTask (worker.go:155)
    github.com/ab180/lrmr/worker.(*Worker).CreateTasks.func1 (worker.go:145)
    github.com/ab180/lrmr/internal/errgroup.(*Group).Go.func1 (errgroup.go:69)
call CreateTask on 127.0.0.1:12346
github.com/ab180/lrmr/master.(*Master).StartJob.func1
        /Users/kakao/sources/lrmr/master/master.go:158
github.com/ab180/lrmr/internal/errgroup.(*Group).Go.func1
        /Users/kakao/sources/lrmr/internal/errgroup/errgroup.go:69
runtime.goexit
        /usr/local/Cellar/go/1.16.3/libexec/src/runtime/asm_amd64.s:1371
assign task
exit status 1

I hope your help.

Thank you.

otheng03 avatar Jun 02 '21 10:06 otheng03