lrmr
lrmr copied to clipboard
Would you help me to solve a problem with sample codes?
Hi~
This project is interesting.
I'm trying to run sample codes to get some insight into this project.
However, a problem arose.
Unknown desc = panic: runtime error: invalid memory address or nil pointer dereference.
Would you take a look at my problem?
golang version: go1.16.3
source version: tag: v0.3.46
8 workers and 1 master and etcd in localhost.
workers port : 12341 ~ 12348
worker command: go run ./test/cmd/workertest/main.go <port>
master command: go run ./test/cmd/mastertest/main.go
I got the below log messages when executed the master.
2021-06-02 19:07:59.375 V │ lrmr.cluster: master node registered as localhost:7600
2021-06-02 19:07:59.376 V │ lrmr: Planned 1 partitions on GroupByApp/_input (output with *lrmr.localInput):
localhost:7600: _input
2021-06-02 19:07:59.376 V │ lrmr: Planned 96 partitions on GroupByApp/csvDecoder0 (output with *partitions.hashKeyPartitioner):
127.0.0.1:12341: 5, 13, 21, 29, 37, 45, 53, 61, 69, 77, 85, 93
127.0.0.1:12342: 7, 15, 23, 31, 39, 47, 55, 63, 71, 79, 87, 95
127.0.0.1:12343: 2, 10, 18, 26, 34, 42, 50, 58, 66, 74, 82, 90
127.0.0.1:12344: 6, 14, 22, 30, 38, 46, 54, 62, 70, 78, 86, 94
127.0.0.1:12345: 1, 9, 17, 25, 33, 41, 49, 57, 65, 73, 81, 89
127.0.0.1:12346: 0, 8, 16, 24, 32, 40, 48, 56, 64, 72, 80, 88
127.0.0.1:12347: 3, 11, 19, 27, 35, 43, 51, 59, 67, 75, 83, 91
127.0.0.1:12348: 4, 12, 20, 28, 36, 44, 52, 60, 68, 76, 84, 92
2021-06-02 19:07:59.376 V │ lrmr: Planned 96 partitions on GroupByApp/counter1 (output with *partitions.PreservePartitioner):
127.0.0.1:12341: 5, 13, 21, 29, 37, 45, 53, 61, 69, 77, 85, 93
127.0.0.1:12342: 7, 15, 23, 31, 39, 47, 55, 63, 71, 79, 87, 95
127.0.0.1:12343: 2, 10, 18, 26, 34, 42, 50, 58, 66, 74, 82, 90
127.0.0.1:12344: 6, 14, 22, 30, 38, 46, 54, 62, 70, 78, 86, 94
127.0.0.1:12345: 1, 9, 17, 25, 33, 41, 49, 57, 65, 73, 81, 89
127.0.0.1:12346: 0, 8, 16, 24, 32, 40, 48, 56, 64, 72, 80, 88
127.0.0.1:12347: 3, 11, 19, 27, 35, 43, 51, 59, 67, 75, 83, 91
127.0.0.1:12348: 4, 12, 20, 28, 36, 44, 52, 60, 68, 76, 84, 92
2021-06-02 19:07:59.385 F │ master: failed to run session: rpc error: code = Unknown desc = panic: runtime error: invalid memory address or nil pointer dereference
runtime.panicmem (panic.go:212)
runtime.sigpanic (signal_unix.go:734)
github.com/ab180/lrmr/internal/serialization.Type.New (type.go:48)
github.com/ab180/lrmr/internal/serialization.DeserializeStruct (struct.go:38)
github.com/ab180/lrmr/partitions.(*SerializablePartitioner).UnmarshalJSON (partitioner.go:41)
github.com/ab180/lrmr/internal/pbtypes.(*JSON).UnmarshalJSON (types.go:18)
github.com/ab180/lrmr/worker.(*Worker).createTask (worker.go:155)
github.com/ab180/lrmr/worker.(*Worker).CreateTasks.func1 (worker.go:145)
github.com/ab180/lrmr/internal/errgroup.(*Group).Go.func1 (errgroup.go:69)
call CreateTask on 127.0.0.1:12346
github.com/ab180/lrmr/master.(*Master).StartJob.func1
/Users/kakao/sources/lrmr/master/master.go:158
github.com/ab180/lrmr/internal/errgroup.(*Group).Go.func1
/Users/kakao/sources/lrmr/internal/errgroup/errgroup.go:69
runtime.goexit
/usr/local/Cellar/go/1.16.3/libexec/src/runtime/asm_amd64.s:1371
assign task
exit status 1
I hope your help.
Thank you.