juicefs
juicefs copied to clipboard
Published
20 hours ago •
juicedata
juicedata
The gateway service get a fatal exception when access its web console
What happened: The gateway service run as the following command and runing ok:
MINIO_ROOT_USER=myjfs MINIO_ROOT_PASSWORD=myjfssecret juicefs gateway --writeback --cache-dir "memory" redis://localhost:6379 0.0.0.0:9002
2022/07/15 15:00:16.826476 juicefs[33953] <INFO>: Meta address: redis://localhost:6379 [interface.go:400]
2022/07/15 15:00:16.828075 juicefs[33953] <INFO>: redis localhost:6379 is in cluster mode [redis.go:164]
2022/07/15 15:00:16.834941 juicefs[33953] <INFO>: Ping redis: 336.48µs [redis.go:2871]
2022/07/15 15:00:16.836496 juicefs[33953] <INFO>: Data use s3://myjfs/myjfs/ [gateway.go:194]
2022/07/15 15:00:16.839551 juicefs[33953] <INFO>: Create session 2 OK with version: 1.0.0-rc3+2022-07-14.d1fe59d2 [base.go:266]
2022/07/15 15:00:16.840578 juicefs[33953] <INFO>: Prometheus metrics listening on 127.0.0.1:40718 [mount.go:160]
Endpoint: http://0.0.0.0:9002
Browser Access:
http://0.0.0.0:9002
Object API (Amazon S3 compatible):
Go: https://docs.min.io/docs/golang-client-quickstart-guide
Java: https://docs.min.io/docs/java-client-quickstart-guide
Python: https://docs.min.io/docs/python-client-quickstart-guide
JavaScript: https://docs.min.io/docs/javascript-client-quickstart-guide
.NET: https://docs.min.io/docs/dotnet-client-quickstart-guide
After I login in the gateway web console，the gateway get a fatal exception and exit as following:
unexpected fault address 0x0
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x80 addr=0x0 pc=0x483edf]
goroutine 752 [running]:
runtime.throw({0x2a691bd?, 0x18?})
/root/sdk/go1.18.4/src/runtime/panic.go:992 +0x71 fp=0xc00138f708 sp=0xc00138f6d8 pc=0x452eb1
runtime.sigpanic()
/root/sdk/go1.18.4/src/runtime/signal_unix.go:825 +0x305 fp=0xc00138f758 sp=0xc00138f708 pc=0x469425
aeshashbody()
/root/sdk/go1.18.4/src/runtime/asm_amd64.s:1343 +0x39f fp=0xc00138f760 sp=0xc00138f758 pc=0x483edf
runtime.mapiternext(0xc001117ac0)
/root/sdk/go1.18.4/src/runtime/map.go:934 +0x2cb fp=0xc00138f7d0 sp=0xc00138f760 pc=0x42c8ab
runtime.mapiterinit(0x0?, 0x6?, 0x1?)
/root/sdk/go1.18.4/src/runtime/map.go:861 +0x228 fp=0xc00138f7f0 sp=0xc00138f7d0 pc=0x42c588
reflect.mapiterinit(0x243958e?, 0xc00138f878?, 0x47c5a5?)
/root/sdk/go1.18.4/src/runtime/map.go:1373 +0x19 fp=0xc00138f818 sp=0xc00138f7f0 pc=0x47fed9
github.com/modern-go/reflect2.(*UnsafeMapType).UnsafeIterate(...)
/root/go/pkg/mod/github.com/modern-go/[email protected]/unsafe_map.go:112
github.com/json-iterator/go.(*sortKeysMapEncoder).Encode(0xc002086990, 0xc0005d7480, 0xc0005d7500)
/root/go/pkg/mod/github.com/json-iterator/[email protected]/reflect_map.go:291 +0x225 fp=0xc00138f988 sp=0xc00138f818 pc=0x1b190c5
github.com/json-iterator/go.(*structFieldEncoder).Encode(0xc002086b70, 0x23ea876?, 0xc0005d7500)
/root/go/pkg/mod/github.com/json-iterator/[email protected]/reflect_struct_encoder.go:110 +0x56 fp=0xc00138fa00 sp=0xc00138f988 pc=0x1b26856
github.com/json-iterator/go.(*structEncoder).Encode(0xc002086c30, 0x0?, 0xc0005d7500)
/root/go/pkg/mod/github.com/json-iterator/[email protected]/reflect_struct_encoder.go:158 +0x765 fp=0xc00138fae8 sp=0xc00138fa00 pc=0x1b27265
github.com/json-iterator/go.(*OptionalEncoder).Encode(0xc00115ed20?, 0x0?, 0x0?)
/root/go/pkg/mod/github.com/json-iterator/[email protected]/reflect_optional.go:70 +0xa4 fp=0xc00138fb38 sp=0xc00138fae8 pc=0x1b1e424
github.com/json-iterator/go.(*onePtrEncoder).Encode(0xc00129b6e0, 0xc0005d7440, 0xc0020865a0?)
/root/go/pkg/mod/github.com/json-iterator/[email protected]/reflect.go:219 +0x82 fp=0xc00138fb70 sp=0xc00138fb38 pc=0x1b113c2
github.com/json-iterator/go.(*Stream).WriteVal(0xc0005d7500, {0x24cac60, 0xc0005d7440})
/root/go/pkg/mod/github.com/json-iterator/[email protected]/reflect.go:98 +0x158 fp=0xc00138fbe0 sp=0xc00138fb70 pc=0x1b106d8
github.com/json-iterator/go.(*dynamicEncoder).Encode(0x266f860?, 0x1?, 0xc0005d7518?)
/root/go/pkg/mod/github.com/json-iterator/[email protected]/reflect_dynamic.go:15 +0x39 fp=0xc00138fc10 sp=0xc00138fbe0 pc=0x1b12d99
github.com/json-iterator/go.(*structFieldEncoder).Encode(0xc001f12e70, 0x244fd94?, 0xc0005d7500)
/root/go/pkg/mod/github.com/json-iterator/[email protected]/reflect_struct_encoder.go:110 +0x56 fp=0xc00138fc88 sp=0xc00138fc10 pc=0x1b26856
github.com/json-iterator/go.(*structEncoder).Encode(0xc001f12f30, 0x0?, 0xc0005d7500)
/root/go/pkg/mod/github.com/json-iterator/[email protected]/reflect_struct_encoder.go:158 +0x765 fp=0xc00138fd70 sp=0xc00138fc88 pc=0x1b27265
github.com/json-iterator/go.(*OptionalEncoder).Encode(0xc00138fde8?, 0x428065?, 0x26a4d80?)
/root/go/pkg/mod/github.com/json-iterator/[email protected]/reflect_optional.go:70 +0xa4 fp=0xc00138fdc0 sp=0xc00138fd70 pc=0x1b1e424
github.com/json-iterator/go.(*onePtrEncoder).Encode(0xc000e4f860, 0xc002086540, 0xc00138fe38?)
/root/go/pkg/mod/github.com/json-iterator/[email protected]/reflect.go:219 +0x82 fp=0xc00138fdf8 sp=0xc00138fdc0 pc=0x1b113c2
github.com/json-iterator/go.(*Stream).WriteVal(0xc0005d7500, {0x24cf360, 0xc002086540})
/root/go/pkg/mod/github.com/json-iterator/[email protected]/reflect.go:98 +0x158 fp=0xc00138fe68 sp=0xc00138fdf8 pc=0x1b106d8
github.com/json-iterator/go.(*Encoder).Encode(0xc0006938a8, {0x24cf360?, 0xc002086540?})
/root/go/pkg/mod/github.com/json-iterator/[email protected]/adapter.go:127 +0x32 fp=0xc00138feb8 sp=0xc00138fe68 pc=0x1afc312
github.com/minio/minio/pkg/rpc/json2.(*CodecRequest).writeServerResponse(0xc002086390, {0x3072f60, 0xc0025250e0}, 0xc002086540)
/root/go/pkg/mod/github.com/juicedata/[email protected]/pkg/rpc/json2/server.go:225 +0x167 fp=0xc00138ff20 sp=0xc00138feb8 pc=0x1e91d47
github.com/minio/minio/pkg/rpc/json2.(*CodecRequest).WriteResponse(0xc002086390, {0x3072f60, 0xc0025250e0}, {0x24cac60?, 0xc0005d7440})
/root/go/pkg/mod/github.com/juicedata/[email protected]/pkg/rpc/json2/server.go:191 +0xd4 fp=0xc00138ff58 sp=0xc00138ff20 pc=0x1e919b4
github.com/minio/minio/pkg/rpc.(*Server).ServeHTTP(0xc0008bca80, {0x3072f60?, 0xc0025250e0}, 0xc002084200)
/root/go/pkg/mod/github.com/juicedata/[email protected]/pkg/rpc/server.go:298 +0xeef fp=0xc001390200 sp=0xc00138ff58 pc=0x1e69baf
github.com/minio/minio/cmd.setRedirectHandler.func1({0x3072f60, 0xc0025250e0}, 0xc002084200)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/generic-handlers.go:135 +0x147 fp=0xc001390268 sp=0xc001390200 pc=0x2019e07
net/http.HandlerFunc.ServeHTTP(0x3072f30?, {0x3072f60?, 0xc0025250e0?}, 0x10?)
/root/sdk/go1.18.4/src/net/http/server.go:2084 +0x2f fp=0xc001390290 sp=0xc001390268 pc=0x86ab0f
github.com/minio/minio/cmd.addCustomHeaders.func1({0x3072f30, 0xc0005f39c8}, 0xc001296c60?)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/generic-handlers.go:660 +0x136 fp=0xc001390308 sp=0xc001390290 pc=0x201dd16
net/http.HandlerFunc.ServeHTTP(0x2830ee0?, {0x3072f30?, 0xc0005f39c8?}, 0x17?)
/root/sdk/go1.18.4/src/net/http/server.go:2084 +0x2f fp=0xc001390330 sp=0xc001390308 pc=0x86ab0f
github.com/minio/minio/cmd.addSecurityHeaders.func1({0x3072f30, 0xc0005f39c8}, 0xc002bff900?)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/generic-handlers.go:669 +0x184 fp=0xc0013903a0 sp=0xc001390330 pc=0x201df84
net/http.HandlerFunc.ServeHTTP(0x746b7a706a6c7974?, {0x3072f30?, 0xc0005f39c8?}, 0x66637874776c7165?)
/root/sdk/go1.18.4/src/net/http/server.go:2084 +0x2f fp=0xc0013903c8 sp=0xc0013903a0 pc=0x86ab0f
github.com/minio/minio/cmd.setBucketForwardingHandler.func1({0x3072f30, 0xc0005f39c8}, 0xc002084200)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/generic-handlers.go:543 +0x237 fp=0xc001390a48 sp=0xc0013903c8 pc=0x201c917
net/http.HandlerFunc.ServeHTTP(0xc000563da5?, {0x3072f30?, 0xc0005f39c8?}, 0x44c870?)
/root/sdk/go1.18.4/src/net/http/server.go:2084 +0x2f fp=0xc001390a70 sp=0xc001390a48 pc=0x86ab0f
github.com/minio/minio/cmd.setRequestValidityHandler.func1({0x3072f30, 0xc0005f39c8}, 0xc002084200)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/generic-handlers.go:531 +0x394 fp=0xc001390c80 sp=0xc001390a70 pc=0x201c494
net/http.HandlerFunc.ServeHTTP(0xc000b05fb0?, {0x3072f30?, 0xc0005f39c8?}, 0x7fdce0516a88?)
/root/sdk/go1.18.4/src/net/http/server.go:2084 +0x2f fp=0xc001390ca8 sp=0xc001390c80 pc=0x86ab0f
github.com/minio/minio/cmd.setHTTPStatsHandler.func1({0x3079d40?, 0xc00239e7e0}, 0xc002084200)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/generic-handlers.go:465 +0x11f fp=0xc001390d00 sp=0xc001390ca8 pc=0x201bdbf
net/http.HandlerFunc.ServeHTTP(0x4578e10?, {0x3079d40?, 0xc00239e7e0?}, 0x0?)
/root/sdk/go1.18.4/src/net/http/server.go:2084 +0x2f fp=0xc001390d28 sp=0xc001390d00 pc=0x86ab0f
github.com/minio/minio/cmd.setRequestSizeLimitHandler.func1({0x3079d40?, 0xc00239e7e0}, 0xc002084200)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/generic-handlers.go:49 +0x102 fp=0xc001390d80 sp=0xc001390d28 pc=0x2019442
net/http.HandlerFunc.ServeHTTP(0xc0005d7190?, {0x3079d40?, 0xc00239e7e0?}, 0x203000?)
/root/sdk/go1.18.4/src/net/http/server.go:2084 +0x2f fp=0xc001390da8 sp=0xc001390d80 pc=0x86ab0f
github.com/minio/minio/cmd.setRequestHeaderSizeLimitHandler.func1({0x3079d40, 0xc00239e7e0}, 0xc002084200)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/generic-handlers.go:68 +0x1a5 fp=0xc001390e80 sp=0xc001390da8 pc=0x20196c5
net/http.HandlerFunc.ServeHTTP(0xc001390f00?, {0x3079d40?, 0xc00239e7e0?}, 0xc0005f3998?)
/root/sdk/go1.18.4/src/net/http/server.go:2084 +0x2f fp=0xc001390ea8 sp=0xc001390e80 pc=0x86ab0f
github.com/minio/minio/cmd.crossDomainPolicy.ServeHTTP({{0x30671a0?, 0xc0005f38a8?}}, {0x3079d40?, 0xc00239e7e0?}, 0xd?)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/crossdomain-xml-handler.go:51 +0xef fp=0xc001390ed8 sp=0xc001390ea8 pc=0x1f4c2ef
github.com/minio/minio/cmd.(*crossDomainPolicy).ServeHTTP(0xc000563da5?, {0x3079d40?, 0xc00239e7e0?}, 0xc000563da6?)
<autogenerated>:1 +0x47 fp=0xc001390f10 sp=0xc001390ed8 pc=0x2191c87
github.com/minio/minio/cmd.setBrowserRedirectHandler.func1({0x3079d40, 0xc00239e7e0}, 0xc002084200)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/generic-handlers.go:161 +0xb0 fp=0xc001390f60 sp=0xc001390f10 pc=0x201a030
net/http.HandlerFunc.ServeHTTP(0xc001390fe0?, {0x3079d40?, 0xc00239e7e0?}, 0x203000?)
/root/sdk/go1.18.4/src/net/http/server.go:2084 +0x2f fp=0xc001390f88 sp=0xc001390f60 pc=0x86ab0f
github.com/minio/minio/cmd.setReservedBucketHandler.func1({0x3079d40, 0xc00239e7e0}, 0xc002084200)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/generic-handlers.go:293 +0x2c2 fp=0xc001391060 sp=0xc001390f88 pc=0x201ae02
net/http.HandlerFunc.ServeHTTP(0xc0013910b8?, {0x3079d40?, 0xc00239e7e0?}, 0xc000b05fb0?)
/root/sdk/go1.18.4/src/net/http/server.go:2084 +0x2f fp=0xc001391088 sp=0xc001391060 pc=0x86ab0f
github.com/minio/minio/cmd.setBrowserCacheControlHandler.func1({0x3079d40, 0xc00239e7e0}, 0xc002084200)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/generic-handlers.go:262 +0x303 fp=0xc0013910f8 sp=0xc001391088 pc=0x201a983
net/http.HandlerFunc.ServeHTTP(0xc002084200?, {0x3079d40?, 0xc00239e7e0?}, 0x30?)
/root/sdk/go1.18.4/src/net/http/server.go:2084 +0x2f fp=0xc001391120 sp=0xc0013910f8 pc=0x86ab0f
github.com/minio/minio/cmd.setTimeValidityHandler.func1({0x3079d40, 0xc00239e7e0}, 0xc002084200)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/generic-handlers.go:357 +0x3a3 fp=0xc001391288 sp=0xc001391120 pc=0x201b463
net/http.HandlerFunc.ServeHTTP(0xc002084200?, {0x3079d40?, 0xc00239e7e0?}, 0x0?)
/root/sdk/go1.18.4/src/net/http/server.go:2084 +0x2f fp=0xc0013912b0 sp=0xc001391288 pc=0x86ab0f
github.com/minio/minio/cmd.setIgnoreResourcesHandler.func1({0x3079d40, 0xc00239e7e0}, 0xc002084200)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/generic-handlers.go:452 +0x337 fp=0xc0013913f8 sp=0xc0013912b0 pc=0x201bbb7
net/http.HandlerFunc.ServeHTTP(0xc002084200?, {0x3079d40?, 0xc00239e7e0?}, 0xc0013914e8?)
/root/sdk/go1.18.4/src/net/http/server.go:2084 +0x2f fp=0xc001391420 sp=0xc0013913f8 pc=0x86ab0f
github.com/minio/minio/cmd.setAuthHandler.func1({0x3079d40, 0xc00239e7e0}, 0xc002084200)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/auth-handler.go:504 +0x2a9 fp=0xc001391510 sp=0xc001391420 pc=0x1eea0e9
net/http.HandlerFunc.ServeHTTP(0x2966020?, {0x3079d40?, 0xc00239e7e0?}, 0x39?)
/root/sdk/go1.18.4/src/net/http/server.go:2084 +0x2f fp=0xc001391538 sp=0xc001391510 pc=0x86ab0f
github.com/minio/minio/cmd.setSSETLSHandler.func1({0x3079d40?, 0xc00239e7e0?}, 0xc002084200?)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/generic-handlers.go:703 +0x3ca fp=0xc001391698 sp=0xc001391538 pc=0x201e6ca
net/http.HandlerFunc.ServeHTTP(0x90?, {0x3079d40?, 0xc00239e7e0?}, 0xc0005f3968?)
/root/sdk/go1.18.4/src/net/http/server.go:2084 +0x2f fp=0xc0013916c0 sp=0xc001391698 pc=0x86ab0f
github.com/minio/minio/cmd.filterReservedMetadata.func1({0x3079d40, 0xc00239e7e0}, 0xc002084200)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/generic-handlers.go:108 +0x1a5 fp=0xc001391798 sp=0xc0013916c0 pc=0x2019b25
net/http.HandlerFunc.ServeHTTP(0xc002084100?, {0x3079d40?, 0xc00239e7e0?}, 0xc00129b0f0?)
/root/sdk/go1.18.4/src/net/http/server.go:2084 +0x2f fp=0xc0013917c0 sp=0xc001391798 pc=0x86ab0f
github.com/gorilla/mux.(*Router).ServeHTTP(0xc00206a540, {0x3079d40, 0xc00239e7e0}, 0xc002084000)
/root/go/pkg/mod/github.com/gorilla/[email protected]/mux.go:210 +0x1cf fp=0xc0013918e8 sp=0xc0013917c0 pc=0x1aca1af
github.com/rs/cors.(*Cors).Handler.func1({0x3079d40, 0xc00239e7e0}, 0xc002084000)
/root/go/pkg/mod/github.com/rs/[email protected]/cors.go:219 +0x1bd fp=0xc001391940 sp=0xc0013918e8 pc=0x1d22fbd
net/http.HandlerFunc.ServeHTTP(0xc000e7a740?, {0x3079d40?, 0xc00239e7e0?}, 0x4b87660?)
/root/sdk/go1.18.4/src/net/http/server.go:2084 +0x2f fp=0xc001391968 sp=0xc001391940 pc=0x86ab0f
github.com/minio/minio/cmd.criticalErrorHandler.ServeHTTP({{0x30671a0?, 0xc00221f6c0?}}, {0x3079d40?, 0xc00239e7e0?}, 0x0?)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/generic-handlers.go:688 +0x85 fp=0xc0013919c8 sp=0xc001391968 pc=0x201e045
github.com/minio/minio/cmd.(*criticalErrorHandler).ServeHTTP(0x391a18?, {0x3079d40?, 0xc00239e7e0?}, 0x0?)
<autogenerated>:1 +0x47 fp=0xc001391a00 sp=0xc0013919c8 pc=0x219d027
github.com/minio/minio/cmd/http.(*Server).Start.func1({0x3079d40?, 0xc00239e7e0?}, 0xc00129b080?)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/http/server.go:101 +0x1ba fp=0xc001391a70 sp=0xc001391a00 pc=0x1bddffa
net/http.HandlerFunc.ServeHTTP(0x0?, {0x3079d40?, 0xc00239e7e0?}, 0x42a0c5?)
/root/sdk/go1.18.4/src/net/http/server.go:2084 +0x2f fp=0xc001391a98 sp=0xc001391a70 pc=0x86ab0f
net/http.serverHandler.ServeHTTP({0x306b958?}, {0x3079d40, 0xc00239e7e0}, 0xc002084000)
/root/sdk/go1.18.4/src/net/http/server.go:2916 +0x43b fp=0xc001391b58 sp=0xc001391a98 pc=0x86e67b
net/http.(*conn).serve(0xc0025a4aa0, {0x307b8e0, 0xc00002c360})
/root/sdk/go1.18.4/src/net/http/server.go:1966 +0x5d7 fp=0xc001391fb8 sp=0xc001391b58 pc=0x8695b7
net/http.(*Server).Serve.func3()
/root/sdk/go1.18.4/src/net/http/server.go:3071 +0x2e fp=0xc001391fe0 sp=0xc001391fb8 pc=0x86efce
runtime.goexit()
/root/sdk/go1.18.4/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc001391fe8 sp=0xc001391fe0 pc=0x486ae1
created by net/http.(*Server).Serve
/root/sdk/go1.18.4/src/net/http/server.go:3071 +0x4db
goroutine 1 [select, 1 minutes]:
github.com/minio/minio/cmd.handleSignals()
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/signals.go:72 +0xaf
github.com/minio/minio/cmd.StartGateway(0xc000c1d1e0, {0x3072d20, 0xc00110a100})
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/gateway-main.go:366 +0x115f
github.com/juicedata/juicefs/cmd.gateway2(0xc000fbd227?)
/mnt/hgfs/Work/JuiceFS/juicefs/cmd/gateway.go:146 +0x27
github.com/minio/cli.HandleAction({0x256a7e0?, 0x2b69678?}, 0xc000e78200?)
/root/go/pkg/mod/github.com/minio/[email protected]/app.go:498 +0x5a
github.com/minio/cli.(*App).Run(0xc000c1d040, {0xc001117100, 0x4, 0x4})
/root/go/pkg/mod/github.com/minio/[email protected]/app.go:270 +0x77c
github.com/juicedata/juicefs/cmd.gateway(0xc001117080)
/mnt/hgfs/Work/JuiceFS/juicefs/cmd/gateway.go:140 +0x59a
github.com/urfave/cli/v2.(*Command).Run(0xc0006db560, 0xc001116740)
/root/go/pkg/mod/github.com/urfave/cli/[email protected]/command.go:163 +0x5bb
github.com/urfave/cli/v2.(*App).RunContext(0xc000c1c000, {0x307b870?, 0xc00023e000}, {0xc000e78100, 0x7, 0x8})
/root/go/pkg/mod/github.com/urfave/cli/[email protected]/app.go:313 +0xb48
github.com/urfave/cli/v2.(*App).Run(...)
/root/go/pkg/mod/github.com/urfave/cli/[email protected]/app.go:224
github.com/juicedata/juicefs/cmd.Main({0xc001118070?, 0x7?, 0x7?})
/mnt/hgfs/Work/JuiceFS/juicefs/cmd/main.go:84 +0x2332
main.main()
/mnt/hgfs/Work/JuiceFS/juicefs/main.go:29 +0x2e
goroutine 21 [sleep, 1 minutes]:
time.Sleep(0x8bb2c97000)
/root/sdk/go1.18.4/src/runtime/time.go:194 +0x12e
github.com/juicedata/juicefs/pkg/utils.init.0.func2()
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/utils/alloc.go:78 +0x25
created by github.com/juicedata/juicefs/pkg/utils.init.0
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/utils/alloc.go:76 +0x116
goroutine 34 [chan receive]:
github.com/golang/glog.(*loggingT).flushDaemon(0xc000214480?)
/root/go/pkg/mod/github.com/golang/[email protected]/glog.go:882 +0x6a
created by github.com/golang/glog.init.0
/root/go/pkg/mod/github.com/golang/[email protected]/glog.go:410 +0x1bf
goroutine 180 [select, 1 minutes]:
github.com/baidubce/bce-sdk-go/util/log.NewLogger.func1()
/root/go/pkg/mod/github.com/baidubce/[email protected]/util/log/logger.go:375 +0xb9
created by github.com/baidubce/bce-sdk-go/util/log.NewLogger
/root/go/pkg/mod/github.com/baidubce/[email protected]/util/log/logger.go:368 +0x136
goroutine 150 [select]:
go.opencensus.io/stats/view.(*worker).start(0xc0008b2700)
/root/go/pkg/mod/[email protected]/stats/view/worker.go:276 +0xad
created by go.opencensus.io/stats/view.init.0
/root/go/pkg/mod/[email protected]/stats/view/worker.go:34 +0x8d
goroutine 290 [chan receive, 1 minutes]:
github.com/juicedata/juicefs/pkg/chunk.(*prefetcher).do(0xc00230f220)
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/chunk/prefetch.go:41 +0x45
created by github.com/juicedata/juicefs/pkg/chunk.newPrefetcher
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/chunk/prefetch.go:35 +0xb3
goroutine 142 [IO wait]:
internal/poll.runtime_pollWait(0x7fdcb76ae468, 0x72)
/root/sdk/go1.18.4/src/runtime/netpoll.go:302 +0x89
internal/poll.(*pollDesc).wait(0xc0008b2a00?, 0xc0000b5400?, 0x0)
/root/sdk/go1.18.4/src/internal/poll/fd_poll_runtime.go:83 +0x32
internal/poll.(*pollDesc).waitRead(...)
/root/sdk/go1.18.4/src/internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Accept(0xc0008b2a00)
/root/sdk/go1.18.4/src/internal/poll/fd_unix.go:614 +0x22c
net.(*netFD).accept(0xc0008b2a00)
/root/sdk/go1.18.4/src/net/fd_unix.go:172 +0x35
net.(*TCPListener).accept(0xc0006b4090)
/root/sdk/go1.18.4/src/net/tcpsock_posix.go:139 +0x28
net.(*TCPListener).AcceptTCP(0xc0006b4090)
/root/sdk/go1.18.4/src/net/tcpsock.go:275 +0x3d
github.com/minio/minio/cmd/http.(*httpListener).start.func3(0x52b64a?, 0xc002282060)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/http/listener.go:91 +0x45
created by github.com/minio/minio/cmd/http.(*httpListener).start
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/http/listener.go:105 +0x16d
goroutine 154 [sleep]:
time.Sleep(0xdf8475800)
/root/sdk/go1.18.4/src/runtime/time.go:194 +0x12e
github.com/viki-org/dnscache.(*Resolver).autoRefresh(0x0?, 0x0?)
/root/go/pkg/mod/github.com/viki-org/[email protected]/dnscache.go:74 +0x26
created by github.com/viki-org/dnscache.New
/root/go/pkg/mod/github.com/viki-org/[email protected]/dnscache.go:20 +0xbf
goroutine 404 [sleep, 1 minutes]:
time.Sleep(0x50cf97ad93)
/root/sdk/go1.18.4/src/runtime/time.go:194 +0x12e
github.com/juicedata/juicefs/pkg/utils.SleepWithJitter(0x53d1ac1000)
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/utils/general.go:26 +0x65
github.com/juicedata/juicefs/pkg/vfs.Backup({0x309a350, 0xc0021fda90}, {0x308c580?, 0xc00232e510}, 0x34630b8a000)
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/vfs/backup.go:37 +0x9a
created by github.com/juicedata/juicefs/cmd.initBackgroundTasks
/mnt/hgfs/Work/JuiceFS/juicefs/cmd/mount.go:354 +0x1a5
goroutine 157 [chan receive, 1 minutes]:
github.com/rjeczalik/notify.(*nonrecursiveTree).dispatch(0xc0005d72c0, 0x0?)
/root/go/pkg/mod/github.com/rjeczalik/[email protected]/tree_nonrecursive.go:36 +0x45
created by github.com/rjeczalik/notify.newNonrecursiveTree
/root/go/pkg/mod/github.com/rjeczalik/[email protected]/tree_nonrecursive.go:29 +0x16a
goroutine 158 [chan receive, 1 minutes]:
github.com/rjeczalik/notify.(*nonrecursiveTree).internal(0xc0005d72c0, 0xc0005d7260)
/root/go/pkg/mod/github.com/rjeczalik/[email protected]/tree_nonrecursive.go:81 +0x5a
created by github.com/rjeczalik/notify.newNonrecursiveTree
/root/go/pkg/mod/github.com/rjeczalik/[email protected]/tree_nonrecursive.go:30 +0x1be
goroutine 159 [sleep, 1 minutes]:
time.Sleep(0x1a3185c5000)
/root/sdk/go1.18.4/src/runtime/time.go:194 +0x12e
github.com/minio/minio/cmd/logger.(*logOnceType).cleanupRoutine(0xc0009198c0)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/logger/logonce.go:64 +0x2e
created by github.com/minio/minio/cmd/logger.newLogOnceType
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/logger/logonce.go:71 +0x90
goroutine 160 [select]:
github.com/minio/minio/cmd/http.NewDNSCache.func1()
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/http/dial_dnscache.go:129 +0xe5
created by github.com/minio/minio/cmd/http.NewDNSCache
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/http/dial_dnscache.go:125 +0x1a5
goroutine 194 [chan receive, 1 minutes]:
github.com/minio/minio/cmd.newReplicationState.func1()
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/bucket-replication.go:803 +0x38
created by github.com/minio/minio/cmd.newReplicationState
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/bucket-replication.go:802 +0xcc
goroutine 210 [chan receive, 1 minutes]:
github.com/minio/minio/cmd.newTransitionState.func1()
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/bucket-lifecycle.go:135 +0x38
created by github.com/minio/minio/cmd.newTransitionState
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/bucket-lifecycle.go:134 +0xb6
goroutine 161 [IO wait, 1 minutes]:
internal/poll.runtime_pollWait(0x7fdcb76ae558, 0x72)
/root/sdk/go1.18.4/src/runtime/netpoll.go:302 +0x89
internal/poll.(*pollDesc).wait(0xc0008b2980?, 0x0?, 0x0)
/root/sdk/go1.18.4/src/internal/poll/fd_poll_runtime.go:83 +0x32
internal/poll.(*pollDesc).waitRead(...)
/root/sdk/go1.18.4/src/internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Accept(0xc0008b2980)
/root/sdk/go1.18.4/src/internal/poll/fd_unix.go:614 +0x22c
net.(*netFD).accept(0xc0008b2980)
/root/sdk/go1.18.4/src/net/fd_unix.go:172 +0x35
net.(*TCPListener).accept(0xc0006b4048)
/root/sdk/go1.18.4/src/net/tcpsock_posix.go:139 +0x28
net.(*TCPListener).Accept(0xc0006b4048)
/root/sdk/go1.18.4/src/net/tcpsock.go:288 +0x3d
net/http.(*Server).Serve(0xc0002480e0, {0x3079b30, 0xc0006b4048})
/root/sdk/go1.18.4/src/net/http/server.go:3039 +0x385
net/http.(*Server).ListenAndServe(0xc0002480e0)
/root/sdk/go1.18.4/src/net/http/server.go:2968 +0x7d
net/http.ListenAndServe(...)
/root/sdk/go1.18.4/src/net/http/server.go:3222
github.com/juicedata/juicefs/cmd.setup.func1()
/mnt/hgfs/Work/JuiceFS/juicefs/cmd/main.go:247 +0x29
created by github.com/juicedata/juicefs/cmd.setup
/mnt/hgfs/Work/JuiceFS/juicefs/cmd/main.go:245 +0x39d
goroutine 242 [IO wait, 1 minutes]:
internal/poll.runtime_pollWait(0x7fdcb76ae648, 0x72)
/root/sdk/go1.18.4/src/runtime/netpoll.go:302 +0x89
internal/poll.(*pollDesc).wait(0xc000256380?, 0x2?, 0x0)
/root/sdk/go1.18.4/src/internal/poll/fd_poll_runtime.go:83 +0x32
internal/poll.(*pollDesc).waitRead(...)
/root/sdk/go1.18.4/src/internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Accept(0xc000256380)
/root/sdk/go1.18.4/src/internal/poll/fd_unix.go:614 +0x22c
net.(*netFD).accept(0xc000256380)
/root/sdk/go1.18.4/src/net/fd_unix.go:172 +0x35
net.(*TCPListener).accept(0xc0002364c8)
/root/sdk/go1.18.4/src/net/tcpsock_posix.go:139 +0x28
net.(*TCPListener).Accept(0xc0002364c8)
/root/sdk/go1.18.4/src/net/tcpsock.go:288 +0x3d
github.com/google/gops/agent.listen()
/root/go/pkg/mod/github.com/google/[email protected]/agent/agent.go:130 +0x45
created by github.com/google/gops/agent.Listen
/root/go/pkg/mod/github.com/google/[email protected]/agent/agent.go:123 +0x35e
goroutine 259 [chan receive]:
github.com/minio/minio/cmd/http.(*httpListener).Accept(0x86ed3b?)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/http/listener.go:111 +0x2e
net/http.(*Server).Serve(0xc000325d40, {0x3072f00, 0xc00002c270})
/root/sdk/go1.18.4/src/net/http/server.go:3039 +0x385
github.com/minio/minio/cmd/http.(*Server).Start(0xc000325d40)
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/http/server.go:113 +0x2ad
github.com/minio/minio/cmd.StartGateway.func3()
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/gateway-main.go:287 +0x1d
created by github.com/minio/minio/cmd.StartGateway
/root/go/pkg/mod/github.com/juicedata/[email protected]/cmd/gateway-main.go:286 +0xa4a
goroutine 211 [syscall, 1 minutes]:
os/signal.signal_recv()
/root/sdk/go1.18.4/src/runtime/sigqueue.go:151 +0x2f
os/signal.loop()
/root/sdk/go1.18.4/src/os/signal/signal_unix.go:23 +0x19
created by os/signal.Notify.func1.1
/root/sdk/go1.18.4/src/os/signal/signal.go:151 +0x2a
goroutine 261 [select]:
github.com/go-redis/redis/v8/internal/pool.(*ConnPool).reaper(0xc002246460, 0x0?)
/root/go/pkg/mod/github.com/go-redis/redis/[email protected]/internal/pool/pool.go:485 +0xd4
created by github.com/go-redis/redis/v8/internal/pool.NewConnPool
/root/go/pkg/mod/github.com/go-redis/redis/[email protected]/internal/pool/pool.go:111 +0x225
goroutine 268 [sleep]:
time.Sleep(0x3b9aca00)
/root/sdk/go1.18.4/src/runtime/time.go:194 +0x12e
github.com/juicedata/juicefs/pkg/meta.(*openfiles).cleanup(0xc00219d608)
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/meta/openfile.go:47 +0x65
created by github.com/juicedata/juicefs/pkg/meta.newOpenFiles
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/meta/openfile.go:27 +0xa5
goroutine 280 [sleep]:
time.Sleep(0xdf8475800)
/root/sdk/go1.18.4/src/runtime/time.go:194 +0x12e
github.com/juicedata/juicefs/cmd.NewReloadableStorage.func1()
/mnt/hgfs/Work/JuiceFS/juicefs/cmd/mount.go:374 +0x85
created by github.com/juicedata/juicefs/cmd.NewReloadableStorage
/mnt/hgfs/Work/JuiceFS/juicefs/cmd/mount.go:371 +0x165
goroutine 321 [sleep]:
time.Sleep(0x262cf433f)
/root/sdk/go1.18.4/src/runtime/time.go:194 +0x12e
github.com/juicedata/juicefs/pkg/utils.SleepWithJitter(0x2540be400)
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/utils/general.go:26 +0x65
github.com/juicedata/juicefs/pkg/meta.(*baseMeta).refreshUsage(0xc0002e0500)
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/meta/base.go:344 +0x31
created by github.com/juicedata/juicefs/pkg/meta.(*baseMeta).NewSession
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/meta/base.go:246 +0x71
goroutine 751 [IO wait]:
internal/poll.runtime_pollWait(0x7fdcb76ae288, 0x72)
/root/sdk/go1.18.4/src/runtime/netpoll.go:302 +0x89
internal/poll.(*pollDesc).wait(0xc002515200?, 0xc002526000?, 0x0)
/root/sdk/go1.18.4/src/internal/poll/fd_poll_runtime.go:83 +0x32
internal/poll.(*pollDesc).waitRead(...)
/root/sdk/go1.18.4/src/internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Read(0xc002515200, {0xc002526000, 0x1000, 0x1000})
/root/sdk/go1.18.4/src/internal/poll/fd_unix.go:167 +0x25a
net.(*netFD).Read(0xc002515200, {0xc002526000?, 0xc000e4cb00?, 0x49167e?})
/root/sdk/go1.18.4/src/net/fd_posix.go:55 +0x29
net.(*conn).Read(0xc000a00630, {0xc002526000?, 0x85a76c?, 0xc00251d880?})
/root/sdk/go1.18.4/src/net/net.go:183 +0x45
net/http.(*connReader).Read(0xc001205560, {0xc002526000, 0x1000, 0x1000})
/root/sdk/go1.18.4/src/net/http/server.go:780 +0x16d
bufio.(*Reader).fill(0xc002502c60)
/root/sdk/go1.18.4/src/bufio/bufio.go:106 +0x103
bufio.(*Reader).ReadSlice(0xc002502c60, 0x0?)
/root/sdk/go1.18.4/src/bufio/bufio.go:371 +0x2f
bufio.(*Reader).ReadLine(0xc002502c60)
/root/sdk/go1.18.4/src/bufio/bufio.go:400 +0x27
net/textproto.(*Reader).readLineSlice(0xc0021e71d0)
/root/sdk/go1.18.4/src/net/textproto/reader.go:57 +0x99
net/textproto.(*Reader).ReadLine(...)
/root/sdk/go1.18.4/src/net/textproto/reader.go:38
net/http.readRequest(0xc000a00630?)
/root/sdk/go1.18.4/src/net/http/request.go:1029 +0x79
net/http.(*conn).readRequest(0xc0025a4a00, {0x307b838, 0xc000e7b740})
/root/sdk/go1.18.4/src/net/http/server.go:988 +0x24a
net/http.(*conn).serve(0xc0025a4a00, {0x307b8e0, 0xc00002c360})
/root/sdk/go1.18.4/src/net/http/server.go:1891 +0x32b
created by net/http.(*Server).Serve
/root/sdk/go1.18.4/src/net/http/server.go:3071 +0x4db
goroutine 405 [sleep, 1 minutes]:
time.Sleep(0x8bb2c97000)
/root/sdk/go1.18.4/src/runtime/time.go:194 +0x12e
github.com/juicedata/juicefs/pkg/usage.ReportUsage({0x309a350, 0xc0021fda90}, {0xc002588080, 0x1d})
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/usage/usage.go:91 +0x16b
created by github.com/juicedata/juicefs/cmd.initBackgroundTasks
/mnt/hgfs/Work/JuiceFS/juicefs/cmd/mount.go:357 +0x255
goroutine 406 [sleep]:
time.Sleep(0x3b9aca00)
/root/sdk/go1.18.4/src/runtime/time.go:194 +0x12e
github.com/juicedata/juicefs/pkg/vfs.(*dataReader).checkReadBuffer(0xc0005e4120)
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/vfs/reader.go:718 +0x3a
created by github.com/juicedata/juicefs/pkg/vfs.NewDataReader
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/vfs/reader.go:702 +0x1dc
goroutine 110 [sleep]:
time.Sleep(0x2e29f54d7)
/root/sdk/go1.18.4/src/runtime/time.go:194 +0x12e
github.com/juicedata/juicefs/pkg/utils.SleepWithJitter(0x2cb417800)
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/utils/general.go:26 +0x65
github.com/juicedata/juicefs/pkg/meta.(*baseMeta).refreshSession(0xc0002e0500)
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/meta/base.go:283 +0x35
created by github.com/juicedata/juicefs/pkg/meta.(*baseMeta).NewSession
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/meta/base.go:268 +0x2f1
goroutine 111 [sleep]:
time.Sleep(0xd81385005)
/root/sdk/go1.18.4/src/runtime/time.go:194 +0x12e
github.com/juicedata/juicefs/pkg/utils.SleepWithJitter(0xdf8475800)
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/utils/general.go:26 +0x65
github.com/juicedata/juicefs/pkg/meta.(*baseMeta).cleanupDeletedFiles(0xc0002e0500)
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/meta/base.go:382 +0x45
created by github.com/juicedata/juicefs/pkg/meta.(*baseMeta).NewSession
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/meta/base.go:270 +0x34a
goroutine 112 [sleep, 1 minutes]:
time.Sleep(0x367ab673092)
/root/sdk/go1.18.4/src/runtime/time.go:194 +0x12e
github.com/juicedata/juicefs/pkg/utils.SleepWithJitter(0x34630b8a000)
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/utils/general.go:26 +0x65
github.com/juicedata/juicefs/pkg/meta.(*baseMeta).cleanupSlices(0xc0002e0500)
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/meta/base.go:401 +0x2c
created by github.com/juicedata/juicefs/pkg/meta.(*baseMeta).NewSession
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/meta/base.go:271 +0x38d
goroutine 113 [sleep, 1 minutes]:
time.Sleep(0x33038083807)
/root/sdk/go1.18.4/src/runtime/time.go:194 +0x12e
github.com/juicedata/juicefs/pkg/utils.SleepWithJitter(0x34630b8a000)
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/utils/general.go:26 +0x65
github.com/juicedata/juicefs/pkg/meta.(*baseMeta).cleanupTrash(0xc0002e0500)
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/meta/base.go:1021 +0x3d
created by github.com/juicedata/juicefs/pkg/meta.(*baseMeta).NewSession
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/meta/base.go:272 +0x3d0
goroutine 369 [sleep]:
time.Sleep(0x26e860c4e)
/root/sdk/go1.18.4/src/runtime/time.go:194 +0x12e
github.com/juicedata/juicefs/pkg/utils.SleepWithJitter(0x2540be400)
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/utils/general.go:26 +0x65
github.com/juicedata/juicefs/pkg/meta.(*baseMeta).InitMetrics.func1()
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/meta/base.go:178 +0x32
created by github.com/juicedata/juicefs/pkg/meta.(*baseMeta).InitMetrics
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/meta/base.go:170 +0x2d6
goroutine 403 [IO wait, 1 minutes]:
internal/poll.runtime_pollWait(0x7fdcb76adb08, 0x72)
/root/sdk/go1.18.4/src/runtime/netpoll.go:302 +0x89
internal/poll.(*pollDesc).wait(0xc0005fe080?, 0x0?, 0x0)
/root/sdk/go1.18.4/src/internal/poll/fd_poll_runtime.go:83 +0x32
internal/poll.(*pollDesc).waitRead(...)
/root/sdk/go1.18.4/src/internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Accept(0xc0005fe080)
/root/sdk/go1.18.4/src/internal/poll/fd_unix.go:614 +0x22c
net.(*netFD).accept(0xc0005fe080)
/root/sdk/go1.18.4/src/net/fd_unix.go:172 +0x35
net.(*TCPListener).accept(0xc0005f2108)
/root/sdk/go1.18.4/src/net/tcpsock_posix.go:139 +0x28
net.(*TCPListener).Accept(0xc0005f2108)
/root/sdk/go1.18.4/src/net/tcpsock.go:288 +0x3d
net/http.(*Server).Serve(0xc00239e000, {0x3079b30, 0xc0005f2108})
/root/sdk/go1.18.4/src/net/http/server.go:3039 +0x385
net/http.Serve(...)
/root/sdk/go1.18.4/src/net/http/server.go:2543
github.com/juicedata/juicefs/cmd.exposeMetrics.func1()
/mnt/hgfs/Work/JuiceFS/juicefs/cmd/mount.go:154 +0x4a
created by github.com/juicedata/juicefs/cmd.exposeMetrics
/mnt/hgfs/Work/JuiceFS/juicefs/cmd/mount.go:153 +0x6ca
goroutine 407 [sleep]:
time.Sleep(0x5f5e100)
/root/sdk/go1.18.4/src/runtime/time.go:194 +0x12e
github.com/juicedata/juicefs/pkg/vfs.(*dataWriter).flushAll(0xc0005e4180)
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/vfs/writer.go:462 +0x3d
created by github.com/juicedata/juicefs/pkg/vfs.NewDataWriter
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/vfs/writer.go:432 +0x176
goroutine 408 [sleep]:
time.Sleep(0x3b9aca00)
/root/sdk/go1.18.4/src/runtime/time.go:194 +0x12e
github.com/juicedata/juicefs/pkg/fs.(*FileSystem).cleanupCache(0xc00259a1b0)
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/fs/fs.go:242 +0x3d
created by github.com/juicedata/juicefs/pkg/fs.NewFileSystem
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/fs/fs.go:189 +0x5aa
goroutine 418 [chan receive, 1 minutes]:
github.com/juicedata/juicefs/pkg/gateway.(*jfsObjects).cleanup(0xc0005ee360)
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/gateway/gateway.go:917 +0x7c
created by github.com/juicedata/juicefs/pkg/gateway.NewJFSGateway
/mnt/hgfs/Work/JuiceFS/juicefs/pkg/gateway/gateway.go:60 +0x2b6
goroutine 450 [IO wait]:
internal/poll.runtime_pollWait(0x7fdcb540bfd8, 0x72)
/root/sdk/go1.18.4/src/runtime/netpoll.go:302 +0x89
internal/poll.(*pollDesc).wait(0xc0008b3d00?, 0xc0025c1000?, 0x0)
/root/sdk/go1.18.4/src/internal/poll/fd_poll_runtime.go:83 +0x32
internal/poll.(*pollDesc).waitRead(...)
/root/sdk/go1.18.4/src/internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Read(0xc0008b3d00, {0xc0025c1000, 0x1000, 0x1000})
/root/sdk/go1.18.4/src/internal/poll/fd_unix.go:167 +0x25a
net.(*netFD).Read(0xc0008b3d00, {0xc0025c1000?, 0x0?, 0x4?})
/root/sdk/go1.18.4/src/net/fd_posix.go:55 +0x29
net.(*conn).Read(0xc000302000, {0xc0025c1000?, 0x0?, 0x0?})
/root/sdk/go1.18.4/src/net/net.go:183 +0x45
net/http.(*persistConn).Read(0xc00055aea0, {0xc0025c1000?, 0x466460?, 0xc000262ec8?})
/root/sdk/go1.18.4/src/net/http/transport.go:1929 +0x4e
bufio.(*Reader).fill(0xc0022500c0)
/root/sdk/go1.18.4/src/bufio/bufio.go:106 +0x103
bufio.(*Reader).Peek(0xc0022500c0, 0x1)
/root/sdk/go1.18.4/src/bufio/bufio.go:144 +0x5d
net/http.(*persistConn).readLoop(0xc00055aea0)
/root/sdk/go1.18.4/src/net/http/transport.go:2093 +0x1ac
created by net/http.(*Transport).dialConn
/root/sdk/go1.18.4/src/net/http/transport.go:1750 +0x173e
goroutine 451 [select]:
net/http.(*persistConn).writeLoop(0xc00055aea0)
/root/sdk/go1.18.4/src/net/http/transport.go:2392 +0xf5
created by net/http.(*Transport).dialConn
/root/sdk/go1.18.4/src/net/http/transport.go:1751 +0x1791
goroutine 770 [IO wait]:
internal/poll.runtime_pollWait(0x7fdcb76ada18, 0x72)
/root/sdk/go1.18.4/src/runtime/netpoll.go:302 +0x89
internal/poll.(*pollDesc).wait(0xc0005fe380?, 0xc0012055d1?, 0x0)
/root/sdk/go1.18.4/src/internal/poll/fd_poll_runtime.go:83 +0x32
internal/poll.(*pollDesc).waitRead(...)
/root/sdk/go1.18.4/src/internal/poll/fd_poll_runtime.go:88
internal/poll.(*FD).Read(0xc0005fe380, {0xc0012055d1, 0x1, 0x1})
/root/sdk/go1.18.4/src/internal/poll/fd_unix.go:167 +0x25a
net.(*netFD).Read(0xc0005fe380, {0xc0012055d1?, 0xc000e7b858?, 0xc0006ebf68?})
/root/sdk/go1.18.4/src/net/fd_posix.go:55 +0x29
net.(*conn).Read(0xc0006937f0, {0xc0012055d1?, 0xc000735540?, 0xc00248a118?})
/root/sdk/go1.18.4/src/net/net.go:183 +0x45
net/http.(*connReader).backgroundRead(0xc0012055c0)
/root/sdk/go1.18.4/src/net/http/server.go:672 +0x3f
created by net/http.(*connReader).startBackgroundRead
/root/sdk/go1.18.4/src/net/http/server.go:668 +0xca
How to reproduce it (as minimally and precisely as possible): Just operate as the above
Environment:
- JuiceFS version : 1.0.0-rc3+2022-07-14.d1fe59d2
- OS : BigCloud Enterprise Linux 7.6 (Core)
- Kernel : 3.10.0-957HG.el7.x86_64
This is a issue from Minio (using unsafe iterator), and there is not much we can do here.
You can take a look at this repo, it is a relatively new minio version, and try to avoid this problem.
minio gateway juicefs VS juicefs gateway minio, what's the difference. which gateway version is recommanded?
juicedata/minio is a fork base on MinIO RELEASE.2022-03-05T06-32-39Z version. It implemented the feature of JuiceFS as one of its gateway backend, and supports full functionality of MinIO gateway such as multi-user management while using JuiceFS as a backend.
But juicefs gateway just support basic functions.
After some debug and test, I found this exception is caused by the Go version. The version build by Go1.17 works ok. My bug version is build by Go1.18.4. It seems Go1.18 make a big change than Go1.17.