Lukasz Sojka
Lukasz Sojka
There was an error even before: ``` 14:13:17 Error when waiting for VM longevity-10gb-3h-master-db-node-eastus-2: (OperationPreempted) Operation execution has been preempted by a more recent operation. 14:13:17 Code: OperationPreempted ``` I'm...
From Azure audit logs it looks that we hit spot eviction during creation of VM's. Recently more frequent as we limit resources to only one availability zone. We can try...
I think this one can be closed
I don't think important. Maybe just preparing ES view and link would suffice keeping effort low.
I revised - ES index is already done: https://70f106c98484448dbc4705050eb3f7e9.us-east-1.aws.found.io:9243/app/dashboards#/view/5f06de80-df8a-11ed-baf0-09544f843571?_g=(filters:!(),refreshInterval:(pause:!t,value:0),time:(from:now-90d%2Fd,to:now)) As to test result verification logic - it's quite complicated without clue why it was done this way. I close this...
Also spot segfault during Remove node add node nemesis in the same job: ``` 2024-05-12 05:49:53.663 : (CoreDumpEvent Severity.ERROR) period_type=one-time event_id=06b9adc6-9f2d-4222-aac1-4a2cdca71f89 during_nemesis=RemoveNodeThenAddNode node=Node parallel-topology-schema-changes-mu-db-node-073570cd-6 [54.217.131.124 | 10.4.9.104] (dc name: eu-westscylla_node_west)...
read barrier timeout happened also when replacing node during add-drop column nemesis: ``` 2024-05-12 12:33:46.575 : (DatabaseLogEvent Severity.ERROR) period_type=one-time event_id=28b31151-2096-4c2d-802c-9f41916770fb during_nemesis=TerminateAndReplaceNode,AddDropColumn: type=DATABASE_ERROR regex=(^ERROR|!\s*?ERR).*\[shard.*\] line_number=1526 node=parallel-topology-schema-changes-mu-db-node-073570cd-22 2024-05-12T12:33:46.481+00:00 parallel-topology-schema-changes-mu-db-node-073570cd-22 !ERR | scylla[6913]:...
>> ``` > > blablabla... > > ``` > > @soyacz Those "coredump details" never contain any useful information. (Aside from the backtrace, the buildid and the download URL, which...
Another segv in similar situation: ``` 2024-05-12 12:48:16.037 : (CoreDumpEvent Severity.ERROR) period_type=one-time event_id=83d9b0ea-223c-4927-b639-ada1f78ca8df node=Node longevity-mv-si-4d-master-db-node-49b86348-4 [54.78.234.226 | 10.4.9.115] corefile_url=https://storage.cloud.google.com/upload.scylladb.com/core.scylla.112.999cff74a5134947bc2a6eb9f2fb1c57.7114.1715512837000000/core.scylla.112.999cff74a5134947bc2a6eb9f2fb1c57.7114.1715512837000000.gz backtrace= PID: 7114 (scylla) UID: 112 (scylla) GID: 119 (scylla) Signal:...
Version: 3.11.3-SNAPSHOT