cockroach icon indicating copy to clipboard operation
cockroach copied to clipboard

Sentry: catch.go:24: crdb_internal.show_create_all_routines: runtime error: invalid memory address or nil pointer dereference (1) secondary error attachment | crdb_internal.show_create_all_routines:...

Open cockroach-sentry opened this issue 3 weeks ago • 1 comments

This issue was auto filed by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry Link: https://cockroach-labs.sentry.io/issues/7104134421/?referrer=webhooks_plugin

Panic Message:

catch.go:24: crdb_internal.show_create_all_routines: runtime error: invalid memory address or nil pointer dereference
(1) secondary error attachment
  | crdb_internal.show_create_all_routines: runtime error: invalid memory address or nil pointer dereference
  | (1) attached stack trace
  |   -- stack trace:
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*InternalExecutor).execInternal.func1.1
  |   | 	pkg/sql/internal.go:1263
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*rowsIterator).Close
  |   | 	pkg/sql/internal.go:608
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*rowsIterator).Next
  |   | 	pkg/sql/internal.go:584
  |   | github.com/cockroachdb/cockroach/pkg/sql/sem/builtins.getRoutineCreateStatementIds
  |   | 	pkg/sql/sem/builtins/show_create_all_routines_builtin.go:58
  |   | github.com/cockroachdb/cockroach/pkg/sql/sem/builtins.(*showCreateAllRoutinesGenerator).Start
  |   | 	pkg/sql/sem/builtins/generator_builtins.go:3343
  |   | github.com/cockroachdb/cockroach/pkg/sql/rowexec.(*projectSetProcessor).nextInputRow
  |   | 	pkg/sql/rowexec/project_set.go:208
  |   | github.com/cockroachdb/cockroach/pkg/sql/rowexec.(*projectSetProcessor).Next
  |   | 	pkg/sql/rowexec/project_set.go:302
  |   | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*FlowCoordinator).next
  |   | 	pkg/sql/colflow/flow_coordinator.go:119
  |   | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*FlowCoordinator).nextAdapter
  |   | 	pkg/sql/colflow/flow_coordinator.go:136
  |   | github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError
  |   | 	pkg/sql/colexecerror/error.go:162
  |   | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*FlowCoordinator).Next
  |   | 	pkg/sql/colflow/flow_coordinator.go:141
  |   | github.com/cockroachdb/cockroach/pkg/sql/execinfra.Run
  |   | 	pkg/sql/execinfra/base.go:193
  |   | github.com/cockroachdb/cockroach/pkg/sql/execinfra.(*ProcessorBaseNoHelper).Run
  |   | 	pkg/sql/execinfra/processorsbase.go:749
  |   | github.com/cockroachdb/cockroach/pkg/sql/flowinfra.(*FlowBase).Run
  |   | 	pkg/sql/flowinfra/flow.go:574
  |   | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*vectorizedFlow).Run
  |   | 	pkg/sql/colflow/vectorized_flow.go:301
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).Run
  |   | 	pkg/sql/distsql_running.go:1072
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRun
  |   | 	pkg/sql/distsql_running.go:2334
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRunAll.func3
  |   | 	pkg/sql/distsql_running.go:2033
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRunAll
  |   | 	pkg/sql/distsql_running.go:2036
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithDistSQLEngine
  |   | 	pkg/sql/conn_executor_exec.go:3381
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).dispatchToExecutionEngine
  |   | 	pkg/sql/conn_executor_exec.go:2907
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmtInOpenState
  |   | 	pkg/sql/conn_executor_exec.go:1067
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmt.func2
  |   | 	pkg/sql/conn_executor_exec.go:175
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithProfiling
  |   | 	pkg/sql/conn_executor_exec.go:4415
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmt
  |   | 	pkg/sql/conn_executor_exec.go:174
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd.func1
  |   | 	pkg/sql/conn_executor.go:2378
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd
  |   | 	pkg/sql/conn_executor.go:2383
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).run
  |   | 	pkg/sql/conn_executor.go:2291
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn
  |   | 	pkg/sql/conn_executor.go:1067
  |   | github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*conn).processCommands
  |   | 	pkg/sql/pgwire/conn.go:253
  |   | github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*Server).serveImpl.func4
  |   | 	pkg/sql/pgwire/server.go:1228
  | Wraps: (2) crdb_internal.show_create_all_routines
  | Wraps: (3)
  | Wraps: (4) assertion failure
  | Wraps: (5) attached stack trace
  |   -- stack trace:
  |   | github.com/cockroachdb/cockroach/pkg/util/errorutil.ShouldCatch
  |   | 	pkg/util/errorutil/catch.go:24
  |   | github.com/cockroachdb/cockroach/pkg/sql.setupGenerator.func3.1.1
  |   | 	pkg/sql/virtual_table.go:130
  |   | runtime.gopanic
  |   | 	GOROOT/src/runtime/panic.go:791
  |   | runtime.panicmem
  |   | 	GOROOT/src/runtime/panic.go:262
  |   | runtime.sigpanic
  |   | 	GOROOT/src/runtime/signal_unix.go:917
  |   | github.com/cockroachdb/cockroach/pkg/sql/catalog.FindColumnByTreeName
  |   | 	pkg/sql/catalog/table_elements.go:1296
  |   | github.com/cockroachdb/cockroach/pkg/sql/catalog.MustFindColumnByTreeName
  |   | 	pkg/sql/catalog/table_elements.go:1307
  |   | github.com/cockroachdb/cockroach/pkg/sql/catalog/schemaexpr.FormatExprForDisplay.makeColumnLookupFnForTableDesc.func1
  |   | 	pkg/sql/catalog/schemaexpr/expr.go:253
  |   | github.com/cockroachdb/cockroach/pkg/sql/catalog/schemaexpr.ReplaceColumnVars.func1
  |   | 	pkg/sql/catalog/schemaexpr/column.go:298
  |   | github.com/cockroachdb/cockroach/pkg/sql/sem/tree.(*simpleVisitor).VisitPre
  |   | 	pkg/sql/sem/tree/walk.go:2170
  |   | github.com/cockroachdb/cockroach/pkg/sql/sem/tree.WalkExpr
  |   | 	pkg/sql/sem/tree/walk.go:892
  |   | github.com/cockroachdb/cockroach/pkg/sql/sem/tree.(*CastExpr).Walk
  |   | 	pkg/sql/sem/tree/walk.go:157
  |   | github.com/cockroachdb/cockroach/pkg/sql/sem/tree.WalkExpr
  |   | 	pkg/sql/sem/tree/walk.go:895
  |   | github.com/cockroachdb/cockroach/pkg/sql/sem/tree.SimpleVisit
  |   | 	pkg/sql/sem/tree/walk.go:2189
  |   | github.com/cockroachdb/cockroach/pkg/sql/catalog/schemaexpr.ReplaceColumnVars
  |   | 	pkg/sql/catalog/schemaexpr/column.go:281
  |   | github.com/cockroachdb/cockroach/pkg/sql/catalog/schemaexpr.deserializeExprForFormatting
  |   | 	pkg/sql/catalog/schemaexpr/expr.go:352
  |   | github.com/cockroachdb/cockroach/pkg/sql/catalog/schemaexpr.parseExprForDisplayImpl
  |   | 	pkg/sql/catalog/schemaexpr/expr.go:329
  |   | github.com/cockroachdb/cockroach/pkg/sql/catalog/schemaexpr.formatExprForDisplayImpl
  |   | 	pkg/sql/catalog/schemaexpr/expr.go:301
  |   | github.com/cockroachdb/cockroach/pkg/sql/catalog/schemaexpr.FormatExprForDisplay
  |   | 	pkg/sql/catalog/schemaexpr/expr.go:214
  |   | github.com/cockroachdb/cockroach/pkg/sql.formatFunctionQueryTypesForDisplay.func1
  |   | 	pkg/sql/show_create_clauses.go:429
  |   | github.com/cockroachdb/cockroach/pkg/sql/sem/tree.(*simpleVisitor).VisitPre
  |   | 	pkg/sql/sem/tree/walk.go:2170
  |   | github.com/cockroachdb/cockroach/pkg/sql/sem/tree.WalkExpr
  |   | 	pkg/sql/sem/tree/walk.go:892
  |   | github.com/cockroachdb/cockroach/pkg/sql/sem/tree.SimpleVisit
  |   | 	pkg/sql/sem/tree/walk.go:2189
  |   | github.com/cockroachdb/cockroach/pkg/sql/sem/plpgsqltree.(*SQLStmtVisitor).visitExpr
  |   | 	pkg/sql/sem/plpgsqltree/visitor.go:47
  |   | github.com/cockroachdb/cockroach/pkg/sql/sem/plpgsqltree.(*SQLStmtVisitor).Visit
  |   | 	pkg/sql/sem/plpgsqltree/visitor.go:184
  |   | github.com/cockroachdb/cockroach/pkg/sql/sem/plpgsqltree.(*Return).WalkStmt
  |   | 	pkg/sql/sem/plpgsqltree/statements.go:821
  |   | github.com/cockroachdb/cockroach/pkg/sql/sem/plpgsqltree.(*Block).WalkStmt
  |   | 	pkg/sql/sem/plpgsqltree/statements.go:116
  |   | github.com/cockroachdb/cockroach/pkg/sql/sem/plpgsqltree.Walk
  |   | 	pkg/sql/sem/plpgsqltree/visitor.go:23
  |   | github.com/cockroachdb/cockroach/pkg/sql.formatFunctionQueryTypesForDisplay
  |   | 	pkg/sql/show_create_clauses.go:508
  |   | github.com/cockroachdb/cockroach/pkg/sql.init.createRoutinePopulate.func911
  |   | 	pkg/sql/crdb_internal.go:3374
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*virtualDefEntry).getPlanInfo.func1.1
  |   | 	pkg/sql/virtual_schema.go:694
  |   | github.com/cockroachdb/cockroach/pkg/sql.setupGenerator.func3.1
  |   | 	pkg/sql/virtual_table....
Stacktrace (expand for inline code snippets):

src/runtime/asm_amd64.s#L1699-L1701 pkg/sql/pgwire/server.go#L1227-L1229 pkg/sql/pgwire/conn.go#L252-L254 pkg/sql/conn_executor.go#L1066-L1068 pkg/sql/conn_executor.go#L2290-L2292 pkg/sql/conn_executor.go#L2382-L2384 pkg/sql/conn_executor.go#L2377-L2379 pkg/sql/conn_executor_exec.go#L173-L175 pkg/sql/conn_executor_exec.go#L4414-L4416 pkg/sql/conn_executor_exec.go#L174-L176 pkg/sql/conn_executor_exec.go#L1066-L1068 pkg/sql/conn_executor_exec.go#L2906-L2908 pkg/sql/conn_executor_exec.go#L3380-L3382 pkg/sql/distsql_running.go#L2035-L2037 pkg/sql/distsql_running.go#L2032-L2034 pkg/sql/distsql_running.go#L2333-L2335 pkg/sql/distsql_running.go#L1071-L1073 pkg/sql/colflow/vectorized_flow.go#L300-L302 pkg/sql/flowinfra/flow.go#L573-L575 pkg/sql/execinfra/processorsbase.go#L748-L750 pkg/sql/execinfra/base.go#L192-L194 pkg/sql/colflow/flow_coordinator.go#L140-L142 pkg/sql/colexecerror/error.go#L161-L163 pkg/sql/colflow/flow_coordinator.go#L135-L137 pkg/sql/colflow/flow_coordinator.go#L118-L120 pkg/sql/rowexec/project_set.go#L301-L303 pkg/sql/rowexec/project_set.go#L207-L209 pkg/sql/sem/builtins/generator_builtins.go#L3342-L3344 pkg/sql/sem/builtins/show_create_all_routines_builtin.go#L57-L59 pkg/sql/internal.go#L583-L585 pkg/sql/internal.go#L607-L609 pkg/sql/internal.go#L1262-L1264 pkg/sql/virtual_table.go#L137-L139 pkg/sql/virtual_schema.go#L693-L695 pkg/sql/crdb_internal.go#L3373-L3375 pkg/sql/show_create_clauses.go#L507-L509 pkg/sql/sem/plpgsqltree/visitor.go#L22-L24 pkg/sql/sem/plpgsqltree/statements.go#L115-L117 pkg/sql/sem/plpgsqltree/statements.go#L820-L822 pkg/sql/sem/plpgsqltree/visitor.go#L183-L185 pkg/sql/sem/plpgsqltree/visitor.go#L46-L48 pkg/sql/sem/tree/walk.go#L2188-L2190 pkg/sql/sem/tree/walk.go#L891-L893 pkg/sql/sem/tree/walk.go#L2169-L2171 pkg/sql/show_create_clauses.go#L428-L430 pkg/sql/catalog/schemaexpr/expr.go#L213-L215 pkg/sql/catalog/schemaexpr/expr.go#L300-L302 pkg/sql/catalog/schemaexpr/expr.go#L328-L330 pkg/sql/catalog/schemaexpr/expr.go#L351-L353 pkg/sql/catalog/schemaexpr/column.go#L280-L282 pkg/sql/sem/tree/walk.go#L2188-L2190 pkg/sql/sem/tree/walk.go#L894-L896 pkg/sql/sem/tree/walk.go#L156-L158 pkg/sql/sem/tree/walk.go#L891-L893 pkg/sql/sem/tree/walk.go#L2169-L2171 pkg/sql/catalog/schemaexpr/column.go#L297-L299 pkg/sql/catalog/schemaexpr/expr.go#L252-L254 pkg/sql/catalog/table_elements.go#L1306-L1308 pkg/sql/catalog/table_elements.go#L1295-L1297 GOROOT/src/runtime/signal_unix.go#L916-L918 GOROOT/src/runtime/panic.go#L261-L263 GOROOT/src/runtime/panic.go#L790-L792 pkg/sql/virtual_table.go#L129-L131 pkg/util/errorutil/catch.go#L23-L25

src/runtime/asm_amd64.s in runtime.goexit at line 1700
pkg/sql/pgwire/server.go in pkg/sql/pgwire.(*Server).serveImpl.func4 at line 1228
pkg/sql/pgwire/conn.go in pkg/sql/pgwire.(*conn).processCommands at line 253
pkg/sql/conn_executor.go in pkg/sql.(*Server).ServeConn at line 1067
pkg/sql/conn_executor.go in pkg/sql.(*connExecutor).run at line 2291
pkg/sql/conn_executor.go in pkg/sql.(*connExecutor).execCmd at line 2383
pkg/sql/conn_executor.go in pkg/sql.(*connExecutor).execCmd.func1 at line 2378
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execStmt at line 174
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execWithProfiling at line 4415
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execStmt.func2 at line 175
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execStmtInOpenState at line 1067
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).dispatchToExecutionEngine at line 2907
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execWithDistSQLEngine at line 3381
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).PlanAndRunAll at line 2036
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).PlanAndRunAll.func3 at line 2033
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).PlanAndRun at line 2334
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).Run at line 1072
pkg/sql/colflow/vectorized_flow.go in pkg/sql/colflow.(*vectorizedFlow).Run at line 301
pkg/sql/flowinfra/flow.go in pkg/sql/flowinfra.(*FlowBase).Run at line 574
pkg/sql/execinfra/processorsbase.go in pkg/sql/execinfra.(*ProcessorBaseNoHelper).Run at line 749
pkg/sql/execinfra/base.go in pkg/sql/execinfra.Run at line 193
pkg/sql/colflow/flow_coordinator.go in pkg/sql/colflow.(*FlowCoordinator).Next at line 141
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError at line 162
pkg/sql/colflow/flow_coordinator.go in pkg/sql/colflow.(*FlowCoordinator).nextAdapter at line 136
pkg/sql/colflow/flow_coordinator.go in pkg/sql/colflow.(*FlowCoordinator).next at line 119
pkg/sql/rowexec/project_set.go in pkg/sql/rowexec.(*projectSetProcessor).Next at line 302
pkg/sql/rowexec/project_set.go in pkg/sql/rowexec.(*projectSetProcessor).nextInputRow at line 208
pkg/sql/sem/builtins/generator_builtins.go in pkg/sql/sem/builtins.(*showCreateAllRoutinesGenerator).Start at line 3343
pkg/sql/sem/builtins/show_create_all_routines_builtin.go in pkg/sql/sem/builtins.getRoutineCreateStatementIds at line 58
pkg/sql/internal.go in pkg/sql.(*rowsIterator).Next at line 584
pkg/sql/internal.go in pkg/sql.(*rowsIterator).Close at line 608
pkg/sql/internal.go in pkg/sql.(*InternalExecutor).execInternal.func1.1 at line 1263
pkg/sql/virtual_table.go in pkg/sql.setupGenerator.func3.1 at line 138
pkg/sql/virtual_schema.go in pkg/sql.(*virtualDefEntry).getPlanInfo.func1.1 at line 694
pkg/sql/crdb_internal.go in pkg/sql.init.createRoutinePopulate.func911 at line 3374
pkg/sql/show_create_clauses.go in pkg/sql.formatFunctionQueryTypesForDisplay at line 508
pkg/sql/sem/plpgsqltree/visitor.go in pkg/sql/sem/plpgsqltree.Walk at line 23
pkg/sql/sem/plpgsqltree/statements.go in pkg/sql/sem/plpgsqltree.(*Block).WalkStmt at line 116
pkg/sql/sem/plpgsqltree/statements.go in pkg/sql/sem/plpgsqltree.(*Return).WalkStmt at line 821
pkg/sql/sem/plpgsqltree/visitor.go in pkg/sql/sem/plpgsqltree.(*SQLStmtVisitor).Visit at line 184
pkg/sql/sem/plpgsqltree/visitor.go in pkg/sql/sem/plpgsqltree.(*SQLStmtVisitor).visitExpr at line 47
pkg/sql/sem/tree/walk.go in pkg/sql/sem/tree.SimpleVisit at line 2189
pkg/sql/sem/tree/walk.go in pkg/sql/sem/tree.WalkExpr at line 892
pkg/sql/sem/tree/walk.go in pkg/sql/sem/tree.(*simpleVisitor).VisitPre at line 2170
pkg/sql/show_create_clauses.go in pkg/sql.formatFunctionQueryTypesForDisplay.func1 at line 429
pkg/sql/catalog/schemaexpr/expr.go in pkg/sql/catalog/schemaexpr.FormatExprForDisplay at line 214
pkg/sql/catalog/schemaexpr/expr.go in pkg/sql/catalog/schemaexpr.formatExprForDisplayImpl at line 301
pkg/sql/catalog/schemaexpr/expr.go in pkg/sql/catalog/schemaexpr.parseExprForDisplayImpl at line 329
pkg/sql/catalog/schemaexpr/expr.go in pkg/sql/catalog/schemaexpr.deserializeExprForFormatting at line 352
pkg/sql/catalog/schemaexpr/column.go in pkg/sql/catalog/schemaexpr.ReplaceColumnVars at line 281
pkg/sql/sem/tree/walk.go in pkg/sql/sem/tree.SimpleVisit at line 2189
pkg/sql/sem/tree/walk.go in pkg/sql/sem/tree.WalkExpr at line 895
pkg/sql/sem/tree/walk.go in pkg/sql/sem/tree.(*CastExpr).Walk at line 157
pkg/sql/sem/tree/walk.go in pkg/sql/sem/tree.WalkExpr at line 892
pkg/sql/sem/tree/walk.go in pkg/sql/sem/tree.(*simpleVisitor).VisitPre at line 2170
pkg/sql/catalog/schemaexpr/column.go in pkg/sql/catalog/schemaexpr.ReplaceColumnVars.func1 at line 298
pkg/sql/catalog/schemaexpr/expr.go in pkg/sql/catalog/schemaexpr.FormatExprForDisplay.makeColumnLookupFnForTableDesc.func1 at line 253
pkg/sql/catalog/table_elements.go in pkg/sql/catalog.MustFindColumnByTreeName at line 1307
pkg/sql/catalog/table_elements.go in pkg/sql/catalog.FindColumnByTreeName at line 1296
GOROOT/src/runtime/signal_unix.go in runtime.sigpanic at line 917
GOROOT/src/runtime/panic.go in runtime.panicmem at line 262
GOROOT/src/runtime/panic.go in runtime.gopanic at line 791
pkg/sql/virtual_table.go in pkg/sql.setupGenerator.func3.1.1 at line 130
pkg/util/errorutil/catch.go in pkg/util/errorutil.ShouldCatch at line 24

Tags

Tag Value
Command start-single-node
Environment v25.4.1
Go Version go1.23.12 X:nocoverageredesign
Platform linux amd64
Distribution CCL
Cockroach Release v25.4.1
Cockroach SHA 60d802bd0bcb2c1aa81a4b5fd73fb4aa13bb5114
# of CPUs 12
# of Goroutines 529

Jira issue: CRDB-57751

cockroach-sentry avatar Dec 11 '25 12:12 cockroach-sentry

CC'ing via the CODEOWNERS-based sentry heuristic:

  • @cockroachdb/sql-foundations

Sentry issue cause: pkg/sql/catalog/table_elements.go

:owl: Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.

blathers-crl[bot] avatar Dec 11 '25 12:12 blathers-crl[bot]

not actionable

rafiss avatar Dec 16 '25 19:12 rafiss