Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Sentry: error.go:30: pebble/table: table 000623: block 2684001/8325: × checksum mismatch 0 != bc5a2e5b (1) attached stack trace -- stack trace: | runtime.gopanic | GOROOT/src/runtime/panic.go:... #143046

Closed
cockroach-sentry opened this issue Mar 18, 2025 · 2 comments
Closed

Sentry: error.go:30: pebble/table: table 000623: block 2684001/8325: × checksum mismatch 0 != bc5a2e5b (1) attached stack trace -- stack trace: | runtime.gopanic | GOROOT/src/runtime/panic.go:... #143046

cockroach-sentry opened this issue Mar 18, 2025 · 2 comments
Labels
A-storage Relating to our storage engine (Pebble) on-disk storage. branch-release-25.1 C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. O-sentry Originated from an in-the-wild panic report. T-storage Storage Team X-blathers-triaged blathers was able to find an owner

Comments

@cockroach-sentry
Copy link
Collaborator

cockroach-sentry commented Mar 18, 2025 •
edited by cockroach-jira-scripts
Loading

This issue was auto filed by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry Link: https://cockroach-labs.sentry.io/issues/6419453940/?referrer=webhooks_plugin

Panic Message:

error.go:30: pebble/table: table 000623: block 2684001/8325: × checksum mismatch 0 != bc5a2e5b
(1) attached stack trace
  -- stack trace:
  | runtime.gopanic
  | 	GOROOT/src/runtime/panic.go:770
  | github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError.func1
  | 	pkg/sql/colexecerror/error.go:137
  | runtime.gopanic
  | 	GOROOT/src/runtime/panic.go:770
  | github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError.func1
  | 	pkg/sql/colexecerror/error.go:137
  | runtime.gopanic
  | 	GOROOT/src/runtime/panic.go:770
  | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).recover
  | 	pkg/util/stop/stopper.go:226
  | runtime.gopanic
  | 	GOROOT/src/runtime/panic.go:770
  | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).SendWithWriteBytes.func1
  | 	pkg/kv/kvserver/store_send.go:104
  | runtime.gopanic
  | 	GOROOT/src/runtime/panic.go:770
  | github.com/cockroachdb/cockroach/pkg/storage.(*pebbleIterator).destroy
  | 	pkg/storage/pebble_iterator.go:1017
  | github.com/cockroachdb/cockroach/pkg/storage.(*pebbleReadOnly).Close
  | 	pkg/storage/pebble.go:2763
  | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeReadOnlyBatch
  | 	pkg/kv/kvserver/replica_read.go:235
  | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
  | 	pkg/kv/kvserver/replica_send.go:498
  | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).SendWithWriteBytes
  | 	pkg/kv/kvserver/replica_send.go:173
  | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).SendWithWriteBytes
  | 	pkg/kv/kvserver/store_send.go:188
  | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).SendWithWriteBytes
  | 	pkg/kv/kvserver/stores.go:199
  | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
  | 	pkg/server/node.go:1671
  | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
  | 	pkg/server/node.go:1872
  | github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.func1
  | 	pkg/rpc/context.go:718
  | github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.ServerInterceptor.func12
  | 	pkg/util/tracing/grpcinterceptor/grpc_interceptor.go:96
  | github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4
  | 	pkg/rpc/context.go:829
  | github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.func3
  | 	pkg/rpc/context.go:165
  | github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4
  | 	pkg/rpc/context.go:829
  | github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.func1.1
  | 	pkg/rpc/context.go:132
  | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
  | 	pkg/util/stop/stopper.go:349
  | github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.func1
  | 	pkg/rpc/context.go:130
  | github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4
  | 	pkg/rpc/context.go:829
  | github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.func2
  | 	pkg/rpc/context.go:728
  | github.com/cockroachdb/cockroach/pkg/rpc.NewContext.ClientInterceptor.func8
  | 	pkg/util/tracing/grpcinterceptor/grpc_interceptor.go:236
  | github.com/cockroachdb/cockroach/pkg/rpc.getChainUnaryInvoker.func1
  | 	pkg/rpc/context.go:913
  | github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.func3
  | 	pkg/rpc/context.go:798
Wraps: (2) attached stack trace
  -- stack trace:
  | github.com/cockroachdb/pebble/sstable/block.(*Reader).doRead
  | 	external/com_github_cockroachdb_pebble/sstable/block/block.go:509
  | github.com/cockroachdb/pebble/sstable/block.(*Reader).Read
  | 	external/com_github_cockroachdb_pebble/sstable/block/block.go:459
  | github.com/cockroachdb/pebble/sstable.(*Reader).readDataBlock
  | 	external/com_github_cockroachdb_pebble/sstable/reader.go:336
  | github.com/cockroachdb/pebble/sstable.(*singleLevelIterator[...]).loadDataBlock
  | 	external/com_github_cockroachdb_pebble/sstable/reader_iter_single_lvl.go:528
  | github.com/cockroachdb/pebble/sstable.(*singleLevelIterator[...]).skipForward
  | 	external/com_github_cockroachdb_pebble/sstable/reader_iter_single_lvl.go:1386
  | github.com/cockroachdb/pebble/sstable.(*singleLevelIterator[...]).Next
  | 	external/com_github_cockroachdb_pebble/sstable/reader_iter_single_lvl.go:1282
  | github.com/cockroachdb/pebble.(*levelIter).Next
  | 	external/com_github_cockroachdb_pebble/level_iter.go:766
  | github.com/cockroachdb/pebble.(*mergingIter).nextEntry
  | 	external/com_github_cockroachdb_pebble/merging_iter.go:541
  | github.com/cockroachdb/pebble.(*mergingIter).Next
  | 	external/com_github_cockroachdb_pebble/merging_iter.go:1189
  | github.com/cockroachdb/pebble.(*lazyCombinedIter).Next
  | 	external/com_github_cockroachdb_pebble/range_keys.go:663
  | github.com/cockroachdb/pebble.(*Iterator).internalNextPrefix
  | 	external/com_github_cockroachdb_pebble/iterator.go:1873
  | github.com/cockroachdb/pebble.(*Iterator).nextPrefix
  | 	external/com_github_cockroachdb_pebble/iterator.go:1777
  | github.com/cockroachdb/pebble.(*Iterator).NextPrefix
  | 	external/com_github_cockroachdb_pebble/iterator.go:1743
  | github.com/cockroachdb/cockroach/pkg/storage.(*pebbleIterator).NextKey
  | 	pkg/storage/pebble_iterator.go:491
  | github.com/cockroachdb/cockroach/pkg/storage.(*pebbleMVCCScanner).nextKey
  | 	pkg/storage/pebble_mvcc_scanner.go:1122
  | github.com/cockroachdb/cockroach/pkg/storage.(*pebbleMVCCScanner).advanceKeyForward
  | 	pkg/storage/pebble_mvcc_scanner.go:1186
  | github.com/cockroachdb/cockroach/pkg/storage.(*pebbleMVCCScanner).advance
  | 	pkg/storage/pebble_mvcc_scanner.go:648
  | github.com/cockroachdb/cockroach/pkg/storage.(*pebbleMVCCScanner).scan
  | 	pkg/storage/pebble_mvcc_scanner.go:686
  | github.com/cockroachdb/cockroach/pkg/storage.mvccScanToBytes
  | 	pkg/storage/mvcc.go:4603
  | github.com/cockroachdb/cockroach/pkg/storage.MVCCScanToBytes
  | 	pkg/storage/mvcc.go:4959
  | github.com/cockroachdb/cockroach/pkg/kv/kvserver/batcheval.Scan
  | 	pkg/kv/kvserver/batcheval/cmd_scan.go:71
  | github.com/cockroachdb/cockroach/pkg/kv/kvserver.evaluateCommand
  | 	pkg/kv/kvserver/replica_evaluate.go:487
  | github.com/cockroachdb/cockroach/pkg/kv/kvserver.evaluateBatch
  | 	pkg/kv/kvserver/replica_evaluate.go:304
  | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeReadOnlyBatchWithServersideRefreshes
  | 	pkg/kv/kvserver/replica_read.go:471
  | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeReadOnlyBatch
  | 	pkg/kv/kvserver/replica_read.go:131
  | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
  | 	pkg/kv/kvserver/replica_send.go:498
  | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).SendWithWriteBytes
  | 	pkg/kv/kvserver/replica_send.go:173
  | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).SendWithWriteBytes
  | 	pkg/kv/kvserver/store_send.go:188
  | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).SendWithWriteBytes
  | 	pkg/kv/kvserver/stores.go:199
  | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
  | 	pkg/server/node.go:1671
  | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
  | 	pkg/server/node.go:1872
Wraps: (3) pebble/table: table 000623
Wraps: (4) forced error mark
  | ×
  | github.com/cockroachdb/errors/withstack/*withstack.withStack::
Wraps: (5) attached stack trace
  -- stack trace:
  | github.com/cockroachdb/pebble/internal/base.CorruptionErrorf
  | 	external/com_github_cockroachdb_pebble/internal/base/error.go:30
  | github.com/cockroachdb/pebble/sstable/block.ValidateChecksum
  | 	external/com_github_cockroachdb_pebble/sstable/block/block.go:171
  | github.com/cockroachdb/pebble/sstable/block.(*Reader).doRead
  | 	external/com_github_cockroachdb_pebble/sstable/block/block.go:507
  | github.com/cockroachdb/pebble/sstable/block.(*Reader).Read
  | 	external/com_github_cockroachdb_pebble/sstable/block/block.go:459
  | github.com/cockro...
Stacktrace (expand for inline code snippets):

pkg/rpc/context.go#L920-L922
pkg/rpc/context.go#L797-L799
pkg/rpc/context.go#L912-L914
pkg/util/tracing/grpcinterceptor/grpc_interceptor.go#L235-L237
pkg/rpc/context.go#L727-L729
pkg/rpc/context.go#L828-L830
pkg/rpc/context.go#L129-L131
pkg/util/stop/stopper.go#L348-L350
pkg/rpc/context.go#L131-L133
pkg/rpc/context.go#L828-L830
pkg/rpc/context.go#L164-L166
pkg/rpc/context.go#L828-L830
pkg/util/tracing/grpcinterceptor/grpc_interceptor.go#L95-L97
pkg/rpc/context.go#L717-L719
pkg/server/node.go#L1871-L1873
pkg/server/node.go#L1670-L1672
pkg/kv/kvserver/stores.go#L198-L200
pkg/kv/kvserver/store_send.go#L187-L189
pkg/kv/kvserver/replica_send.go#L172-L174
pkg/kv/kvserver/replica_send.go#L497-L499
pkg/kv/kvserver/replica_read.go#L234-L236
pkg/storage/pebble.go#L2762-L2764
pkg/storage/pebble_iterator.go#L1016-L1018
GOROOT/src/runtime/panic.go#L769-L771
pkg/kv/kvserver/store_send.go#L103-L105
GOROOT/src/runtime/panic.go#L769-L771
pkg/util/stop/stopper.go#L225-L227
GOROOT/src/runtime/panic.go#L769-L771
pkg/sql/colexecerror/error.go#L136-L138
GOROOT/src/runtime/panic.go#L769-L771
pkg/sql/colexecerror/error.go#L136-L138
GOROOT/src/runtime/panic.go#L769-L771
pkg/rpc/context.go#L717-L719
pkg/server/node.go#L1871-L1873
pkg/server/node.go#L1670-L1672
pkg/kv/kvserver/stores.go#L198-L200
pkg/kv/kvserver/store_send.go#L187-L189
pkg/kv/kvserver/replica_send.go#L172-L174
pkg/kv/kvserver/replica_send.go#L497-L499
pkg/kv/kvserver/replica_read.go#L130-L132
pkg/kv/kvserver/replica_read.go#L470-L472
pkg/kv/kvserver/replica_evaluate.go#L303-L305
pkg/kv/kvserver/replica_evaluate.go#L486-L488
pkg/kv/kvserver/batcheval/cmd_scan.go#L70-L72
pkg/storage/mvcc.go#L4958-L4960
pkg/storage/mvcc.go#L4602-L4604
pkg/storage/pebble_mvcc_scanner.go#L685-L687
pkg/storage/pebble_mvcc_scanner.go#L647-L649
pkg/storage/pebble_mvcc_scanner.go#L1185-L1187
pkg/storage/pebble_mvcc_scanner.go#L1121-L1123
pkg/storage/pebble_iterator.go#L490-L492
external/com_github_cockroachdb_pebble/iterator.go#L1742-L1744
external/com_github_cockroachdb_pebble/iterator.go#L1776-L1778
external/com_github_cockroachdb_pebble/iterator.go#L1872-L1874
external/com_github_cockroachdb_pebble/range_keys.go#L662-L664
external/com_github_cockroachdb_pebble/merging_iter.go#L1188-L1190
external/com_github_cockroachdb_pebble/merging_iter.go#L540-L542
external/com_github_cockroachdb_pebble/level_iter.go#L765-L767
external/com_github_cockroachdb_pebble/sstable/reader_iter_single_lvl.go#L1281-L1283
external/com_github_cockroachdb_pebble/sstable/reader_iter_single_lvl.go#L1385-L1387
external/com_github_cockroachdb_pebble/sstable/reader_iter_single_lvl.go#L527-L529
external/com_github_cockroachdb_pebble/sstable/reader.go#L335-L337
external/com_github_cockroachdb_pebble/sstable/block/block.go#L458-L460
external/com_github_cockroachdb_pebble/sstable/block/block.go#L508-L510
pkg/server/node.go#L1670-L1672
pkg/kv/kvserver/stores.go#L198-L200
pkg/kv/kvserver/store_send.go#L187-L189
pkg/kv/kvserver/replica_send.go#L172-L174
pkg/kv/kvserver/replica_send.go#L497-L499
pkg/kv/kvserver/replica_read.go#L130-L132
pkg/kv/kvserver/replica_read.go#L470-L472
pkg/kv/kvserver/replica_evaluate.go#L303-L305
pkg/kv/kvserver/replica_evaluate.go#L486-L488
pkg/kv/kvserver/batcheval/cmd_scan.go#L70-L72
pkg/storage/mvcc.go#L4958-L4960
pkg/storage/mvcc.go#L4602-L4604
pkg/storage/pebble_mvcc_scanner.go#L685-L687
pkg/storage/pebble_mvcc_scanner.go#L647-L649
pkg/storage/pebble_mvcc_scanner.go#L1185-L1187
pkg/storage/pebble_mvcc_scanner.go#L1121-L1123
pkg/storage/pebble_iterator.go#L490-L492
external/com_github_cockroachdb_pebble/iterator.go#L1742-L1744
external/com_github_cockroachdb_pebble/iterator.go#L1776-L1778
external/com_github_cockroachdb_pebble/iterator.go#L1872-L1874
external/com_github_cockroachdb_pebble/range_keys.go#L662-L664
external/com_github_cockroachdb_pebble/merging_iter.go#L1188-L1190
external/com_github_cockroachdb_pebble/merging_iter.go#L540-L542
external/com_github_cockroachdb_pebble/level_iter.go#L765-L767
external/com_github_cockroachdb_pebble/sstable/reader_iter_single_lvl.go#L1281-L1283
external/com_github_cockroachdb_pebble/sstable/reader_iter_single_lvl.go#L1385-L1387
external/com_github_cockroachdb_pebble/sstable/reader_iter_single_lvl.go#L527-L529
external/com_github_cockroachdb_pebble/sstable/reader.go#L335-L337
external/com_github_cockroachdb_pebble/sstable/block/block.go#L458-L460
external/com_github_cockroachdb_pebble/sstable/block/block.go#L506-L508
external/com_github_cockroachdb_pebble/sstable/block/block.go#L170-L172
external/com_github_cockroachdb_pebble/internal/base/error.go#L29-L31

pkg/rpc/context.go in pkg/rpc.internalClientAdapter.Batch at line 921
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.func3 at line 798
pkg/rpc/context.go in pkg/rpc.getChainUnaryInvoker.func1 at line 913
pkg/util/tracing/grpcinterceptor/grpc_interceptor.go in pkg/rpc.NewContext.ClientInterceptor.func8 at line 236
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.func2 at line 728
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4 at line 829
pkg/rpc/context.go in pkg/rpc.NewServerEx.func1 at line 130
pkg/util/stop/stopper.go in pkg/util/stop.(*Stopper).RunTaskWithErr at line 349
pkg/rpc/context.go in pkg/rpc.NewServerEx.func1.1 at line 132
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4 at line 829
pkg/rpc/context.go in pkg/rpc.NewServerEx.func3 at line 165
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4 at line 829
pkg/util/tracing/grpcinterceptor/grpc_interceptor.go in pkg/rpc.NewServerEx.ServerInterceptor.func12 at line 96
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.func1 at line 718
pkg/server/node.go in pkg/server.(*Node).Batch at line 1872
pkg/server/node.go in pkg/server.(*Node).batchInternal at line 1671
pkg/kv/kvserver/stores.go in pkg/kv/kvserver.(*Stores).SendWithWriteBytes at line 199
pkg/kv/kvserver/store_send.go in pkg/kv/kvserver.(*Store).SendWithWriteBytes at line 188
pkg/kv/kvserver/replica_send.go in pkg/kv/kvserver.(*Replica).SendWithWriteBytes at line 173
pkg/kv/kvserver/replica_send.go in pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries at line 498
pkg/kv/kvserver/replica_read.go in pkg/kv/kvserver.(*Replica).executeReadOnlyBatch at line 235
pkg/storage/pebble.go in pkg/storage.(*pebbleReadOnly).Close at line 2763
pkg/storage/pebble_iterator.go in pkg/storage.(*pebbleIterator).destroy at line 1017
GOROOT/src/runtime/panic.go in runtime.gopanic at line 770
pkg/kv/kvserver/store_send.go in pkg/kv/kvserver.(*Store).SendWithWriteBytes.func1 at line 104
GOROOT/src/runtime/panic.go in runtime.gopanic at line 770
pkg/util/stop/stopper.go in pkg/util/stop.(*Stopper).recover at line 226
GOROOT/src/runtime/panic.go in runtime.gopanic at line 770
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError.func1 at line 137
GOROOT/src/runtime/panic.go in runtime.gopanic at line 770
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError.func1 at line 137
GOROOT/src/runtime/panic.go in runtime.gopanic at line 770
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.func1 at line 718
pkg/server/node.go in pkg/server.(*Node).Batch at line 1872
pkg/server/node.go in pkg/server.(*Node).batchInternal at line 1671
pkg/kv/kvserver/stores.go in pkg/kv/kvserver.(*Stores).SendWithWriteBytes at line 199
pkg/kv/kvserver/store_send.go in pkg/kv/kvserver.(*Store).SendWithWriteBytes at line 188
pkg/kv/kvserver/replica_send.go in pkg/kv/kvserver.(*Replica).SendWithWriteBytes at line 173
pkg/kv/kvserver/replica_send.go in pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries at line 498
pkg/kv/kvserver/replica_read.go in pkg/kv/kvserver.(*Replica).executeReadOnlyBatch at line 131
pkg/kv/kvserver/replica_read.go in pkg/kv/kvserver.(*Replica).executeReadOnlyBatchWithServersideRefreshes at line 471
pkg/kv/kvserver/replica_evaluate.go in pkg/kv/kvserver.evaluateBatch at line 304
pkg/kv/kvserver/replica_evaluate.go in pkg/kv/kvserver.evaluateCommand at line 487
pkg/kv/kvserver/batcheval/cmd_scan.go in pkg/kv/kvserver/batcheval.Scan at line 71
pkg/storage/mvcc.go in pkg/storage.MVCCScanToBytes at line 4959
pkg/storage/mvcc.go in pkg/storage.mvccScanToBytes at line 4603
pkg/storage/pebble_mvcc_scanner.go in pkg/storage.(*pebbleMVCCScanner).scan at line 686
pkg/storage/pebble_mvcc_scanner.go in pkg/storage.(*pebbleMVCCScanner).advance at line 648
pkg/storage/pebble_mvcc_scanner.go in pkg/storage.(*pebbleMVCCScanner).advanceKeyForward at line 1186
pkg/storage/pebble_mvcc_scanner.go in pkg/storage.(*pebbleMVCCScanner).nextKey at line 1122
pkg/storage/pebble_iterator.go in pkg/storage.(*pebbleIterator).NextKey at line 491
external/com_github_cockroachdb_pebble/iterator.go in github.com/cockroachdb/pebble.(*Iterator).NextPrefix at line 1743
external/com_github_cockroachdb_pebble/iterator.go in github.com/cockroachdb/pebble.(*Iterator).nextPrefix at line 1777
external/com_github_cockroachdb_pebble/iterator.go in github.com/cockroachdb/pebble.(*Iterator).internalNextPrefix at line 1873
external/com_github_cockroachdb_pebble/range_keys.go in github.com/cockroachdb/pebble.(*lazyCombinedIter).Next at line 663
external/com_github_cockroachdb_pebble/merging_iter.go in github.com/cockroachdb/pebble.(*mergingIter).Next at line 1189
external/com_github_cockroachdb_pebble/merging_iter.go in github.com/cockroachdb/pebble.(*mergingIter).nextEntry at line 541
external/com_github_cockroachdb_pebble/level_iter.go in github.com/cockroachdb/pebble.(*levelIter).Next at line 766
external/com_github_cockroachdb_pebble/sstable/reader_iter_single_lvl.go in github.com/cockroachdb/pebble/sstable.(*singleLevelIterator[...]).Next at line 1282
external/com_github_cockroachdb_pebble/sstable/reader_iter_single_lvl.go in github.com/cockroachdb/pebble/sstable.(*singleLevelIterator[...]).skipForward at line 1386
external/com_github_cockroachdb_pebble/sstable/reader_iter_single_lvl.go in github.com/cockroachdb/pebble/sstable.(*singleLevelIterator[...]).loadDataBlock at line 528
external/com_github_cockroachdb_pebble/sstable/reader.go in github.com/cockroachdb/pebble/sstable.(*Reader).readDataBlock at line 336
external/com_github_cockroachdb_pebble/sstable/block/block.go in github.com/cockroachdb/pebble/sstable/block.(*Reader).Read at line 459
external/com_github_cockroachdb_pebble/sstable/block/block.go in github.com/cockroachdb/pebble/sstable/block.(*Reader).doRead at line 509
pkg/server/node.go in pkg/server.(*Node).batchInternal at line 1671
pkg/kv/kvserver/stores.go in pkg/kv/kvserver.(*Stores).SendWithWriteBytes at line 199
pkg/kv/kvserver/store_send.go in pkg/kv/kvserver.(*Store).SendWithWriteBytes at line 188
pkg/kv/kvserver/replica_send.go in pkg/kv/kvserver.(*Replica).SendWithWriteBytes at line 173
pkg/kv/kvserver/replica_send.go in pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries at line 498
pkg/kv/kvserver/replica_read.go in pkg/kv/kvserver.(*Replica).executeReadOnlyBatch at line 131
pkg/kv/kvserver/replica_read.go in pkg/kv/kvserver.(*Replica).executeReadOnlyBatchWithServersideRefreshes at line 471
pkg/kv/kvserver/replica_evaluate.go in pkg/kv/kvserver.evaluateBatch at line 304
pkg/kv/kvserver/replica_evaluate.go in pkg/kv/kvserver.evaluateCommand at line 487
pkg/kv/kvserver/batcheval/cmd_scan.go in pkg/kv/kvserver/batcheval.Scan at line 71
pkg/storage/mvcc.go in pkg/storage.MVCCScanToBytes at line 4959
pkg/storage/mvcc.go in pkg/storage.mvccScanToBytes at line 4603
pkg/storage/pebble_mvcc_scanner.go in pkg/storage.(*pebbleMVCCScanner).scan at line 686
pkg/storage/pebble_mvcc_scanner.go in pkg/storage.(*pebbleMVCCScanner).advance at line 648
pkg/storage/pebble_mvcc_scanner.go in pkg/storage.(*pebbleMVCCScanner).advanceKeyForward at line 1186
pkg/storage/pebble_mvcc_scanner.go in pkg/storage.(*pebbleMVCCScanner).nextKey at line 1122
pkg/storage/pebble_iterator.go in pkg/storage.(*pebbleIterator).NextKey at line 491
external/com_github_cockroachdb_pebble/iterator.go in github.com/cockroachdb/pebble.(*Iterator).NextPrefix at line 1743
external/com_github_cockroachdb_pebble/iterator.go in github.com/cockroachdb/pebble.(*Iterator).nextPrefix at line 1777
external/com_github_cockroachdb_pebble/iterator.go in github.com/cockroachdb/pebble.(*Iterator).internalNextPrefix at line 1873
external/com_github_cockroachdb_pebble/range_keys.go in github.com/cockroachdb/pebble.(*lazyCombinedIter).Next at line 663
external/com_github_cockroachdb_pebble/merging_iter.go in github.com/cockroachdb/pebble.(*mergingIter).Next at line 1189
external/com_github_cockroachdb_pebble/merging_iter.go in github.com/cockroachdb/pebble.(*mergingIter).nextEntry at line 541
external/com_github_cockroachdb_pebble/level_iter.go in github.com/cockroachdb/pebble.(*levelIter).Next at line 766
external/com_github_cockroachdb_pebble/sstable/reader_iter_single_lvl.go in github.com/cockroachdb/pebble/sstable.(*singleLevelIterator[...]).Next at line 1282
external/com_github_cockroachdb_pebble/sstable/reader_iter_single_lvl.go in github.com/cockroachdb/pebble/sstable.(*singleLevelIterator[...]).skipForward at line 1386
external/com_github_cockroachdb_pebble/sstable/reader_iter_single_lvl.go in github.com/cockroachdb/pebble/sstable.(*singleLevelIterator[...]).loadDataBlock at line 528
external/com_github_cockroachdb_pebble/sstable/reader.go in github.com/cockroachdb/pebble/sstable.(*Reader).readDataBlock at line 336
external/com_github_cockroachdb_pebble/sstable/block/block.go in github.com/cockroachdb/pebble/sstable/block.(*Reader).Read at line 459
external/com_github_cockroachdb_pebble/sstable/block/block.go in github.com/cockroachdb/pebble/sstable/block.(*Reader).doRead at line 507
external/com_github_cockroachdb_pebble/sstable/block/block.go in github.com/cockroachdb/pebble/sstable/block.ValidateChecksum at line 171
external/com_github_cockroachdb_pebble/internal/base/error.go in github.com/cockroachdb/pebble/internal/base.CorruptionErrorf at line 30

Tags

Tag Value
Command start-single-node
Environment v25.1.2
Go Version go1.22.8 X:nocoverageredesign
Platform linux amd64
Distribution CCL
Cockroach Release v25.1.2
Cockroach SHA b439068
# of CPUs 12
# of Goroutines 512

Jira issue: CRDB-48630
@cockroach-sentry cockroach-sentry added branch-release-25.1 C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. O-sentry Originated from an in-the-wild panic report. labels Mar 18, 2025
@blathers-crl blathers[crl]
Copy link

blathers-crl bot commented Mar 18, 2025

CC'ing via the CODEOWNERS-based sentry heuristic:

  • @cockroachdb/storage

🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.

@blathers-crl blathers-crl bot added T-storage Storage Team X-blathers-triaged blathers was able to find an owner A-storage Relating to our storage engine (Pebble) on-disk storage. labels Mar 18, 2025
@exalate-issue-sync exalate-issue-sync bot changed the title Sentry: error.go:30: pebble/table: table 000623: block 2684001/8325: × checksum mismatch 0 != bc5a2e5b (1) attached stack trace -- stack trace: | runtime.gopanic | GOROOT/src/runtime/panic.go:... Sentry: error.go:30: pebble/table: table 000623: block 2684001/8325: × checksum mismatch 0 != bc5a2e5b (1) attached stack trace -- stack trace: | runtime.gopanic | GOROOT/src/runtime/panic.go:... Mar 18, 2025
@jbowens
Copy link
Collaborator

jbowens commented Mar 18, 2025 •
edited
Loading

Closing as duplicate of #143045 .

@jbowens jbowens closed this as completed Mar 18, 2025
@jbowens jbowens mentioned this issue Mar 18, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
A-storage Relating to our storage engine (Pebble) on-disk storage. branch-release-25.1 C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. O-sentry Originated from an in-the-wild panic report. T-storage Storage Team X-blathers-triaged blathers was able to find an owner
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jbowens @cockroach-sentry