release-6506

What's Changed

• proxy: Fix some warnings by extended clippy checks by @cloneable in #8748
• l0_flush: remove support for mode page-cached by @problame in #8739
• Migrate physical GC and scan_metadata to remote_storage by @arpad-m in #8673
• Update aws -> infra for repo rename by @arpad-m in #8755
• scrubber: remove _generic postfix and two unused functions by @arpad-m in #8761
• safekeeper: check for non-consecutive writes in safekeeper.rs by @arssher in #8640
• task_mgr::spawn: require a TenantId by @problame in #8462
• Make Postgres 16 default version by @bayandin in #8745
• Revert "safekeeper: check for non-consecutive writes in safekeeper.rs" by @jcsp in #8771
• storcon: run db migrations after step down sequence by @VladLazar in #8756
• proxy: make TLS and WS handling optional by @conradludgate in #8752
• storcon: add peer jwt token by @VladLazar in #8764
• pageserver: add metric pageserver_secondary_heatmap_total_size by @jcsp in #8768
• impr(pageserver): abort on fatal I/O writer error by @skyzh in #8777
• Benchmarking: need to checkout actions to download Neon artifacts by @Bodobolero in #8770
• pageserver: add counter for wait time on background loop semaphore by @problame in #8769
• storcon: handle heartbeater shutdown gracefully by @koivunej in #8767
• test: test_timeline_ancestor_detach_errors rare allowed_error by @koivunej in #8782
• CI(build-and-test): run regression tests on arm by @bayandin in #8552
• remove workspace hack from libs by @conradludgate in #8780
• Add compute_logical_snapshot_files metric by @tristan957 in #8762
• safekeeper: add listing timelines by @arssher in #8789
• test: fix more flaky due to graceful shutdown by @koivunej in #8787
• Add compute_receive_lsn metric by @tristan957 in #8750
• test: avoid some too long shutdowns by flushing before shutdown by @koivunej in #8772
• fix(pageserver): unify initdb optimization for sparse keyspaces; fix force img generation by @skyzh in #8776
• pageserver: batch InMemoryLayer puts, remove need to sort items by LSN during ingest by @jcsp in #8591
• Sleep in test_scrubber_physical_gc by @arpad-m in #8798
• Revert "Use sycnhronous commit for logical replicaiton worker (#8645)" by @ololobus in #8792
• proxy: Enable stricter/pedantic clippy checks by @cloneable in #8775
• test_compatibility: flush in the end by @koivunej in #8804
• Fix race condition in LRU list update in get_cached_relsize by @knizhnik in #8807
• feat(pageserver): warn on aux v1 tenants + default to v2 by @skyzh in #8625
• Upgrade Postgres to 14.13, 15.8, and 16.4 by @tristan957 in #8704
• Document how to use "git merge" for PostgreSQL minor version upgrades. by @hlinnaka in #8692
• Require poetry >=1.8 by @MMeent in #8812
• Update serde_json to 1.0.125 by @arpad-m in #8813
• CI(autocomment): add arch to build type by @bayandin in #8809
• feat(pageserver): remove features=testing restriction for compact by @skyzh in #8815
• fix(pageserver): l0 check criteria by @skyzh in #8797
• test: copy dict to avoid error on retry by @koivunej in #8811
• storcon_cli: add support for drain and fill operations by @VladLazar in #8791
• update diesel by @conradludgate in #8816
• impr(pageserver): error if keys are unordered in merge iter by @skyzh in #8818
• proxy: flesh out JWT verification code by @conradludgate in #8805
• controller: use PageserverUtilization for scheduling by @jcsp in #8711
• storage controller: enable timeline CRUD operations to run concurrently with reconciliation & make them safer by @jcsp in #8783
• proxy: local auth backend by @conradludgate in #8806
• proxy: new local-proxy application by @conradludgate in #8736
• chore: improve markdown formatting by @mrl5 in #8825
• Storage & Compute release 2024-08-26 by @vipvap in #8827

New Contributors

• @cloneable made their first contribution in #8748
• @mrl5 made their first contribution in #8825

Full Changelog: release-6450...release-6506