Skip to content

fix(db): preserve lexical source identity during optimization - #1978

Closed
KyleAMathews wants to merge 1 commit into
mainfrom
codex/optimizer-source-identity
Closed

KyleAMathews wants to merge 1 commit into
mainfrom
codex/optimizer-source-identity

Conversation

@KyleAMathews

Copy link
Copy Markdown
Collaborator

Summary

A live query can omit parent rows when a joined subquery and a sibling include use the same alias. Jaime02 reported this regression in #1976. The optimizer created new source IDs while it copied collection references. The compiler then associated the joined source with the include input. This PR preserves each lexical source reference during optimization.

Behavior and repair

The reported query joins project rows to issues and includes the project's issues. The join and include both use i as an alias. On the current main branch, the query returns no project. The expected result contains the Alpha project and its two issues.

The optimizer now reuses a CollectionRef when it copies a query or moves a predicate. It also reuses that reference when it removes a redundant subquery. These rewrites keep the source ID and the source collection together. cloneQueryForPlacement still creates a new reference for each new lexical position.

This is an independent implementation of the bug repair in #1976. It does not change Jaime02's PR or its proposed API.

Evidence

  • The original optimizer returns [] at the public initial checkpoint. The reference model expects Alpha with two issues.
  • Four separate mutants restore one old copy site each. Each mutant fails a source ID check at the intended optimizer shape.
  • The query-shape oracle passes 37 tests. Five focused suites pass 271 tests and report no Vitest type errors.
  • TypeScript passes with a temporary path to the source entry for the unbuilt @tanstack/db self import. The standard package command stops on that unresolved self import.
  • The package-wide run passes 7,896 tests. Its 21 replay tests fail because subprocesses cannot create node_modules/.vite-temp in the managed worktree.

Scope

The public oracle compares parent and included rows after preload and each source update. It crosses reused and distinct sibling aliases, three predicate forms, and joined or included issue updates. Its bounded model has one matching joined row per parent. An existing part of the oracle covers join multiplicity.

Direct checks cover eleven optimizer shapes and two separate placement clones. They also check that optimization leaves the input query containers and source fields unchanged. These checks do not establish arbitrary nested include graphs or caller mutation of public IR after construction. The coverage map records the remaining paths.

Reported by Jaime02 in #1976. This PR contains an independent repair and an expanded executable oracle.

@coderabbitai

coderabbitai Bot commented Oct 1, 2026

Copy link
Copy Markdown
Contributor

Important

Draft PR not reviewed

Draft PRs are not automatically reviewed by default.

  • Trigger a manual review

To automatically review draft PRs, update your CodeRabbit configuration:

reviews:
  auto_review:
    drafts: true
  • Autopilot · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Autopilot is currently an internal CodeRabbit preview.


Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@pkg-pr-new

pkg-pr-new Bot commented Oct 1, 2026

Copy link
Copy Markdown
More templates

@tanstack/angular-db

npm i https://pkg.pr.new/@tanstack/angular-db@1978

@tanstack/browser-db-sqlite-persistence

npm i https://pkg.pr.new/@tanstack/browser-db-sqlite-persistence@1978

@tanstack/capacitor-db-sqlite-persistence

npm i https://pkg.pr.new/@tanstack/capacitor-db-sqlite-persistence@1978

@tanstack/cloudflare-durable-objects-db-sqlite-persistence

npm i https://pkg.pr.new/@tanstack/cloudflare-durable-objects-db-sqlite-persistence@1978

@tanstack/db

npm i https://pkg.pr.new/@tanstack/db@1978

@tanstack/db-ivm

npm i https://pkg.pr.new/@tanstack/db-ivm@1978

@tanstack/db-sqlite-persistence-core

npm i https://pkg.pr.new/@tanstack/db-sqlite-persistence-core@1978

@tanstack/electric-db-collection

npm i https://pkg.pr.new/@tanstack/electric-db-collection@1978

@tanstack/electron-db-sqlite-persistence

npm i https://pkg.pr.new/@tanstack/electron-db-sqlite-persistence@1978

@tanstack/expo-db-sqlite-persistence

npm i https://pkg.pr.new/@tanstack/expo-db-sqlite-persistence@1978

@tanstack/node-db-sqlite-persistence

npm i https://pkg.pr.new/@tanstack/node-db-sqlite-persistence@1978

@tanstack/offline-transactions

npm i https://pkg.pr.new/@tanstack/offline-transactions@1978

@tanstack/powersync-db-collection

npm i https://pkg.pr.new/@tanstack/powersync-db-collection@1978

@tanstack/query-db-collection

npm i https://pkg.pr.new/@tanstack/query-db-collection@1978

@tanstack/react-db

npm i https://pkg.pr.new/@tanstack/react-db@1978

@tanstack/react-native-db-sqlite-persistence

npm i https://pkg.pr.new/@tanstack/react-native-db-sqlite-persistence@1978

@tanstack/react-router-with-db

npm i https://pkg.pr.new/@tanstack/react-router-with-db@1978

@tanstack/rxdb-db-collection

npm i https://pkg.pr.new/@tanstack/rxdb-db-collection@1978

@tanstack/solid-db

npm i https://pkg.pr.new/@tanstack/solid-db@1978

@tanstack/svelte-db

npm i https://pkg.pr.new/@tanstack/svelte-db@1978

@tanstack/tauri-db-sqlite-persistence

npm i https://pkg.pr.new/@tanstack/tauri-db-sqlite-persistence@1978

@tanstack/trailbase-db-collection

npm i https://pkg.pr.new/@tanstack/trailbase-db-collection@1978

@tanstack/vue-db

npm i https://pkg.pr.new/@tanstack/vue-db@1978

commit: 0094702

@github-actions

github-actions Bot commented Oct 1, 2026

Copy link
Copy Markdown
Contributor

Size Change: -15 B (-0.01%)

Total Size: 174 kB

📦 View Changed
Filename Size Change
packages/db/dist/esm/query/optimizer.js 2.92 kB -15 B (-0.51%)
ℹ️ View Unchanged
Filename Size
packages/db/dist/esm/client.js 3.61 kB
packages/db/dist/esm/collection-options.js 236 B
packages/db/dist/esm/collection/change-events.js 2.07 kB
packages/db/dist/esm/collection/changes.js 2.71 kB
packages/db/dist/esm/collection/cleanup-queue.js 808 B
packages/db/dist/esm/collection/events.js 481 B
packages/db/dist/esm/collection/index.js 4.46 kB
packages/db/dist/esm/collection/indexes.js 2.06 kB
packages/db/dist/esm/collection/lifecycle.js 2.63 kB
packages/db/dist/esm/collection/mutations.js 2.59 kB
packages/db/dist/esm/collection/state.js 8.3 kB
packages/db/dist/esm/collection/subscription.js 8.63 kB
packages/db/dist/esm/collection/sync.js 4.96 kB
packages/db/dist/esm/collection/transaction-metadata.js 144 B
packages/db/dist/esm/deferred.js 207 B
packages/db/dist/esm/errors.js 5.49 kB
packages/db/dist/esm/event-emitter.js 961 B
packages/db/dist/esm/index.js 3.94 kB
packages/db/dist/esm/indexes/auto-index.js 841 B
packages/db/dist/esm/indexes/base-index.js 1.25 kB
packages/db/dist/esm/indexes/basic-index.js 2.01 kB
packages/db/dist/esm/indexes/btree-index.js 2.3 kB
packages/db/dist/esm/indexes/index-registry.js 820 B
packages/db/dist/esm/indexes/reverse-index.js 370 B
packages/db/dist/esm/live-query-adapter.js 318 B
packages/db/dist/esm/live-query-observer.js 4.53 kB
packages/db/dist/esm/live-query-options.js 731 B
packages/db/dist/esm/live-query-window-controller.js 4.12 kB
packages/db/dist/esm/local-only.js 989 B
packages/db/dist/esm/local-storage.js 2.17 kB
packages/db/dist/esm/optimistic-action.js 359 B
packages/db/dist/esm/paced-mutations.js 702 B
packages/db/dist/esm/persisted-readiness.js 195 B
packages/db/dist/esm/proxy.js 3.32 kB
packages/db/dist/esm/query/builder/clone-query.js 766 B
packages/db/dist/esm/query/builder/functions.js 1.45 kB
packages/db/dist/esm/query/builder/index.js 6.79 kB
packages/db/dist/esm/query/builder/query-ir.js 116 B
packages/db/dist/esm/query/builder/ref-proxy-identity.js 198 B
packages/db/dist/esm/query/builder/ref-proxy.js 1.35 kB
packages/db/dist/esm/query/builder/wrapper-identity.js 221 B
packages/db/dist/esm/query/compiler/evaluators.js 2.1 kB
packages/db/dist/esm/query/compiler/expressions.js 603 B
packages/db/dist/esm/query/compiler/group-by.js 4.16 kB
packages/db/dist/esm/query/compiler/index.js 9.21 kB
packages/db/dist/esm/query/compiler/joins.js 3.06 kB
packages/db/dist/esm/query/compiler/lazy-targets.js 1.14 kB
packages/db/dist/esm/query/compiler/order-by.js 2 kB
packages/db/dist/esm/query/compiler/parent-routes.js 319 B
packages/db/dist/esm/query/compiler/query-equivalence.js 455 B
packages/db/dist/esm/query/compiler/route-metadata.js 1.24 kB
packages/db/dist/esm/query/compiler/select.js 1.59 kB
packages/db/dist/esm/query/effect.js 4.86 kB
packages/db/dist/esm/query/equality-value-identity.js 591 B
packages/db/dist/esm/query/expression-helpers.js 1.45 kB
packages/db/dist/esm/query/ir-stable-identity.js 4.22 kB
packages/db/dist/esm/query/ir.js 1.69 kB
packages/db/dist/esm/query/live-query-collection.js 391 B
packages/db/dist/esm/query/live/bucket-facade-adapter.js 2.67 kB
packages/db/dist/esm/query/live/collection-config-builder.js 6.47 kB
packages/db/dist/esm/query/live/collection-registry.js 264 B
packages/db/dist/esm/query/live/collection-subscriber.js 2.05 kB
packages/db/dist/esm/query/live/graph-scheduler.js 303 B
packages/db/dist/esm/query/live/internal.js 145 B
packages/db/dist/esm/query/live/materialized-pipeline.js 2.32 kB
packages/db/dist/esm/query/live/ordered-source-loader.js 4.14 kB
packages/db/dist/esm/query/live/subset-demand-controller.js 1.65 kB
packages/db/dist/esm/query/live/utils.js 1.2 kB
packages/db/dist/esm/query/query-once.js 359 B
packages/db/dist/esm/query/runtime-reference-identity.js 630 B
packages/db/dist/esm/query/subset-dedupe.js 493 B
packages/db/dist/esm/scheduler.js 1.13 kB
packages/db/dist/esm/SortedMap.js 1.58 kB
packages/db/dist/esm/strategies/debounceStrategy.js 331 B
packages/db/dist/esm/strategies/queueStrategy.js 488 B
packages/db/dist/esm/strategies/throttleStrategy.js 386 B
packages/db/dist/esm/sync-persistence.js 530 B
packages/db/dist/esm/transactions.js 3.72 kB
packages/db/dist/esm/utils.js 1.22 kB
packages/db/dist/esm/utils/array-utils.js 270 B
packages/db/dist/esm/utils/browser-polyfills.js 304 B
packages/db/dist/esm/utils/btree.js 3.02 kB
packages/db/dist/esm/utils/callbacks.js 174 B
packages/db/dist/esm/utils/comparison.js 1.59 kB
packages/db/dist/esm/utils/cursor.js 677 B
packages/db/dist/esm/utils/error.js 167 B
packages/db/dist/esm/utils/get-or-create.js 155 B
packages/db/dist/esm/utils/index-optimization.js 2.42 kB
packages/db/dist/esm/utils/source-record.js 140 B
packages/db/dist/esm/utils/type-guards.js 230 B
packages/db/dist/esm/utils/uuid.js 449 B
packages/db/dist/esm/virtual-props.js 360 B

compressed-size-action::db-package-size

@github-actions

github-actions Bot commented Oct 1, 2026

Copy link
Copy Markdown
Contributor

Size Change: 0 B

Total Size: 8.51 kB

ℹ️ View Unchanged
Filename Size
packages/react-db/dist/esm/DbProvider.js 317 B
packages/react-db/dist/esm/HydrationBoundary.js 263 B
packages/react-db/dist/esm/index.js 330 B
packages/react-db/dist/esm/live-query-internals.js 282 B
packages/react-db/dist/esm/useLiveInfiniteQuery.js 1.93 kB
packages/react-db/dist/esm/useLiveQuery.js 3.3 kB
packages/react-db/dist/esm/useLiveQueryEffect.js 355 B
packages/react-db/dist/esm/useLiveSuspenseQuery.js 1.33 kB
packages/react-db/dist/esm/usePacedMutations.js 401 B

compressed-size-action::react-db-package-size

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant