Repository navigation
Commit f2ceb1e
fix(asap-aware-mapping): CSE recompute-cost proxy must be DAG-aware, not tree-shaped
default_cse_recompute_cost measured a subtree's cost via
serde_json::to_string(subtree).len() — but a CseCandidate's subtree, by
definition, is something CSE already found sharing in, so it's
generally a DAG, not a tree. Rc's Serialize impl serializes the
pointee's value at every occurrence, not once by identity, so a naive
full serialization re-counts any descendant the subtree already shares
internally (e.g. from single-query CSE, x op x collapsing both
branches onto one Rc) once per parent that references it — silently
inflating the cost estimate relative to the DAG's real size.
Adds asap_types::pre_asap::cse::dag_node_count(root) -> usize: counts
unique nodes reachable from root, deduplicated by Rc pointer identity,
using the same operator-child traversal scope share_common_subtrees
itself uses (mirrors rebuild_children's field enumeration, as a
separate read-only traversal since rebuild_children consumes and
rebuilds its input). default_cse_recompute_cost now calls this instead
of serde_json.
Recalibrates default_cse_shared_maintenance_cost's UNIT constant
(60.0 -> 1.0) to match the new magnitude: node counts are small
integers (typically 1-20), not byte lengths (typically 200-500) — the
weight table's relative ordering (ExactAggregate cheapest, StatModel
priciest) is unchanged, only the absolute scale. Verified this
preserves existing default-sharing behavior: all pre-existing CSE
tests, including crates/integration-tests/tests/cse.rs's
DefaultCostModel-sharing assertions, pass unchanged.
New tests:
- cse.rs: dag_node_count is the naive count when nothing is shared;
correctly dedupes an internally-shared subtree (BinaryOp with both
branches pointing at the same Rc: 3 unique nodes, not 5); dedupes
correctly across two workload roots sharing one subtree.
- cost_model.rs: default_recompute_cost_does_not_double_count_an_internally_shared_descendant
— a Join with two independent Scan children costs 3, the same Join
with both children pointing at one shared Scan costs 2, not 3 (the
bug this fix addresses, demonstrated directly at the layer that
consumes dag_node_count).
Verified: cargo build --workspace --all-targets, cargo test --workspace
(444 passed, 0 failed), cargo fmt --all -- --check, cargo clippy
--workspace --all-targets --all-features -- -D warnings, cargo doc
--workspace --no-deps (no new broken-link warnings).
Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>1 parent 5da7995 commit f2ceb1e
3 files changed
Lines changed: 247 additions & 27 deletions
File tree
- crates
- asap-aware-mapping/src
- types/src/pre_asap
- docs
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
85 | 85 | | |
86 | 86 | | |
87 | 87 | | |
88 | | - | |
89 | | - | |
90 | | - | |
91 | | - | |
92 | | - | |
93 | | - | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
| 98 | + | |
| 99 | + | |
| 100 | + | |
| 101 | + | |
94 | 102 | | |
95 | 103 | | |
96 | | - | |
97 | | - | |
98 | | - | |
99 | | - | |
| 104 | + | |
100 | 105 | | |
101 | 106 | | |
102 | 107 | | |
103 | 108 | | |
104 | | - | |
105 | | - | |
106 | | - | |
107 | | - | |
108 | | - | |
109 | | - | |
110 | | - | |
111 | | - | |
112 | | - | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
113 | 119 | | |
114 | | - | |
| 120 | + | |
115 | 121 | | |
116 | 122 | | |
117 | 123 | | |
| |||
423 | 429 | | |
424 | 430 | | |
425 | 431 | | |
| 432 | + | |
| 433 | + | |
| 434 | + | |
| 435 | + | |
| 436 | + | |
| 437 | + | |
| 438 | + | |
| 439 | + | |
| 440 | + | |
| 441 | + | |
| 442 | + | |
| 443 | + | |
| 444 | + | |
| 445 | + | |
| 446 | + | |
| 447 | + | |
| 448 | + | |
| 449 | + | |
| 450 | + | |
| 451 | + | |
| 452 | + | |
| 453 | + | |
| 454 | + | |
| 455 | + | |
| 456 | + | |
| 457 | + | |
| 458 | + | |
| 459 | + | |
| 460 | + | |
| 461 | + | |
| 462 | + | |
| 463 | + | |
| 464 | + | |
| 465 | + | |
| 466 | + | |
| 467 | + | |
| 468 | + | |
| 469 | + | |
| 470 | + | |
| 471 | + | |
| 472 | + | |
| 473 | + | |
| 474 | + | |
426 | 475 | | |
427 | 476 | | |
428 | 477 | | |
| |||
468 | 517 | | |
469 | 518 | | |
470 | 519 | | |
471 | | - | |
472 | | - | |
473 | | - | |
474 | | - | |
| 520 | + | |
| 521 | + | |
| 522 | + | |
| 523 | + | |
475 | 524 | | |
476 | 525 | | |
477 | 526 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
164 | 164 | | |
165 | 165 | | |
166 | 166 | | |
| 167 | + | |
| 168 | + | |
| 169 | + | |
| 170 | + | |
| 171 | + | |
| 172 | + | |
| 173 | + | |
| 174 | + | |
| 175 | + | |
| 176 | + | |
| 177 | + | |
| 178 | + | |
| 179 | + | |
| 180 | + | |
| 181 | + | |
| 182 | + | |
| 183 | + | |
| 184 | + | |
| 185 | + | |
| 186 | + | |
| 187 | + | |
| 188 | + | |
| 189 | + | |
| 190 | + | |
| 191 | + | |
| 192 | + | |
| 193 | + | |
| 194 | + | |
| 195 | + | |
| 196 | + | |
| 197 | + | |
| 198 | + | |
| 199 | + | |
| 200 | + | |
| 201 | + | |
| 202 | + | |
| 203 | + | |
| 204 | + | |
| 205 | + | |
| 206 | + | |
| 207 | + | |
| 208 | + | |
| 209 | + | |
| 210 | + | |
| 211 | + | |
| 212 | + | |
| 213 | + | |
| 214 | + | |
| 215 | + | |
| 216 | + | |
| 217 | + | |
| 218 | + | |
| 219 | + | |
| 220 | + | |
| 221 | + | |
| 222 | + | |
| 223 | + | |
| 224 | + | |
| 225 | + | |
| 226 | + | |
| 227 | + | |
| 228 | + | |
| 229 | + | |
| 230 | + | |
| 231 | + | |
| 232 | + | |
| 233 | + | |
| 234 | + | |
| 235 | + | |
| 236 | + | |
| 237 | + | |
| 238 | + | |
| 239 | + | |
| 240 | + | |
| 241 | + | |
| 242 | + | |
| 243 | + | |
| 244 | + | |
| 245 | + | |
| 246 | + | |
| 247 | + | |
| 248 | + | |
| 249 | + | |
| 250 | + | |
| 251 | + | |
| 252 | + | |
| 253 | + | |
| 254 | + | |
| 255 | + | |
| 256 | + | |
| 257 | + | |
| 258 | + | |
| 259 | + | |
| 260 | + | |
| 261 | + | |
| 262 | + | |
| 263 | + | |
| 264 | + | |
| 265 | + | |
| 266 | + | |
| 267 | + | |
| 268 | + | |
| 269 | + | |
| 270 | + | |
167 | 271 | | |
168 | 272 | | |
169 | 273 | | |
| |||
516 | 620 | | |
517 | 621 | | |
518 | 622 | | |
| 623 | + | |
| 624 | + | |
| 625 | + | |
| 626 | + | |
| 627 | + | |
| 628 | + | |
| 629 | + | |
| 630 | + | |
| 631 | + | |
| 632 | + | |
| 633 | + | |
| 634 | + | |
| 635 | + | |
| 636 | + | |
| 637 | + | |
| 638 | + | |
| 639 | + | |
| 640 | + | |
| 641 | + | |
| 642 | + | |
| 643 | + | |
| 644 | + | |
| 645 | + | |
| 646 | + | |
| 647 | + | |
| 648 | + | |
| 649 | + | |
| 650 | + | |
| 651 | + | |
| 652 | + | |
| 653 | + | |
| 654 | + | |
| 655 | + | |
| 656 | + | |
| 657 | + | |
| 658 | + | |
| 659 | + | |
| 660 | + | |
| 661 | + | |
| 662 | + | |
| 663 | + | |
| 664 | + | |
| 665 | + | |
| 666 | + | |
| 667 | + | |
| 668 | + | |
| 669 | + | |
| 670 | + | |
| 671 | + | |
| 672 | + | |
| 673 | + | |
| 674 | + | |
| 675 | + | |
| 676 | + | |
| 677 | + | |
| 678 | + | |
| 679 | + | |
| 680 | + | |
| 681 | + | |
| 682 | + | |
| 683 | + | |
519 | 684 | | |
520 | 685 | | |
521 | 686 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
80 | 80 | | |
81 | 81 | | |
82 | 82 | | |
83 | | - | |
84 | | - | |
85 | | - | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
86 | 92 | | |
87 | 93 | | |
88 | 94 | | |
| |||
0 commit comments