Skip to content

perf(expr): Add EvalCtx constructor with pre-computed inputFlatNoNulls flag (#17232)#17232

Closed
darxsys wants to merge 1 commit intofacebookincubator:mainfrom
darxsys:export-D101418306
Closed

perf(expr): Add EvalCtx constructor with pre-computed inputFlatNoNulls flag (#17232)#17232
darxsys wants to merge 1 commit intofacebookincubator:mainfrom
darxsys:export-D101418306

Conversation

@darxsys
Copy link
Copy Markdown

@darxsys darxsys commented Apr 17, 2026

Summary:

CONTEXT: When the same RowVector is evaluated across many ExprSet instances (e.g. ~1800 times in some cases), the EvalCtx constructor's per-column isFlatEncoding/mayHaveNulls loop runs redundantly for each new instance of EvalCtx, even though the data is the same — 39% of CPU in production.

WHAT: Add a new EvalCtx constructor overload that accepts a pre-computed inputFlatNoNulls flag, plus a static computeInputFlatNoNulls() helper. This lets callers compute the flag once and reuse it across all EvalCtx instances for the same RowVector. The original constructor now delegates to computeInputFlatNoNulls() to avoid code duplication.

Differential Revision: D101418306

@netlify
Copy link
Copy Markdown

netlify Bot commented Apr 17, 2026

Deploy Preview for meta-velox canceled.

Name Link
🔨 Latest commit 15df915
🔍 Latest deploy log https://app.netlify.com/projects/meta-velox/deploys/69e69d4230474c0008a8fb53

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Apr 17, 2026
@meta-codesync
Copy link
Copy Markdown

meta-codesync Bot commented Apr 17, 2026

@darxsys has exported this pull request. If you are a Meta employee, you can view the originating Diff in D101418306.

@darxsys darxsys changed the title Add EvalCtx constructor with pre-computed inputFlatNoNulls flag perf(expr): Add EvalCtx constructor with pre-computed inputFlatNoNulls flag Apr 17, 2026
@github-actions
Copy link
Copy Markdown

github-actions Bot commented Apr 17, 2026

Build Impact Analysis

Selective Build Targets (building these covers all 396 affected)

cmake --build _build/release --target aggregate_companion_functions_test physical_size_aggregator_test presto_sql_test spark_aggregation_fuzzer_test spark_expression_fuzzer_test velox_abfs_test velox_aggregates_GeometryAggregateTest velox_aggregates_reduce_agg_bm velox_aggregates_simple_aggregates_bm velox_aggregates_string_keys_bm velox_aggregates_test_group0 velox_aggregates_test_group1 velox_aggregates_test_group2 velox_aggregates_test_group3 velox_aggregates_test_group4 velox_aggregation_fuzzer_test velox_aggregation_runner_test velox_benchmark_array_writer_no_nulls velox_benchmark_array_writer_with_nulls velox_benchmark_basic_comparison_conjunct velox_benchmark_basic_decoded_vector velox_benchmark_basic_preproc velox_benchmark_basic_selectivity_vector velox_benchmark_basic_simple_arithmetic velox_benchmark_basic_simple_cast velox_benchmark_basic_vector_compare velox_benchmark_basic_vector_fuzzer velox_benchmark_basic_vector_slice velox_benchmark_estimate_flat_size velox_benchmark_expr_flat_no_nulls velox_benchmark_feature_normalization velox_benchmark_map_writer_no_nulls velox_benchmark_map_writer_with_nulls velox_benchmark_nested_array_writer_no_nulls velox_benchmark_nested_array_writer_with_nulls velox_cache_fuzzer velox_cast_benchmark velox_common_compression_test velox_common_geospatial_serde_test velox_common_test velox_constrained_input_generators_test velox_constrained_vector_generator_test velox_core_test velox_driver_test velox_duckdb_conversion_test velox_dwio_arrow_parquet_writer_test velox_dwio_cache_test velox_dwio_common_bitpack_decoder_benchmark velox_dwio_common_data_buffer_benchmark velox_dwio_common_int_decoder_benchmark velox_dwio_common_test velox_dwio_dwrf_buffered_output_stream_test velox_dwio_dwrf_byte_rle_encoder_test velox_dwio_dwrf_byte_rle_test velox_dwio_dwrf_checksum_test velox_dwio_dwrf_column_reader_test velox_dwio_dwrf_column_statistics_test velox_dwio_dwrf_compression_test velox_dwio_dwrf_config_test velox_dwio_dwrf_data_buffer_holder_test velox_dwio_dwrf_decompression_test velox_dwio_dwrf_decryption_test velox_dwio_dwrf_dictionary_encoder_test velox_dwio_dwrf_dictionary_encoding_utils_test velox_dwio_dwrf_encoding_selector_test velox_dwio_dwrf_encryption_test velox_dwio_dwrf_flush_policy_test velox_dwio_dwrf_index_builder_test velox_dwio_dwrf_int_direct_test velox_dwio_dwrf_int_encoder_test velox_dwio_dwrf_layout_planner_test velox_dwio_dwrf_ratio_checker_test velox_dwio_dwrf_reader_base_test velox_dwio_dwrf_reader_test velox_dwio_dwrf_rle_test velox_dwio_dwrf_rlev1_encoder_test velox_dwio_dwrf_stream_labels_test velox_dwio_dwrf_stripe_dictionary_cache_test velox_dwio_dwrf_stripe_reader_base_test velox_dwio_dwrf_stripe_stream_test velox_dwio_dwrf_utils_test velox_dwio_dwrf_writer_context_test velox_dwio_dwrf_writer_encoding_manager_test velox_dwio_dwrf_writer_sink_test velox_dwio_dwrf_writer_test velox_dwio_iceberg_reader_benchmark velox_dwio_orc_column_statistics_test velox_dwio_orc_reader_filter_test velox_dwio_orc_reader_test velox_dwio_parquet_common_test velox_dwio_parquet_page_reader_test velox_dwio_parquet_reader_benchmark velox_dwio_parquet_reader_test velox_dwio_parquet_rlebp_decoder_test velox_dwio_parquet_structure_decoder_benchmark velox_dwio_parquet_structure_decoder_test velox_dwio_parquet_table_scan_test velox_dwio_parquet_thrift_test velox_dwio_parquet_tpch_test velox_dwrf_column_writer_index_test velox_dwrf_column_writer_stats_test velox_dwrf_column_writer_test velox_dwrf_e2e_filter_test velox_dwrf_e2e_reader_test velox_dwrf_e2e_writer_test velox_dwrf_float_column_writer_benchmark velox_dwrf_int_encoder_benchmark velox_dwrf_statistics_builder_utils_test velox_dwrf_writer_extended_test velox_dwrf_writer_flush_test velox_example_expression_eval velox_example_opaque_type velox_example_operator_extensibility velox_example_scan_orc velox_example_simple_functions velox_example_vector_reader_writer velox_exchange_benchmark velox_exchange_fuzzer velox_exec_SpatialJoinTest velox_exec_bm_duplicate_project velox_exec_infra_test velox_exec_prefixsort_test velox_exec_test_group0 velox_exec_test_group1 velox_exec_test_group2 velox_exec_test_group3 velox_exec_test_group4 velox_exec_test_group5 velox_exec_test_group6 velox_exec_test_group7 velox_exec_util_test_group0 velox_exec_vector_hasher_benchmark velox_expression_fuzzer_test velox_expression_fuzzer_unit_test velox_expression_runner_test velox_expression_runner_unit_test velox_expression_test velox_expression_verifier_unit_test velox_filemetadata_test velox_filter_project_benchmark velox_format_datetime_benchmark velox_function_dynamic velox_function_dynamic_link_test velox_function_err_dynamic velox_function_non_default_dynamic velox_function_registry_test velox_functions_aggregates_test velox_functions_benchmarks_compare velox_functions_benchmarks_row_writer_no_nulls velox_functions_benchmarks_simdjson_function_with_expr velox_functions_benchmarks_string_writer_no_nulls velox_functions_benchmarks_url velox_functions_iceberg_test velox_functions_json_test velox_functions_lib_test velox_functions_prestosql_benchmarks_array_contains velox_functions_prestosql_benchmarks_array_min_max velox_functions_prestosql_benchmarks_array_position velox_functions_prestosql_benchmarks_array_sum velox_functions_prestosql_benchmarks_bitwise velox_functions_prestosql_benchmarks_cardinality velox_functions_prestosql_benchmarks_comparisons velox_functions_prestosql_benchmarks_concat velox_functions_prestosql_benchmarks_date_time velox_functions_prestosql_benchmarks_field_reference velox_functions_prestosql_benchmarks_generic velox_functions_prestosql_benchmarks_in velox_functions_prestosql_benchmarks_map_concat velox_functions_prestosql_benchmarks_map_input velox_functions_prestosql_benchmarks_map_subscript velox_functions_prestosql_benchmarks_map_zip_with velox_functions_prestosql_benchmarks_not velox_functions_prestosql_benchmarks_regexp_replace velox_functions_prestosql_benchmarks_row velox_functions_prestosql_benchmarks_string_ascii_utf_functions velox_functions_prestosql_benchmarks_uuid_cast velox_functions_prestosql_benchmarks_width_bucket velox_functions_prestosql_benchmarks_zip velox_functions_prestosql_benchmarks_zip_with velox_functions_spark_aggregates_test velox_functions_spark_test velox_functions_test velox_fuzzer_connector_test velox_gcs_file_test velox_gcs_insert_test velox_gcs_multiendpoints_test velox_gcsfile_example velox_hash_benchmark velox_hash_join_build_benchmark velox_hash_join_list_result_benchmark velox_hash_join_prepare_join_table_benchmark velox_hdfs_file_test velox_hdfs_insert_test velox_hive_connector_test velox_hive_iceberg_deletion_vector_test velox_hive_iceberg_deletion_vector_writer_test velox_hive_iceberg_dwrf_insert_test velox_hive_iceberg_equality_delete_test velox_hive_iceberg_insert_test velox_hive_iceberg_test velox_hive_paimon_connector velox_hive_paimon_data_file_meta_test velox_hive_paimon_deletion_file_test velox_hive_paimon_row_kind_test velox_hive_paimon_split_test velox_hive_partition_function_benchmark velox_in_10_min_demo velox_join_fuzzer velox_key_encoder_test velox_like_benchmark velox_like_tpch_benchmark velox_mark_distinct_fuzzer velox_mark_sorted_benchmark velox_memory_arbitration_fuzzer velox_memory_test velox_merge_benchmark velox_numeric_upcast_benchmark velox_orderby_benchmark velox_overload_int_function_dynamic velox_overload_varchar_function_dynamic velox_overwrite_int_function_dynamic velox_overwrite_varchar_function_dynamic velox_parquet_e2e_filter_test velox_parquet_writer_sink_test velox_parquet_writer_test velox_parse_test velox_prefixsort_benchmark velox_presto_type_parser_test velox_presto_types_fuzzer_utils_test velox_presto_types_test velox_prestosql_coverage velox_query_replayer velox_re2_functions_benchmarks velox_read_benchmark velox_row_number_fuzzer velox_row_serializer_benchmark velox_row_test velox_rpc_operator_test velox_s3config_test velox_s3file_test velox_s3finalize_test velox_s3insert_test velox_s3metrics_test velox_s3multiendpoints_test velox_s3read_test velox_s3registration_test velox_serializer_benchmark velox_serializer_test_group0 velox_simple_aggregate_test velox_sort_benchmark velox_spark_function_registry_test velox_spark_query_runner_test velox_spark_types_test velox_spark_windows_test velox_sparksql_benchmarks_cast velox_sparksql_benchmarks_compare velox_sparksql_benchmarks_from_json velox_sparksql_benchmarks_get_funcs velox_sparksql_benchmarks_hash velox_sparksql_benchmarks_in velox_sparksql_benchmarks_simd_compare velox_sparksql_benchmarks_split velox_sparksql_coverage velox_spatial_join_benchmark velox_spatial_join_fuzzer velox_spiller_aggregate_benchmark velox_spiller_join_benchmark velox_streaming_aggregation_benchmark velox_table_evolution_fuzzer_test velox_test_util_test velox_text_reader_test velox_text_writer_test velox_tool_trace_test velox_topn_row_number_fuzzer velox_tpcds_connector_test velox_tpch_benchmark velox_tpch_connector_test velox_tpch_speed_test velox_trace_file_tool velox_unsafe_row_serialize_benchmark velox_vector_fuzzer_test velox_vector_test velox_wave_benchmark velox_wave_exec_test velox_window_fuzzer_test velox_window_prefixsort_benchmark velox_window_sub_partitioned_sort_benchmark velox_windows_agg_test velox_windows_rank_test velox_windows_value_test velox_writer_fuzzer_test

Total affected: 396/567 targets

Affected targets (396)

Directly changed (142)

Target Changed Files
aggregate_companion_functions_test EvalCtx.h
spark_expression_fuzzer_test EvalCtx.h
velox_aggregates EvalCtx.h
velox_benchmark_array_writer_no_nulls EvalCtx.h
velox_benchmark_array_writer_with_nulls EvalCtx.h
velox_benchmark_basic_comparison_conjunct EvalCtx.h
velox_benchmark_basic_decoded_vector EvalCtx.h
velox_benchmark_basic_preproc EvalCtx.h
velox_benchmark_basic_selectivity_vector EvalCtx.h
velox_benchmark_basic_simple_arithmetic EvalCtx.h
velox_benchmark_basic_simple_cast EvalCtx.h
velox_benchmark_basic_vector_compare EvalCtx.h
velox_benchmark_builder EvalCtx.h
velox_benchmark_estimate_flat_size EvalCtx.h
velox_benchmark_expr_flat_no_nulls EvalCtx.h
velox_benchmark_feature_normalization EvalCtx.h
velox_benchmark_map_writer_no_nulls EvalCtx.h
velox_benchmark_map_writer_with_nulls EvalCtx.h
velox_benchmark_nested_array_writer_no_nulls EvalCtx.h
velox_benchmark_nested_array_writer_with_nulls EvalCtx.h
velox_cast_benchmark EvalCtx.h
velox_core_test EvalCtx.h
velox_dwio_common_test_utils EvalCtx.h
velox_dwio_parquet_tpch_test EvalCtx.h
velox_example_expression_eval EvalCtx.h
velox_example_opaque_type EvalCtx.h
velox_example_simple_functions EvalCtx.h
velox_example_vector_reader_writer EvalCtx.h
velox_exec EvalCtx.h
velox_exec_infra_test EvalCtx.h
velox_exec_test_group2 EvalCtx.h
velox_exec_test_group5 EvalCtx.h
velox_exec_test_group6 EvalCtx.h
velox_exec_test_lib EvalCtx.h
velox_exec_util_test_group0 EvalCtx.h
velox_expression EvalCtx.cpp, EvalCtx.h
velox_expression_fuzzer EvalCtx.h
velox_expression_fuzzer_test EvalCtx.h
velox_expression_runner EvalCtx.h
velox_expression_runner_unit_test EvalCtx.h
velox_expression_test EvalCtx.h, EvalCtxTest.cpp
velox_expression_verifier EvalCtx.h
velox_expression_verifier_unit_test EvalCtx.h
velox_format_datetime_benchmark EvalCtx.h
velox_function_dynamic EvalCtx.h
velox_function_dynamic_link_test EvalCtx.h
velox_function_err_dynamic EvalCtx.h
velox_function_non_default_dynamic EvalCtx.h
velox_function_registry EvalCtx.h
velox_function_registry_test EvalCtx.h
velox_functions_aggregates_test EvalCtx.h
velox_functions_aggregates_test_lib EvalCtx.h
velox_functions_benchmarks_compare EvalCtx.h
velox_functions_benchmarks_row_writer_no_nulls EvalCtx.h
velox_functions_benchmarks_simdjson_function_with_expr EvalCtx.h
velox_functions_benchmarks_string_writer_no_nulls EvalCtx.h
velox_functions_benchmarks_url EvalCtx.h
velox_functions_iceberg EvalCtx.h
velox_functions_iceberg_test EvalCtx.h
velox_functions_lib EvalCtx.h
velox_functions_lib_test EvalCtx.h
velox_functions_prestosql EvalCtx.h
velox_functions_prestosql_benchmarks_array_contains EvalCtx.h
velox_functions_prestosql_benchmarks_array_min_max EvalCtx.h
velox_functions_prestosql_benchmarks_array_position EvalCtx.h
velox_functions_prestosql_benchmarks_array_sum EvalCtx.h
velox_functions_prestosql_benchmarks_bitwise EvalCtx.h
velox_functions_prestosql_benchmarks_cardinality EvalCtx.h
velox_functions_prestosql_benchmarks_comparisons EvalCtx.h
velox_functions_prestosql_benchmarks_concat EvalCtx.h
velox_functions_prestosql_benchmarks_date_time EvalCtx.h
velox_functions_prestosql_benchmarks_field_reference EvalCtx.h
velox_functions_prestosql_benchmarks_generic EvalCtx.h
velox_functions_prestosql_benchmarks_in EvalCtx.h
velox_functions_prestosql_benchmarks_map_concat EvalCtx.h
velox_functions_prestosql_benchmarks_map_input EvalCtx.h
velox_functions_prestosql_benchmarks_map_subscript EvalCtx.h
velox_functions_prestosql_benchmarks_map_zip_with EvalCtx.h
velox_functions_prestosql_benchmarks_not EvalCtx.h
velox_functions_prestosql_benchmarks_regexp_replace EvalCtx.h
velox_functions_prestosql_benchmarks_row EvalCtx.h
velox_functions_prestosql_benchmarks_string_ascii_utf_functions EvalCtx.h
velox_functions_prestosql_benchmarks_uuid_cast EvalCtx.h
velox_functions_prestosql_benchmarks_width_bucket EvalCtx.h
velox_functions_prestosql_benchmarks_zip EvalCtx.h
velox_functions_prestosql_benchmarks_zip_with EvalCtx.h
velox_functions_prestosql_impl EvalCtx.h
velox_functions_spark EvalCtx.h
velox_functions_spark_aggregates EvalCtx.h
velox_functions_spark_aggregates_test EvalCtx.h
velox_functions_spark_impl EvalCtx.h
velox_functions_spark_specialforms EvalCtx.h
velox_functions_spark_test EvalCtx.h
velox_functions_test EvalCtx.h
velox_functions_test_lib EvalCtx.h
velox_functions_util EvalCtx.h
velox_fuzzer_util EvalCtx.h
velox_hive_connector EvalCtx.h
velox_hive_connector_test EvalCtx.h
velox_hive_iceberg_dwrf_insert_test EvalCtx.h
velox_hive_iceberg_insert_test EvalCtx.h
velox_hive_iceberg_splitreader EvalCtx.h
velox_hive_paimon_connector EvalCtx.h
velox_hive_partition_function_benchmark EvalCtx.h
velox_in_10_min_demo EvalCtx.h
velox_is_null_functions EvalCtx.h
velox_like_benchmark EvalCtx.h
velox_like_tpch_benchmark EvalCtx.h
velox_numeric_upcast_benchmark EvalCtx.h
velox_overload_int_function_dynamic EvalCtx.h
velox_overload_varchar_function_dynamic EvalCtx.h
velox_overwrite_int_function_dynamic EvalCtx.h
velox_overwrite_varchar_function_dynamic EvalCtx.h
velox_parse_utils EvalCtx.h
velox_presto_types EvalCtx.h
velox_presto_types_fuzzer_utils_test EvalCtx.h
velox_presto_types_test EvalCtx.h
velox_re2_functions_benchmarks EvalCtx.h
velox_rpc_function_stubs EvalCtx.h
velox_simple_aggregate EvalCtx.h
velox_simple_aggregate_test EvalCtx.h
velox_spark_function_registry_test EvalCtx.h
velox_spark_types EvalCtx.h
velox_spark_types_test EvalCtx.h
velox_sparksql_benchmarks_cast EvalCtx.h
velox_sparksql_benchmarks_compare EvalCtx.h
velox_sparksql_benchmarks_from_json EvalCtx.h
velox_sparksql_benchmarks_get_funcs EvalCtx.h
velox_sparksql_benchmarks_hash EvalCtx.h
velox_sparksql_benchmarks_in EvalCtx.h
velox_sparksql_benchmarks_simd_compare EvalCtx.h
velox_sparksql_benchmarks_split EvalCtx.h
velox_tpch_connector EvalCtx.h
velox_tpch_connector_test EvalCtx.h
velox_tpch_speed_test EvalCtx.h
velox_wave_benchmark EvalCtx.h
velox_wave_dwio EvalCtx.h
velox_wave_exec EvalCtx.h
velox_wave_exec_test EvalCtx.h
velox_wave_mock_reader EvalCtx.h
velox_wave_stream EvalCtx.h
velox_writer_fuzzer EvalCtx.h

Transitively affected (254)

  • physical_size_aggregator_test
  • presto_sql_test
  • spark_aggregation_fuzzer_test
  • velox_abfs_test
  • velox_aggregates_GeometryAggregateTest
  • velox_aggregates_reduce_agg_bm
  • velox_aggregates_simple_aggregates_bm
  • velox_aggregates_string_keys_bm
  • velox_aggregates_test_group0
  • velox_aggregates_test_group1
  • velox_aggregates_test_group2
  • velox_aggregates_test_group3
  • velox_aggregates_test_group4
  • velox_aggregation_fuzzer
  • velox_aggregation_fuzzer_base
  • velox_aggregation_fuzzer_test
  • velox_aggregation_result_verifier
  • velox_aggregation_runner_test
  • velox_async_rpc_function_registry
  • velox_benchmark_basic_vector_fuzzer
  • velox_benchmark_basic_vector_slice
  • velox_cache_fuzzer
  • velox_cache_fuzzer_lib
  • velox_common_compression_test
  • velox_common_geospatial_serde
  • velox_common_geospatial_serde_test
  • velox_common_test
  • velox_constrained_input_generators
  • velox_constrained_input_generators_test
  • velox_constrained_vector_generator
  • velox_constrained_vector_generator_test
  • velox_coverage_util
  • velox_cursor
  • velox_driver_test
  • velox_duckdb_conversion_test
  • velox_duckdb_parser
  • velox_dwio_arrow_parquet_writer
  • velox_dwio_arrow_parquet_writer_lib
  • velox_dwio_arrow_parquet_writer_test
  • velox_dwio_arrow_parquet_writer_test_lib
  • velox_dwio_arrow_parquet_writer_util_lib
  • velox_dwio_cache_test
  • velox_dwio_common
  • velox_dwio_common_bitpack_decoder_benchmark
  • velox_dwio_common_compression
  • velox_dwio_common_data_buffer_benchmark
  • velox_dwio_common_int_decoder_benchmark
  • velox_dwio_common_test
  • velox_dwio_dwrf_buffered_output_stream_test
  • velox_dwio_dwrf_byte_rle_encoder_test
  • velox_dwio_dwrf_byte_rle_test
  • velox_dwio_dwrf_checksum_test
  • velox_dwio_dwrf_column_reader_test
  • velox_dwio_dwrf_column_statistics_test
  • velox_dwio_dwrf_common
  • velox_dwio_dwrf_compression_test
  • velox_dwio_dwrf_config_test
  • velox_dwio_dwrf_data_buffer_holder_test
  • velox_dwio_dwrf_decompression_test
  • velox_dwio_dwrf_decryption_test
  • velox_dwio_dwrf_dictionary_encoder_test
  • velox_dwio_dwrf_dictionary_encoding_utils_test
  • velox_dwio_dwrf_encoding_selector_test
  • velox_dwio_dwrf_encryption_test
  • velox_dwio_dwrf_flush_policy_test
  • velox_dwio_dwrf_index_builder_test
  • velox_dwio_dwrf_int_direct_test
  • velox_dwio_dwrf_int_encoder_test
  • velox_dwio_dwrf_layout_planner_test
  • velox_dwio_dwrf_ratio_checker_test
  • velox_dwio_dwrf_reader
  • velox_dwio_dwrf_reader_base_test
  • velox_dwio_dwrf_reader_test
  • velox_dwio_dwrf_rle_test
  • velox_dwio_dwrf_rlev1_encoder_test
  • velox_dwio_dwrf_stream_labels_test
  • velox_dwio_dwrf_stripe_dictionary_cache_test
  • velox_dwio_dwrf_stripe_reader_base_test
  • velox_dwio_dwrf_stripe_stream_test
  • velox_dwio_dwrf_utils
  • velox_dwio_dwrf_utils_test
  • velox_dwio_dwrf_writer
  • velox_dwio_dwrf_writer_context_test
  • velox_dwio_dwrf_writer_encoding_manager_test
  • velox_dwio_dwrf_writer_sink_test
  • velox_dwio_dwrf_writer_test
  • velox_dwio_faulty_file_sink
  • velox_dwio_iceberg_reader_benchmark
  • velox_dwio_iceberg_reader_benchmark_lib
  • velox_dwio_native_parquet_reader
  • velox_dwio_orc_column_statistics_test
  • velox_dwio_orc_reader
  • velox_dwio_orc_reader_filter_test
  • velox_dwio_orc_reader_test
  • velox_dwio_parquet_common
  • velox_dwio_parquet_common_test
  • velox_dwio_parquet_page_reader_test
  • velox_dwio_parquet_reader
  • velox_dwio_parquet_reader_benchmark
  • velox_dwio_parquet_reader_benchmark_lib
  • velox_dwio_parquet_reader_test
  • velox_dwio_parquet_rlebp_decoder_test
  • velox_dwio_parquet_structure_decoder_benchmark
  • velox_dwio_parquet_structure_decoder_test
  • velox_dwio_parquet_table_scan_test
  • velox_dwio_parquet_thrift_test
  • velox_dwio_parquet_writer
  • velox_dwio_text_reader
  • velox_dwio_text_reader_register
  • velox_dwio_text_writer
  • velox_dwio_text_writer_register
  • velox_dwrf_column_writer_index_test
  • velox_dwrf_column_writer_stats_test
  • velox_dwrf_column_writer_test
  • velox_dwrf_e2e_filter_test
  • velox_dwrf_e2e_reader_test
  • velox_dwrf_e2e_writer_test
  • velox_dwrf_float_column_writer_benchmark
  • velox_dwrf_int_encoder_benchmark
  • velox_dwrf_statistics_builder_utils_test
  • velox_dwrf_test_utils
  • velox_dwrf_writer_extended_test
  • velox_dwrf_writer_flush_test
  • velox_example_operator_extensibility
  • velox_example_scan_orc
  • velox_exchange_benchmark
  • velox_exchange_fuzzer
  • velox_exec_SpatialJoinTest
  • velox_exec_bm_duplicate_project
  • velox_exec_prefixsort_test
  • velox_exec_test_group0
  • velox_exec_test_group1
  • velox_exec_test_group3
  • velox_exec_test_group4
  • velox_exec_test_group7
  • velox_exec_vector_hasher_benchmark
  • velox_expression_fuzzer_test_utility
  • velox_expression_fuzzer_unit_test
  • velox_expression_runner_test
  • velox_expression_test_utility
  • velox_filemetadata_test
  • velox_filter_project_benchmark
  • velox_functions_aggregates
  • velox_functions_geo
  • velox_functions_iceberg_hash
  • velox_functions_json
  • velox_functions_json_test
  • velox_functions_spark_window
  • velox_functions_window
  • velox_functions_window_test_lib
  • velox_fuzzer_connector
  • velox_fuzzer_connector_test
  • velox_gcs
  • velox_gcs_file_test
  • velox_gcs_insert_test
  • velox_gcs_multiendpoints_test
  • velox_gcsfile_example
  • velox_hash_benchmark
  • velox_hash_join_build_benchmark
  • velox_hash_join_list_result_benchmark
  • velox_hash_join_prepare_join_table_benchmark
  • velox_hdfs
  • velox_hdfs_file_test
  • velox_hdfs_insert_test
  • velox_hive_iceberg_deletion_vector_test
  • velox_hive_iceberg_deletion_vector_writer_test
  • velox_hive_iceberg_equality_delete_test
  • velox_hive_iceberg_test
  • velox_hive_paimon_data_file_meta_test
  • velox_hive_paimon_deletion_file_test
  • velox_hive_paimon_row_kind_test
  • velox_hive_paimon_split
  • velox_hive_paimon_split_test
  • velox_hive_partition_function
  • velox_join_fuzzer
  • velox_key_encoder_test
  • velox_mark_distinct_fuzzer
  • velox_mark_distinct_fuzzer_lib
  • velox_mark_sorted_benchmark
  • velox_memory_arbitration_fuzzer
  • velox_memory_test
  • velox_merge_benchmark
  • velox_orderby_benchmark
  • velox_orderby_benchmark_util
  • velox_parquet_e2e_filter_test
  • velox_parquet_writer_sink_test
  • velox_parquet_writer_test
  • velox_parse_expression
  • velox_parse_parser
  • velox_parse_test
  • velox_prefixsort_benchmark
  • velox_presto_type_parser_test
  • velox_presto_types_fuzzer_utils
  • velox_prestosql_coverage
  • velox_query_benchmark
  • velox_query_replayer
  • velox_query_trace_replayer_base
  • velox_read_benchmark
  • velox_row_number_fuzzer
  • velox_row_number_fuzzer_lib
  • velox_row_serializer_benchmark
  • velox_row_test
  • velox_rpc_operator
  • velox_rpc_operator_test
  • velox_rpc_plan_node_translator
  • velox_s3config_test
  • velox_s3file_test
  • velox_s3finalize_test
  • velox_s3fs
  • velox_s3insert_test
  • velox_s3metrics_test
  • velox_s3multiendpoints_test
  • velox_s3read_test
  • velox_s3registration_test
  • velox_serializer_benchmark
  • velox_serializer_test_group0
  • velox_sort_benchmark
  • velox_spark_query_runner
  • velox_spark_query_runner_test
  • velox_spark_windows_test
  • velox_sparksql_coverage
  • velox_spatial_join_benchmark
  • velox_spatial_join_fuzzer
  • velox_spill_fuzzer_base_lib
  • velox_spiller_aggregate_benchmark
  • velox_spiller_aggregate_benchmark_base
  • velox_spiller_join_benchmark
  • velox_spiller_join_benchmark_base
  • velox_streaming_aggregation_benchmark
  • velox_table_evolution_fuzzer_test
  • velox_test_util_test
  • velox_text_reader_test
  • velox_text_writer_test
  • velox_tool_trace_test
  • velox_topn_row_number_fuzzer
  • velox_topn_row_number_fuzzer_lib
  • velox_tpcds_connector_test
  • velox_tpch_benchmark
  • velox_tpch_benchmark_lib
  • velox_trace_file_tool
  • velox_trace_file_tool_base
  • velox_unsafe_row_serialize_benchmark
  • velox_vector_fuzzer
  • velox_vector_fuzzer_test
  • velox_vector_test
  • velox_window
  • velox_window_fuzzer
  • velox_window_fuzzer_test
  • velox_window_prefixsort_benchmark
  • velox_window_sub_partitioned_sort_benchmark
  • velox_windows_agg_test
  • velox_windows_rank_test
  • velox_windows_value_test
  • velox_writer_fuzzer_test

Fast path • Graph from main@f1c6510ad978b913af37be3a775104e05479287d

@meta-codesync meta-codesync Bot changed the title perf(expr): Add EvalCtx constructor with pre-computed inputFlatNoNulls flag Add EvalCtx constructor with pre-computed inputFlatNoNulls flag Apr 17, 2026
@darxsys darxsys force-pushed the export-D101418306 branch from 59f232c to e45a320 Compare April 17, 2026 21:42
@darxsys darxsys changed the title Add EvalCtx constructor with pre-computed inputFlatNoNulls flag perf(expr): Add EvalCtx constructor with pre-computed inputFlatNoNulls flag Apr 17, 2026
@meta-codesync meta-codesync Bot changed the title perf(expr): Add EvalCtx constructor with pre-computed inputFlatNoNulls flag Add EvalCtx constructor with pre-computed inputFlatNoNulls flag (#17232) Apr 17, 2026
darxsys pushed a commit to darxsys/velox that referenced this pull request Apr 17, 2026
…bookincubator#17232)

Summary:

CONTEXT: When the same RowVector is evaluated across many ExprSet instances (e.g. ~1800 times in some cases), the EvalCtx constructor's per-column isFlatEncoding/mayHaveNulls loop runs redundantly for each new instance of EvalCtx, even though the data is the same — 39% of CPU in production.

WHAT: Add a new EvalCtx constructor overload that accepts a pre-computed inputFlatNoNulls flag, plus a static computeInputFlatNoNulls() helper. This lets callers compute the flag once and reuse it across all EvalCtx instances for the same RowVector. The original constructor now delegates to computeInputFlatNoNulls() to avoid code duplication.

Differential Revision: D101418306
@darxsys darxsys force-pushed the export-D101418306 branch from e45a320 to 5bd45b9 Compare April 17, 2026 23:26
@darxsys darxsys changed the title Add EvalCtx constructor with pre-computed inputFlatNoNulls flag (#17232) perf(expr): Add EvalCtx constructor with pre-computed inputFlatNoNulls flag (#17232) Apr 17, 2026
darxsys pushed a commit to darxsys/velox that referenced this pull request Apr 17, 2026
…s flag (facebookincubator#17232)

Summary:
Pull Request resolved: facebookincubator#17232

CONTEXT: When the same RowVector is evaluated across many ExprSet instances (e.g. ~1800 times in some cases), the EvalCtx constructor's per-column isFlatEncoding/mayHaveNulls loop runs redundantly for each new instance of EvalCtx, even though the data is the same — 39% of CPU in production.

WHAT: Add a new EvalCtx constructor overload that accepts a pre-computed inputFlatNoNulls flag, plus a static computeInputFlatNoNulls() helper. This lets callers compute the flag once and reuse it across all EvalCtx instances for the same RowVector. The original constructor now delegates to computeInputFlatNoNulls() to avoid code duplication.

Differential Revision: D101418306
@darxsys darxsys force-pushed the export-D101418306 branch 2 times, most recently from 8db05d0 to 027e653 Compare April 20, 2026 21:37
darxsys pushed a commit to darxsys/velox that referenced this pull request Apr 20, 2026
…s flag (facebookincubator#17232)

Summary:

CONTEXT: When the same RowVector is evaluated across many ExprSet instances (e.g. ~1800 times in some cases), the EvalCtx constructor's per-column isFlatEncoding/mayHaveNulls loop runs redundantly for each new instance of EvalCtx, even though the data is the same — 39% of CPU in production.

WHAT: Add a new EvalCtx constructor overload that accepts a pre-computed inputFlatNoNulls flag, plus a static computeInputFlatNoNulls() helper. This lets callers compute the flag once and reuse it across all EvalCtx instances for the same RowVector. The original constructor now delegates to computeInputFlatNoNulls() to avoid code duplication.

Differential Revision: D101418306
…s flag (facebookincubator#17232)

Summary:
Pull Request resolved: facebookincubator#17232

CONTEXT: When the same RowVector is evaluated across many ExprSet instances (e.g. ~1800 times in some cases), the EvalCtx constructor's per-column isFlatEncoding/mayHaveNulls loop runs redundantly for each new instance of EvalCtx, even though the data is the same — 39% of CPU in production.

WHAT: Add a new EvalCtx constructor overload that accepts a pre-computed inputFlatNoNulls flag, plus a static computeInputFlatNoNulls() helper. This lets callers compute the flag once and reuse it across all EvalCtx instances for the same RowVector. The original constructor now delegates to computeInputFlatNoNulls() to avoid code duplication.

Differential Revision: D101418306
@darxsys darxsys force-pushed the export-D101418306 branch from 027e653 to 15df915 Compare April 20, 2026 21:40
@meta-codesync meta-codesync Bot closed this in 3eb73e9 Apr 21, 2026
@meta-codesync
Copy link
Copy Markdown

meta-codesync Bot commented Apr 21, 2026

This pull request has been merged in 3eb73e9.

shrshi pushed a commit to patdevinwilson/velox that referenced this pull request Apr 23, 2026
…s flag (facebookincubator#17232)

Summary:
Pull Request resolved: facebookincubator#17232

CONTEXT: When the same RowVector is evaluated across many ExprSet instances (e.g. ~1800 times in some cases), the EvalCtx constructor's per-column isFlatEncoding/mayHaveNulls loop runs redundantly for each new instance of EvalCtx, even though the data is the same — 39% of CPU in production.

WHAT: Add a new EvalCtx constructor overload that accepts a pre-computed inputFlatNoNulls flag, plus a static computeInputFlatNoNulls() helper. This lets callers compute the flag once and reuse it across all EvalCtx instances for the same RowVector. The original constructor now delegates to computeInputFlatNoNulls() to avoid code duplication.

Reviewed By: Yuhta

Differential Revision: D101418306

fbshipit-source-id: 68e78b5d47d1b9e36b5c3532dffaa3a5206f1a05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported Merged meta-exported

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants