Skip to content

Latest commit

 

History

History
108 lines (88 loc) · 10.9 KB

File metadata and controls

108 lines (88 loc) · 10.9 KB

Daft Benchmark Report

Auto-generated by the LakeBench integration test suite.
Last updated: 2026-08-03 23:19:40 UTC


TPC-H

⚠️ 21/22 queries passed (95.5%)

Failed queries

Querie Error
q21 DaftCoreException: DaftError::ValueError Failed to bind predicate for row group pruning on 'C:/Users/milescole/AppData/Local/Temp/pytest-of-milescole/pytest-116/test_tpch_daft0/tpch/lineitem/0-81ab440a-ff6a-4bbd-9e4f-8b67b755271a-0.parquet': DaftError::InternalError Outer reference columns cannot be

TPC-DS

⚠️ 46/103 queries passed (44.7%)

Failed queries

Querie Error
q2 InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::TypeError Cannot infer supertypes for divide on types: Decimal[precision: 38, scale: 2], Decimal[precision: 38, scale: 2] result precision: 77 exceed bounds of [1, 38]. scale: 41
q4 InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::TypeError Cannot infer supertypes for divide on types: Decimal[precision: 38, scale: 13], Decimal[precision: 38, scale: 13] result precision: 77 exceed bounds of [1, 38]. scale: 52
q5 InvalidSQLException: Invalid operation: Interval value must be a string
q10 DaftCoreException: DaftError::ComputeError EXISTS should be optimized away before evaluation. This indicates a bug in the query optimizer.
q11 InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::TypeError Cannot infer supertypes for divide on types: Decimal[precision: 38, scale: 2], Decimal[precision: 38, scale: 2] result precision: 77 exceed bounds of [1, 38]. scale: 41
q12 InvalidSQLException: Invalid operation: Interval value must be a string
q13 InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::AmbiguousReference Column name "ss_ext_wholesale_cost" is ambiguous in schema: [Field { name: "ss_ext_sales_price", dtype: Decimal128(38, 6), metadata: {} }, Field { name: "ss_quantity", dtype
q14a InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::TypeError Cannot perform comparison on types: Decimal[precision: 38, scale: 2], Decimal[precision: 38, scale: 6] Details: DaftError::TypeError Cannot infer supertypes for comparison on types:
q14b InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::TypeError Cannot perform comparison on types: Decimal[precision: 38, scale: 2], Decimal[precision: 38, scale: 6] Details: DaftError::TypeError Cannot infer supertypes for comparison on types:
q16 InvalidSQLException: Invalid operation: Interval value must be a string
q20 InvalidSQLException: Invalid operation: Interval value must be a string
q21 InvalidSQLException: Invalid operation: Interval value must be a string
q22 InvalidSQLException: Unsupported SQL: 'data type: Signed'
q27 InvalidSQLException: Unsupported SQL: 'Function grouping not found'
q28 InvalidSQLException: Unsupported SQL: 'Unsupported join type: CrossJoin(None)'
q31 InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::TypeError Cannot infer supertypes for divide on types: Decimal[precision: 38, scale: 2], Decimal[precision: 38, scale: 2] result precision: 77 exceed bounds of [1, 38]. scale: 41
q32 InvalidSQLException: Invalid operation: Interval value must be a string
q35 InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::AmbiguousReference Column name "cd_dep_count" is ambiguous in schema: [Field { name: "ca_state", dtype: Utf8, metadata: {} }, Field { name: "cd_gender", dtype: Utf8, metadata: {} }, Field { na
q36 InvalidSQLException: Unsupported SQL: 'Function grouping not found'
q37 InvalidSQLException: Invalid operation: Interval value must be a string
q39a InvalidSQLException: Unsupported SQL: 'CASE with operand not yet supported'
q39b InvalidSQLException: Unsupported SQL: 'CASE with operand not yet supported'
q40 InvalidSQLException: Invalid operation: Interval value must be a string
q41 DaftCoreException: DaftError::ValueError Failed to bind predicate for row group pruning on 'C:/Users/milescole/AppData/Local/Temp/pytest-of-milescole/pytest-116/test_tpcds_daft0/tpcds/item/0-bf6efebc-0864-485c-93da-aa3cb4a0dd24-0.parquet': DaftError::InternalError Outer reference columns cannot be b
q45 DaftCoreException: DaftError::ComputeError IN should be optimized away before evaluation. This indicates a bug in the query optimizer.
q47 InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::TypeError Cannot infer supertypes for subtraction on types: Decimal[precision: 38, scale: 2], Decimal[precision: 38, scale: 6] result precision: 43 exceed bounds of [1, 38]
q49 DaftCoreException: Unable to create logical plan node. Due to Caused by the following errors: 1: DaftError::TypeError could not determine supertype of Decimal128(7, 2) and Int64
q51 DaftCoreException: DaftError::InternalError Outer reference columns cannot be bound: col(ws_sales_price)
q53 InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::TypeError Cannot infer supertypes for subtraction on types: Decimal[precision: 38, scale: 2], Decimal[precision: 38, scale: 6] result precision: 43 exceed bounds of [1, 38]
q54 InvalidSQLException: Unsupported SQL: 'data type: Signed'
q57 InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::TypeError Cannot infer supertypes for subtraction on types: Decimal[precision: 38, scale: 2], Decimal[precision: 38, scale: 6] result precision: 43 exceed bounds of [1, 38]
q58 InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::TypeError Cannot infer supertypes for addition on types: Decimal[precision: 38, scale: 2], Decimal[precision: 38, scale: 2] result precision: 39 exceed bounds of [1, 38]
q59 InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::TypeError Cannot infer supertypes for divide on types: Decimal[precision: 38, scale: 2], Decimal[precision: 38, scale: 2] result precision: 77 exceed bounds of [1, 38]. scale: 41
q61 InvalidSQLException: Unsupported SQL: 'Unsupported join type: CrossJoin(None)'
q63 InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::TypeError Cannot infer supertypes for subtraction on types: Decimal[precision: 38, scale: 2], Decimal[precision: 38, scale: 6] result precision: 43 exceed bounds of [1, 38]
q64 InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::TypeError Cannot infer supertypes for multiply on types: Decimal[precision: 20, scale: 0], Decimal[precision: 38, scale: 2] result precision: 58 exceed bounds of [1, 38]
q65 DaftCoreException: Not Yet Implemented: Execution of non-equality join
q66 InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::TypeError Expected if_true and if_false arguments for if_else to be castable to the same supertype, but received ws_net_profit#Decimal[precision: 27, scale: 2] and literal#Int64
q67 InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::TypeError could not determine supertype of Decimal128(27, 2) and Int64
q70 InvalidSQLException: Unsupported SQL: 'Function grouping not found'
q72 InvalidSQLException: Invalid operation: Interval value must be a string
q74 InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::TypeError Cannot infer supertypes for divide on types: Decimal[precision: 38, scale: 6], Decimal[precision: 38, scale: 6] result precision: 77 exceed bounds of [1, 38]. scale: 45
q75 InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::TypeError could not determine supertype of Decimal128(7, 2) and Float64
q77 InvalidSQLException: Invalid operation: Interval value must be a string
q78 InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::TypeError could not determine supertype of Decimal128(38, 2) and Int64
q80 InvalidSQLException: Invalid operation: Interval value must be a string
q82 InvalidSQLException: Invalid operation: Interval value must be a string
q86 InvalidSQLException: Unsupported SQL: 'Function grouping not found'
q87 InvalidSQLException: Unsupported SQL: 'Subqueries are not supported'
q88 InvalidSQLException: Unsupported SQL: 'Unsupported join type: CrossJoin(None)'
q89 InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::TypeError Cannot infer supertypes for subtraction on types: Decimal[precision: 38, scale: 2], Decimal[precision: 38, scale: 6] result precision: 43 exceed bounds of [1, 38]
q90 InvalidSQLException: Unsupported SQL: 'Unsupported join type: CrossJoin(None)'
q92 InvalidSQLException: Invalid operation: Interval value must be a string
q94 InvalidSQLException: Invalid operation: Interval value must be a string
q95 InvalidSQLException: Invalid operation: Interval value must be a string
q97 InvalidSQLException: Table not found: ssci
q98 InvalidSQLException: Invalid operation: Interval value must be a string

ClickBench

⚠️ 38/43 queries passed (88.4%)

Failed queries

Querie Error
q7 InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::AmbiguousReference Column name "EventDate" is ambiguous in schema: [Field { name: "EventDate", dtype: Date, metadata: {} }, Field { name: "EventDate", dtype: Date, metadata: {} }]
q28 InvalidSQLException: Unsupported SQL: 'Function char_length not found'
q29 InvalidSQLException: Unsupported SQL: 'Function char_length not found'
q30 InvalidSQLException: Daft error: DaftError::External Unable to create logical plan node. Due to: DaftError::AmbiguousReference Column name "ResolutionWidth" is ambiguous in schema: [Field { name: "ResolutionWidth", dtype: Int64, metadata: {} }, Field { name: "ResolutionWidth", dtype: Int64, metadata
q43 InvalidSQLException: Unsupported SQL: 'Function timestampdiff not found'

ELTBench

12/12 tasks passed (100.0%)