You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem?
In Sanity the Testing, we only test for the JSON format data, and each query will scan 1045 JSON files, that is the primary slowness during Spark execution (~90% time spent on file scan). Can parquet file format be able to use? It could be much and much faster. We didn't test other data format cases.
What solution would you like?
Not sure it is supported or not. Close it if this is already supported.
What alternatives have you considered?
A clear and concise description of any alternative solutions or features you've considered.
Do you have any additional context?
Add any other context or screenshots about the feature request here.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem?
In Sanity the Testing, we only test for the JSON format data, and each query will scan 1045 JSON files, that is the primary slowness during Spark execution (~90% time spent on file scan). Can parquet file format be able to use? It could be much and much faster. We didn't test other data format cases.
What solution would you like?
Not sure it is supported or not. Close it if this is already supported.
What alternatives have you considered?
A clear and concise description of any alternative solutions or features you've considered.
Do you have any additional context?
Add any other context or screenshots about the feature request here.
The text was updated successfully, but these errors were encountered: