feat: Support loading parquet files from local disk

[as51340]

A new query is added LOAD PARQUET FROM.... New library arrow is added which is built through libs folder functionality. Loading parquet files uses a prefetcher thread which operates in column batches and from such column-wise oriented data, assembles rows which the main execution thread at the end just pulls. That's how we hide the cost of assembling rows from column-oriented data. To avoid copying allocated data from the background thread to the main thread, we make use of thread-safe memory resource. A new data queue is added which is used as a shared resource between the prefetcher and the main thread.

The class utils::Date supports instantiation now using the number of days and the number of microseconds passed since UNIX epoch.

[as51340]

Tracking

• [Link to Epic/Issue]

Standard development

• Update unit/E2E tests
• Compare the benchmarking results between the master branch this branch

CI Testing Labels

• Select the appropriate CI test labels (CI -build=build-name -test=test-suite)

Documentation checklist

• Add the documentation label
• Add the bug / feature label
• Add the milestone for which this feature is intended
  • If not known, set for a later milestone
• Write a release note, including added/changed clauses
  • Memgraph now supports loading Parquet files directly from the local filesystem. Users can now use LOAD PARQUET FROM /path/to/file.parquet in their Cypher queries for efficient bulk data import. This eliminates the need for manual CSV conversion and provides significantly faster import performance for large datasets. #3356
  • What has changed? What does it mean for a user? What should a user do with it? [#{{PR_number}}]({{link to the PR}})
• Documentation PR link
  • Is back linked to this development PR

[sonarqubecloud]

Quality Gate passed

Issues
7 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
3.6% Duplication on New Code

See analysis details on SonarQube Cloud