[Python] Unhandled type for Arrow to Parquet schema conversion: month_day_nano_interval

[FoxHeather]

Describe the bug, including details regarding any error messages, version, and platform.

Perform Python code to generate a parquet data with interval type, using APACHE ARROW.
Display error as below:

pyarrow.lib.ArrowNotImplementedError:
Unhandled type for Arrow to Parquet schema conversion: month_day_nano_interval

import pyarrow as pa
import pyarrow.parquet as pq

Define Schema

schema = pa.schema([
('itv', pa.month_day_nano_interval())
])

itv = pa.array([ (13,25,1000) ], type = pa.month_day_nano_interval())

Generate Parquet data

batch = pa.RecordBatch.from_arrays(
[itv], schema = schema
)
table = pa.Table.from_batches([batch])

Write Parquet file pqtpitvl.parquet

pq.write_table(table, 'pqtpitvl.parquet')

display error

with ParquetWriter(
     ^^^^^^^^^^^^^^

File "C:\Users\FoxHeather\AppData\Local\Programs\Python\Python311\Lib\site-packages\pyarrow\parquet\core.py", line 966, in init
self.writer = _parquet.ParquetWriter(
^^^^^^^^^^^^^^^^^^^^^^^
File "pyarrow_parquet.pyx", line 1748, in pyarrow._parquet.ParquetWriter.cinit
File "pyarrow\error.pxi", line 121, in pyarrow.lib.check_status
pyarrow.lib.ArrowNotImplementedError: Unhandled type for Arrow to Parquet schema conversion: month_day_nano_interval

Component(s)

Python

[FoxHeather]

@emkornfield could you have a look this error?

[FoxHeather]

@westonpace do you have any idea for this?

[mapleFU]

Seems interval is not handled by FieldToNode:

Status FieldToNode(const std::string& name, const std::shared_ptr<Field>& field,
                   const WriterProperties& properties,
                   const ArrowWriterProperties& arrow_properties, NodePtr* out)

You can:

1. Cast interval to time64 duration or other supported types, event int64 or extended types
2. Maybe we can cast it to https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#interval , but it need some further development

[FoxHeather]

This is whole error message

with ParquetWriter(
     ^^^^^^^^^^^^^^

File "C:\Users\FoxHeather\AppData\Local\Programs\Python\Python311\Lib\site-packages\pyarrow\parquet\core.py", line 966, in init
self.writer = _parquet.ParquetWriter(
^^^^^^^^^^^^^^^^^^^^^^^
File "pyarrow_parquet.pyx", line 1748, in pyarrow._parquet.ParquetWriter.cinit
File "pyarrow\error.pxi", line 121, in pyarrow.lib.check_status
pyarrow.lib.ArrowNotImplementedError:
Unhandled type for Arrow to Parquet schema conversion: month_day_nano_interval

@mapleFU

[mapleFU]

Pyarrow is just a wrapper, finally it would goes here: https://github.com/apache/arrow/blob/main/cpp/src/parquet/arrow/schema.cc#L433-L438

[jorisvandenbossche]

Closing as duplicate of #36799