feat(datafusion): add map methods to datafusion compiler

[venkat-oss]

• Added Datafusion supported map functions to Datafusion compiler.
• This PR in Datafusion repo adds support for certain map functions.

ops.Map - ✅ (Already supported by ibis)
ops.MapLength - ✅
ops.MapGet - ✅
ops.MapContains - ✅
ops.MapKeys - ✅
ops.MapValues - ✅
ops.MapMerge - 🆘 Need help

[venkat-oss]

@gforsyth and @cpcloud could you please provide some feedback/pointers on how MapMerge could be implemented?

I'm not very sure how MapMerge could be implemented unless supported by datafusion.

[IndexSeek]

Very nice! Thank you for working on this, @venkat-oss.

Could you remove the "notyet" markers in the tests so that we can ensure these operations run properly with DataFusion? Here is an example of a marker and where they can be found in the case of the tests for map:

ibis/ibis/backends/tests/test_map.py

Lines 657 to 660 in db8af10

	@mark_notyet_datafusion
	def test_map_length(con):
	expr = ibis.literal(dict(a="A", b="B")).length()
	assert con.execute(expr) == 2

After this, can you run your code through the linter? If you have just, you can do: just fmt. This command will run the following (in case you don't have just available):

    ruff format .
    ruff check --fix .

[cpcloud]

@venkat-oss Any chance you can continue work on this PR? It looks like there are a sizable number of map-type test failures related to your new implementations. Let us know if you need some assistance.

[venkat-oss]

Will try to get this over the finish line soon @cpcloud 👍🏼