feat: update to datafusion 52

[sunng87]

Updated datafusion to 52 and adopt FileSource APi changes

[sunng87]

Seems we will need to wait until datafusion-python update to 52 and see if it fixes the segment fault when registering udf.

[gstamatakis95]

👋 Since the mentioned PR got merged is this still being blocked? If so I would be happy to contribute as this is blocking something on my end as well. Thanks in advance.

[kylebarron]

I think you might need to just update the version of datafusion-python in the dependencies?

[sunng87]

We still need 52 to be released on pypi

[timsaucer]

datafusion-python 52.0.0 is released. Do you need any help moving this PR along?

[kylebarron]

I'm at a company offsite this week; if you're able to just push the edit bumping to the latest pypi version that would be great. I sent you a collaboration invite too if you're interested

[timsaucer]

Since the FFI boundary is unstable I took the liberty of adding in major version requirements to make sure we don't allow mixing things like DF51 with a 52 based library. I also bumped Python to 3.10 since 3.9 is past end of life and DF-python's minimum version supported is 3.10.

[kylebarron]

Awesome thank you!