Skip to content

feat: add datafusion adbc table provider notebook#12

Open
esadek wants to merge 3 commits intomainfrom
datafusion-adbc
Open

feat: add datafusion adbc table provider notebook#12
esadek wants to merge 3 commits intomainfrom
datafusion-adbc

Conversation

@esadek
Copy link
Copy Markdown
Collaborator

@esadek esadek commented Apr 17, 2026

Closes #8

@esadek esadek requested a review from ianmcook April 17, 2026 22:10
@esadek
Copy link
Copy Markdown
Collaborator Author

esadek commented Apr 17, 2026

Here's a screenshot of the recipe:

image

@ianmcook
Copy link
Copy Markdown
Member

ianmcook commented Apr 19, 2026

I’d suggest adding a paragraph explaining that although this demo uses DuckDB for convenience, the real power of this ADBC table provider is that it gives DataFusion access to more than a dozen different data systems that don’t have a dedicated DataFusion table provider, especially cloud data platforms like Snowflake. The second paragraph says some of this already but I think it should explicitly acknowledge that DuckDB is not really the greatest system to demonstrate this with.

".unwrap()"
]
},
{
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The output of this cell is just None so it'd probably be better to hide it.

"\n",
"[ADBC](https://arrow.apache.org/adbc/) (Arrow Database Connectivity) is a database-agnostic API that retrieves query results directly in Arrow format, making it an efficient bridge between DataFusion and external databases. This demo uses DuckDB for simplicity, but ADBC's real value is providing DataFusion with access to more than a dozen different data systems that lack dedicated table providers.\n",
"\n",
"In this notebook, you will:\n",
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
"In this notebook, you will:\n",
"In this Rust-language notebook, you will:\n",

],
"source": [
"let df = ctx\n",
" .sql(\"SELECT * FROM datafusion.public.penguins LIMIT 10\")\n",
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What dialect of SQL is expected here? DataFusion or DuckDB? Can you add a note to clarify this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add recipe demonstrating DataFusion ADBC table provider

2 participants