-
Notifications
You must be signed in to change notification settings - Fork 75
Implement SharePoint data extraction sources and configuration classes #661
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Conversation
|
|
…ion definitions in SharePoint modules
…tFilesConfig classes
|
Hi @WangCHEN9, thanks for the contribution! Could add the tests you have written for the source? btw, please rebase on master, some import failures were fixed which were causing ci errors |
- Updated `pyproject.toml` to include SharePoint dependencies. - Created `README.md` for SharePoint source documentation. - Implemented SharePoint client in `helpers.py` for API interaction. - Added configuration classes in `sharepoint_files_config.py` for lists and files. - Developed extraction functions in `__init__.py` for SharePoint lists and files. - Created unit tests for SharePoint source in `test_sharepoint_source.py`. - Added requirements file for SharePoint source dependencies.
…epointFilesSource tests for clarity
Added tests |
Introduce classes and functions for extracting data from SharePoint lists and files, including configuration for file types and paths. This implementation supports both list and file data extraction into a DuckDB pipeline.