Update datasets requirement from ~=3.2.0 to >=3.2,<4.1

Updates the requirements on [datasets](https://github.com/huggingface/datasets) to permit the latest version.
- [Release notes](https://github.com/huggingface/datasets/releases)
- [Commits](huggingface/datasets@3.2.0...4.0.0)

---
updated-dependencies:
- dependency-name: datasets
  dependency-version: 4.0.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Author: dependabot[bot]

pyproject.toml

@@ -50,7 +50,7 @@ dependencies = [ #TODO: can add optional dependencies
 'torch-geometric~=2.5.2',
 'torch-scatter~=2.1.2',
 'transformers~=4.42.4',
-'datasets~=3.2.0', #for HF datasets
+'datasets>=3.2,<4.1', #for HF datasets
 # 'causal-conv1d>=1.4.0', #For jamba/mamba
 # 'mamba-ssm~=2.2.4', #For jamba/mamba
 # 'flash-attn~=2.7.4.post1', #Flash Attention

requirements.txt

@@ -14,7 +14,7 @@ scipy~=1.15.2
 torch-geometric~=2.5.2
 torch-scatter~=2.1.2
 transformers~=4.42.4
-datasets~=3.2.0 #for HF datasets
+datasets>=3.2,<4.1 #for HF datasets
 # causal-conv1d>=1.4.0 #For jamba/mamba
 # mamba-ssm~=2.2.4 #For jamba/mamba
 # flash-attn~=2.7.4.post1 #Flash Attention