table.append(df)
File "/.venv/lib/python3.11/site-packages/pyiceberg/table/__init__.py", line 1427, in append
tx.append(df=df, snapshot_properties=snapshot_properties, branch=branch)
File "/.venv/lib/python3.11/site-packages/pyiceberg/table/__init__.py", line 520, in append
with self._append_snapshot_producer(snapshot_properties, branch=branch) as append_files:
File "/.venv/lib/python3.11/site-packages/pyiceberg/table/update/__init__.py", line 76, in __exit__
self.commit()
File "/.venv/lib/python3.11/site-packages/pyiceberg/table/update/__init__.py", line 72, in commit
self._transaction._apply(*self._commit())
^^^^^^^^^^^^^^
File "/.venv/lib/python3.11/site-packages/pyiceberg/table/update/snapshot.py", line 290, in _commit
with write_manifest_list(
File "/.venv/lib/python3.11/site-packages/pyiceberg/manifest.py", line 1289, in __exit__
self._writer.__exit__(exc_type, exc_value, traceback)
File "/.venv/lib/python3.11/site-packages/pyiceberg/avro/file.py", line 269, in __exit__
self.output_stream.close()
File "pyarrow/io.pxi", line 207, in pyarrow.lib.NativeFile.close
File "pyarrow/error.pxi", line 92, in pyarrow.lib.check_status
OSError: When completing multiple part upload for key 'metadata/snap-removed.avro' in bucket 'removed--table-s3': AWS Error UNKNOWN (HTTP status 400) during CompleteMultipartUpload operation: Unable to parse ExceptionName: S3TablesUnsupportedHeader Message: S3 Tables does not support the following header: xxpect value: 100-continue
We were able to connect, list and query the table fine, the issue only occurs when trying to write.
Apache Iceberg version
0.11.0 (latest release)
Please describe the bug 🐞
When trying to write to an S3 Tables bucket, we receive the following error:
We were able to connect, list and query the table fine, the issue only occurs when trying to write.
Debian 11
Python 3.11.9
pyiceberg==0.11.1
pyiceberg-core==0.8.0
boto3==1.43.8
botocore==1.43.8
Thanks
Willingness to contribute