Skip to content

Commit ec74185

Browse files
committed
Merge branch 'main' of github.com:apache/iceberg-python into fd-fix-double-commit
2 parents 17fe4c2 + 9185389 commit ec74185

File tree

15 files changed

+881
-565
lines changed

15 files changed

+881
-565
lines changed

.github/ISSUE_TEMPLATE/iceberg_bug_report.yml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,8 @@ body:
2828
description: What Apache Iceberg version are you using?
2929
multiple: false
3030
options:
31-
- "0.9.0 (latest release)"
31+
- "0.9.1 (latest release)"
32+
- "0.9.0"
3233
- "0.8.1"
3334
- "0.8.0"
3435
- "0.7.1"

.gitignore

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -35,6 +35,7 @@ coverage.xml
3535
.project
3636
.settings
3737
bin/
38+
.vscode/
3839

3940
# Hive/metastore files
4041
metastore_db/

dev/docker-compose-integration.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -81,7 +81,7 @@ services:
8181
- AWS_REGION=us-east-1
8282
entrypoint: >
8383
/bin/sh -c "
84-
until (/usr/bin/mc config host add minio http://minio:9000 admin password) do echo '...waiting...' && sleep 1; done;
84+
until (/usr/bin/mc alias set minio http://minio:9000 admin password) do echo '...waiting...' && sleep 1; done;
8585
/usr/bin/mc mb minio/warehouse;
8686
/usr/bin/mc policy set public minio/warehouse;
8787
tail -f /dev/null

dev/docker-compose.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -38,7 +38,7 @@ services:
3838
- AWS_REGION=us-east-1
3939
entrypoint: >
4040
/bin/sh -c "
41-
until (/usr/bin/mc config host add minio http://minio:9000 admin password) do echo '...waiting...' && sleep 1; done;
41+
until (/usr/bin/mc alias set minio http://minio:9000 admin password) do echo '...waiting...' && sleep 1; done;
4242
/usr/bin/mc rm -r --force minio/warehouse;
4343
/usr/bin/mc mb minio/warehouse;
4444
/usr/bin/mc policy set public minio/warehouse;

mkdocs/docs/configuration.md

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -95,6 +95,7 @@ Iceberg works with the concept of a FileIO which is a pluggable module for readi
9595
- **hdfs**: `PyArrowFileIO`
9696
- **abfs**, **abfss**: `FsspecFileIO`
9797
- **oss**: `PyArrowFileIO`
98+
- **hf**: `FsspecFileIO`
9899

99100
You can also set the FileIO explicitly:
100101

@@ -154,6 +155,7 @@ For the FileIO there are several configuration options available:
154155
| adls.tenant-id | ad667be4-b811-11ed-afa1-0242ac120002 | The tenant-id |
155156
| adls.client-id | ad667be4-b811-11ed-afa1-0242ac120002 | The client-id |
156157
| adls.client-secret | oCA3R6P\*ka#oa1Sms2J74z... | The client-secret |
158+
| adls.account-host | accountname1.blob.core.windows.net | The storage account host. See [AzureBlobFileSystem](https://github.com/fsspec/adlfs/blob/adb9c53b74a0d420625b86dd00fbe615b43201d2/adlfs/spec.py#L125) for reference |
157159

158160
<!-- markdown-link-check-enable-->
159161

@@ -193,6 +195,17 @@ PyIceberg uses [S3FileSystem](https://arrow.apache.org/docs/python/generated/pya
193195

194196
<!-- markdown-link-check-enable-->
195197

198+
### Hugging Face
199+
200+
<!-- markdown-link-check-disable -->
201+
202+
| Key | Example | Description |
203+
| ----------- | ------------------------ | --------------------------------------------------------- |
204+
| hf.endpoint | <https://huggingface.co> | Configure the endpoint for Hugging Face |
205+
| hf.token | hf_xxx | The Hugging Face token to access HF Datasets repositories |
206+
207+
<!-- markdown-link-check-enable-->
208+
196209
### PyArrow
197210

198211
<!-- markdown-link-check-disable -->

poetry.lock

Lines changed: 384 additions & 400 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)