Documentation IndexFetch the complete documentation index at: /llms.txtUse this file to discover all available pages before exploring further.
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
配置 S3 兼容的对象存储数据源,支持 AWS S3、MinIO 及各大云厂商
type
string
"s3"
endpoint
access_key
secret_key
bucket
prefix
region
"us-east-1"
source = S3Source( endpoint='https://your-s3-endpoint.com', access_key='your-access-key-id', secret_key='your-secret-access-key', bucket='your-bucket-name', prefix='documents/', # 可选,指定文件夹前缀 region='us-east-1' # 可选,默认为 us-east-1 )
from xparse_client import S3Source, Pipeline source = S3Source( endpoint='https://oss-cn-hangzhou.aliyuncs.com', # 阿里云 OSS 端点 access_key='your-access-key-id', secret_key='your-secret-access-key', bucket='my-documents', prefix='pdfs/', # 只处理 pdfs/ 文件夹下的文件 region='cn-hangzhou' ) # ... 其他配置 pipeline = Pipeline( source=source, # ...其他配置 ) pipeline.run()
此页面对您有帮助吗?