Destination configuration
destination:
type: file-jsonl # see table
fileprefix: output # required for file-* types
compress: gz # optional: gz, bz2, xz, zip, zst
compress and compression are both accepted. zst needs the
compression extra: pip install "datacrafter[compression]".
File types
| Type | Extension | Extra package |
|---|---|---|
file-jsonl | .jsonl | — |
file-bson | .bson | — |
file-csv | .csv | optional delimiter / quotechar |
file-parquet | .parquet | pyarrow (datacrafter[parquet]) |
File destinations write output/datapackage.json beside the data file.
Databases and search
destination:
type: mongodb
connstr: "${MONGO_URI}"
dbname: mydb
tablename: mytable
| Type | Package |
|---|---|
mongodb | pymongo |
arangodb | python-arango |
couchdb | pycouchdb |
meilisearch | meilisearch |
Concepts: Destinations.