Destinations

Destinations receive transformed records. Types:

Files: file-jsonl, file-bson, file-csv, file-parquet (needs pyarrow).

Stores: mongodb, arangodb, couchdb, meilisearch.

File names are fileprefix plus the type extension. Optional compression: xz, gz, bz2, zip, zst. Both compress and compression keys work. Storage is local today.

destination:
  type: file-bson
  compress: xz
  storage: local
  fileprefix: fnspaytax

File destinations also write output/datapackage.json (Frictionless Data Package) next to the data file.

MongoDB example:

destination:
  type: mongodb
  connstr: "${MONGO_URI}"
  dbname: mydb
  tablename: mydata

YAML details: Destination configuration.

Planned (not implemented): JSON/YAML file destinations, ClickHouse / SQLAlchemy, and remote storage (S3, FTP, WebDAV).