Convert a CSV file into ION.
type: "io.kestra.plugin.serdes.csv.csvtoion"Convert a CSV file to the Amazon Ion format.
id: csv_to_ion
namespace: company.team
tasks:
- id: http_download
type: io.kestra.plugin.core.http.Download
uri: https://huggingface.co/datasets/kestra/datasets/raw/main/csv/products.csv
- id: to_ion
type: io.kestra.plugin.serdes.csv.CsvToIon
from: "{{ outputs.http_download.uri }}"
Source file URI
Pebble expression referencing an Internal Storage URI e.g. {{ outputs.mytask.uri }}.
falseAllow extra characters after a closing quote
UTF-8The name of a supported charset
falseSpecifies if an exception should be thrown, if CSV data contains different field count
,The field separator character
trueSpecifies if the first line should be the header
16777216Maximum CSV parser buffer size (bytes)
16777216Maximum field size (characters)
ERRORERRORWARNSKIPHow to handle bad lines (e.g., a line with too many fields).
falseSpecifies if empty rows should be skipped
0Number of lines to skip at the start of the file
"The text delimiter character
uriURI of a temporary result file