How to load multiple parquet files from folder into table in one go?
LOAD DATA S3 's3://bucket-name/example_table/'
CONFIG '{"region" : "ap-south-1"}'
CREDENTIALS '{"aws_access_key_id" : "{aws_access_key_id}", "aws_secret_access_key": "{aws_secret_access_key}"}'
INTO TABLE example_table (ID <- ID, CREATED_AT <- CREATED_AT, UPDATED_AT <- UPDATED_AT)
FORMAT PARQUET;
I tried following but it says “Query 2 ERROR at Line 2: : ‘LOAD DATA S3’ can’t process more than one file per query. Files found: 2. Consider using pipelines to load all the data”