How to infer schema from (s3) parquet?

Help Connectors and Pipelines
1

Hi,
I have created a table with col1, col2, col3.
I’d like to load my parquet which has simply 3 columns: col1, col2, col3.

Yet i need to define mapping.
Is there a way to infer schema from the file instead of doing this?

(i’d love to see e.g a mapping tool in studio - even if just generates a code for you)

Thanks
Dani

2

For now, no, we don’t support auto-inference. However, we are in fact working on (1) inferring parquet field -> sql col mappings based on name similarity and (2) a create table as pipeline feature, where we create the table from the parquet schema in the first place.

3

i’ll try out ctap, sounds great.