Hi Im trying to load data from parquet file into Singlestore using pipeline.
I have a repeated group field here and I am unable to load this data as singstore throws this error
Feature ‘loading repeated parquet fields’ is not supported by SingleStore. Field path PERSONA::key_value::value references a list element in schema
Is there a way around this?
This is my Parquet Schema
{
optional binary field_id=-1 Field1 (String);
optional binary field_id=-1 field 2 (String);
optional binary field_id=-1 Field 3 (String);
optional group field_id=-1 PERSONA (Map) {
repeated group field_id=-1 key_value {
required binary field_id=-1 key (String);
optional binary field_id=-1 value (String);
}
}
}
My pipeline code is
INTO TABLE `table1`
FORMAT Parquet
(
`Field1` <- `Field1` DEFAULT NULL,
`Field2` <- `Field2`,
`Field3` <- `Field3`,
Field4 <- `PERSONA`::key_value::value DEFAULT NULL
)