DESCRIBE tables through Spark retrieves String instead of Varchar

Help Connectors and Pipelines
1

Hello Everyone,

I’ve been trying to retrieve a DESCRIBE result from MemSQL to a dataframe, however it retrieves String for the columns that are VARCHAR(XX). Does someone know how can I get exactly the column types as it is retrieved on MySQL Workbench?

Ex: MySQL Workbench:
±------------------±--------±------+
| col_name|data_type|comment|
±------------------±--------±------+
|name| varchar(5)| null|

Dataframe
±------------------±--------±------+
| col_name|data_type|comment|
±------------------±--------±------+
|name| String| null|

2

Hello lfsffernandes

Welcome to MemSQL Forums!

That is the default mapping of the MemSQL Varchar datatype to Spark Dataframe

Please see our docs for the details of how each datatype is mapped

Thanks,