Data Lake using Single Store DB

Off-Topic
1

Hi There,

Has anyone created a data lake using single store yet ??
If yes please let me know so we can connect and discuss about it.

Thanks,
Vishwajeet

2

Hi @vishwajeetdabholkar,

It’s popular to use SingleStore as a data lake accelerator. Basically, you use S3 or HDFS SingleStore “pipelines” to load data from your data lake into SingleStore and direct queries to SingleStore. SingleStore’s compiled, distributed and columnstore query processing is super fast, much faster than native query processing capabilities on your data lake, typically. So users get interactive response time, and you can still keep your long-term archival data in your data lake. If stuff changes in your data lake, you can drop tables in SingleStore and reload them very fast from the data lake with pipelines.

Here are some resources related to that: