Ingesting in MemSQL from Kinesis

Help Connectors and Pipelines
1

Hi,
Is there a direct way to ingest data into MemSQL from Kinesis?
If not, is there plan to support Kinesis in the future?
What solution would you recommend?

2

Hi Franck,

MemSQL supports ingesting from many sources like S3, GCS, etc… Unfortunately, AWS Kinesis is not one of them. Please check out the list of sources we support today here: CREATE PIPELINE · SingleStore Documentation . We will take your input into consideration for future developments.

Yu-wang

3
  1. Frank, are you interested in ingesting into Helios or MemSQL software?
  2. Do you think you can do Kinesis to S3 and have a MemSQL pipeline pointed at S3?
4

Hi @nikita,
We’re planning to use Kinesis to stream CDC from different DBs (mysql) used by different micro-services.
We’re thinking to dump all DB transactions (CDC) in S3 via Kinesis and use S3 as Data Lake.
We can ingest from S3, just wondering if there is an advantage in pulling directly from Kinesis.
Thanks,
Franck