A favicon of Sequin

Sequin

Change data capture for Postgres, streaming rows into queues, streams, and search indexes from a container beside your database.

Open Source Alternative to:

Screenshot of Sequin websiteVisit Sequin

Postgres is good at holding data and answering questions about it. Getting changes out of it and into everything else is where teams end up writing something brittle by hand. Sequin reads changes from any Postgres database from version 14 onward and delivers them to sinks, backfilling existing rows and streaming new ones in real time.

It runs as a standalone Docker container next to the database rather than as an extension. You name the schemas and tables to stream, add optional filters and transforms, and point them at a sink; delivery retries with exponential backoff when a sink is unavailable. Configuration happens in a web console, in YAML paired with the CLI, or through a management API, and Terraform templates for AWS live in the repository.

The delivery guarantees are what separate it from a webhook loop written in an afternoon.

  • Strict ordering: every change reaches its sink, in order, under a documented consistency model.
  • Exactly-once processing: idempotency keys keep a consumer from acting on the same change twice.
  • Filters and transforms: payloads are reshaped by functions written in Elixir before they leave.
  • Routing: individual messages are directed to specific topics, endpoints, or indexes.
  • Backfills: a sink can be refilled from any point, including partial replays of specific rows.
  • Metrics: a Prometheus endpoint exposes what the pipeline is doing.

Sinks include Kafka, NATS, RabbitMQ, Redis, SQS, SNS, Kinesis, GCP Pub/Sub, Azure Event Hubs, Elasticsearch, Typesense, Meilisearch, and webhooks. Published benchmarks report sustained throughput above 50,000 operations per second at 55ms average latency.

Share:
Details:
  • Stars


    2,196
  • Forks


    148
  • Last commit


    7 months ago
  • Repository age


    2 years
  • License


    MIT
  • Version


    0.14.6
  • Repository


    sequinstream/sequin

Auto-fetched from GitHub .

Ad

 

 
 
 
 

Open source alternatives similar to Sequin:

 

 
 
  • Stars


  • Forks


  • Last commit


 

 
 
  • Stars


  • Forks


  • Last commit


 

 
 
  • Stars


  • Forks


  • Last commit


Sequin: Open Source Alternative to Fivetran, Confluent Cloud and Amazon SQS – Unvendored