Senior Engineer (Ingestion)

About the role

TypeScript, Node.js, ClickHouse, Event-Driven Data Pipelines With millions of messages generated, turning raw activity into clear insight is difficult. This depends on reliable data ingestion. As we expand customers and sources, ingestion sits at the core of our platform growth.

What you'll do

• As we transition to an event-driven architecture, you will design event flows, queuing, retries, failure recovery, and data consistency at scale
• Handling millions of messages, you'll focus on throughput, latency, deduplication, backfills, schema design
• Collaborating with product and AI teams, you'll identify pipeline bottlenecks and deliver continuous incremental updates in ambiguous problem spaces
• Also help us add new platforms fast (Discord, Reddit, Steam, X and customers’ own sources), building the system that makes each new integration quick and cheap
• For ingestion, this pace requires care. Our transition to event-driven architectures must be incremental to ensure continuous data flow

What you need

• Node.js
• TypeScript
• PostgreSQL
• Redis
• Kubernetes
• ETL
• Any graduate

Good to have

• Kafka
• Technical writing
• GCP
• NestJS
• CI/CD
• LLMs