Senior Data Engineer - Dublin

Xtremepush is a global leader in customer engagement, providing a cutting-edge platform that empowers brands to understand, engage, and influence their customers across multiple channels. Specialising in the Sports Betting & Gaming (SBG) industry, Xtremepush enables businesses to drive growth and enhance customer experiences through data-driven insights, personalisation, and omni-channel marketing. We also partner with organisations in financial services and other regulated sectors. Our innovative Customer Data Platform and engagement tools help organisations create highly targeted campaigns, optimise conversions, and maximise revenue. Xtremepush is the only platform that combines real-time CDP, Omnichannel Activation, AI Optimisation, Gamification Engine, and Advanced Intelligence in a single platform.

We are seeking an experienced Senior Data Engineer to own the ingestion of new data sources into the Xtremepush platform for our clients’ marketing and personalisation use cases. Working across a number of clients, you will design and build custom jobs, working directly with their technical and data teams to secure access, resolve data quality issues and land data in the right shape and at the right latency. This role requires the successful candidate to have strong data engineering, integration and key stakeholder management experience.

• Design, build and maintain custom ETL/ELT and ingestion jobs that bring new client data sources into the Xtremepush platform.

• Define integration patterns and standards for batch, API and event-driven ingestion.

• Ensure data lands in the structure and at the latency the Data Analyst and Data Modeller require.

• Work with client technical and data teams on source access, data contracts and data quality.

• Orchestrate, monitor and troubleshoot pipelines, resolving failures quickly.

• Document integrations, data flows and dependencies for the wider team.

• Advise on integration scope and effort during use case planning.

• Experience mentoring associate data engineers.

• 5+ years’ experience in data engineering or data integration, ideally including a lead or senior role.

• A degree in computer science, software engineering, data engineering or a related field, 

• Experience in financial services, gaming or another regulated sector, including consent and data protection requirements.

• Experience working directly with client technical teams and managing key stakeholders.

• Strong ETL/ELT and pipeline design skills across batch and streaming, including idempotent loads, backfills and failure recovery, and knowledge of common integration patterns.

• Strong Python, including production ETL, testing and maintainable code, and experience with APIs and REST integrations.

• Advanced SQL, including query performance tuning.

• Experience with MySQL, including schema design, query tuning and extracting data from operational databases.

• Experience with ClickHouse or another columnar database, including ingestion, table engines, and troubleshooting memory and insert performance.

• Hands-on experience with Snowflake and/or Databricks.

• Experience with Kafka, including producers and consumers, offsets, partitions, retention, replay and deduplication.

• Experience orchestrating pipelines with Dagster or Airflow.

• Hands-on AWS experience, including S3, IAM, KMS, Secrets Manager and CloudWatch.

• Experience running and debugging jobs and CronJobs on Kubernetes (EKS or similar), and comfortable working in Linux environments.

• Experience designing monitoring and alerts in Datadog or a similar tool.

• Strong incident handling, including triage, root cause analysis and clear write-ups.

Desirable 

• Experience with a CDP, CRM or marketing automation platform.

• Experience with file-based integrations, including SFTP, file validation and reprocessing.

• Experience with CI/CD, ideally Bitbucket Pipelines.