We are seeking a Senior Data Software Engineer to join our team and contribute to building scalable data solutions. In this role, you will collaborate directly with the client, lead technical delivery and design robust data pipelines for batch and streaming workloads.
Responsibilities
Develop and maintain the code base for ETL and ELT pipelines, large batch/micro batch processing and streaming systems
Build out the infrastructure required for optimal extraction, transformation and loading of data from a wide variety of data sources using ADF, Spark, Kafka or similar technologies
Identify, design and implement internal process improvements such as automating manual processes, optimizing data delivery and re‑designing infrastructure for greater scalability
Design and implement innovative data services solutions using Spring Boot, ReactJS, NoSQL or other UI and API related technologies
Assure governance of processes in delivery management and production as per the ...