About This Opportunity
Excite your career at Paytm Labs as a Senior Data Engineer. Work with massive datasets, optimize data pipelines, and enhance fraud detection techniques in a hybrid model.
In this role based in our Toronto office, you will collaborate with the Platform Engineering Team to create robust data pipelines and manage high-volume data ingestion using advanced technologies. You will apply your expertise in Spark, Kafka, and data structuring to ensure seamless data flow and reliable storage solutions while embracing problem-solving skills to address challenges head-on.
Key Responsibilities: • Develop reusable experimental and production data pipelines • Optimize feature pipelines for speed and efficiency • Tune and master daily frameworks and technologies • Ensure data safety and flow using ingestion platforms • Shape data structures for efficient storage and transit
Requirements: • Degree in Computer Science or related field • Proficient in Spark, Scala, Python, or Ja...