Job Title : Big Data Engineer
Location : 100% Remote (Mexico)
Duration : Full Time
**Job Description**:
4+ years of experience in working with Scala, Python, SQL, PySpark and bash scripts. Proficient in Spark development lifecycle and data engineering practices.
3+ years of experience in developing and maintaining robust data pipelines for both structured and unstructured data.
3+ years of hands-on experience in operationalizing solutions which are used in live production processes and ability to debug and troubleshoot failures.
3+ years of experience working with Cloud Data Warehousing (Azure Datawarehouse, AzSQL, Azure CosmosDB, Databricks SQL or equivalent) platforms and experience in working with distributed Spark computes.
2+ years of hands-on experience in using Azure Synape Spark Compute, Azure Data Factory orchestrations for Data Engineering Workflow.
Must have hands-on experience in Scala Development on IntelliJ Idea IDE.
Solid understanding of Da...