Job Description Must-Have Skills & Qualifications

Strong hands‑on experience with Databricks and Apache Spark (PySpark/Scala).

Experience in SQL and data transformation techniques.

Knowledge of ETL tools and data pipeline development.

Experience working with cloud platforms (Azure/AWS/GCP).

Strong Azure cloud background

Understanding of data warehousing concepts.

Strong problem‑solving and analytical skills.

Hands on Experience with Azure Databricks or Delta Lake, in building ETLPipelines: batch (autoloader) and Spark structured streaming

Knowledge of data modelling and performance tuning in Spark.

Exposure to CI/CD pipelines and DevOps practices.

Familiarity with data governance and security practices.

Strong hands‑on working experience of Unity catalog:

Hands on exposure to Creating end to end environments : creating catalogs,schemas, tables . materialized views, funct...