Job description

Immediate Requirement for Data Engineer (Azure Databricks) Location – Remote Employment Type – Contract – 6 months Experience – 3 to 5 Years Job Overview: We are looking for a skilled Data Engineer with 3 to 5 years of hands-on experience in Azure Databricks to join our growing data team. The ideal candidate should be proficient in building scalable data pipelines, transforming large datasets, and optimizing data flows on Azure cloud infrastructure. This is an exciting opportunity to work on impactful projects that drive data-driven decisions across the organization. Key Responsibilities: • Design, develop, and maintain robust, scalable, and high-performance data pipelines using Azure Databricks and other Azure services. • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver clean, structured data solutions. • Build ETL/ELT processes to ingest data from multiple sources (structured, semi-structured, and unstructured). • Optimize and tune Spark jobs for better performance and lower cost on Azure Databricks. • Ensure data quality, governance, and security best practices are implemented and followed. • Develop and maintain documentation for data engineering solutions. Key Skills & Qualifications: • 3–5 years of experience in data engineering with a focus on cloud-based platforms. • Strong experience in Azure Databricks, Apache Spark, and PySpark. • Proficiency in SQL and scripting languages like Python. • Hands-on experience with Azure Data Factory, Azure Data Lake, and other Azure data services. • Knowledge of data modeling, warehousing concepts, and performance tuning. • Experience working with version control (Git), CI/CD pipelines, and Agile methodologies. • Familiarity with building datasets using Scala. • Experience leading agile scrum, sprint planning and review sessions. • Good communication and interpersonal skills. • Strong problem-solving skills and ability to work independently or as part of a team. Preferred Qualifications: • Azure Data Engineer Associate certification is a plus. • Experience with Delta Lake, Databricks Workflows, and Unity Catalog. • Familiarity with modern data stack tools and practices.

Requirements