Job description

Databricks Data Engineer job at Cynet Systems. Pleasanton, CA. Job Description: Pay Range: $60hr - $65hr Responsibilities: • s a Databricks Data Engineer, Candidates will be responsible for designing, implementing, and optimizing data pipelines and workflows using Databricks and other data engineering tools. • Candidates will work closely with cross-functional teams to ensure data integrity, performance, and scalability, enabling the organization to make data-driven decisions. • Key Responsibilities: Design, develop, and maintain data pipelines and ETL processes using Databricks, Spark, and other data engineering tools. • Implement and report on business key performance indicators (KPIs) in data warehousing environments. • Utilize analytic SQL to work with traditional relational databases and distributed systems. • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. Optimize data workflows for performance, scalability, and reliability. • Develop and maintain documentation for data engineering processes and solutions. Ensure data quality and integrity through rigorous testing and validation. Preferred Qualifications: • 4+ years of work experience implementing and reporting on business key performance indicators in data warehousing environments. • 4+ years of experience using analytic SQL, working with traditional relational databases and/or distributed systems. • 3+ years of experience with programming languages such as Python and PySpark. • 3+ years of experience with data orchestration/ETL tools. • 2+ years of experience with Databricks/Spark and Power BI. • 2+ years of experience with X12 EDI. • 2+ years of experience with Azure. Skills and Competencies: • Strong understanding of data warehousing concepts and best practices. Proficiency in SQL and experience with relational databases. • Expertise in programming languages like Python and PySpark. • Experience with data orchestration tools and ETL processes. • Familiarity with Databricks, Spark, and Power BI. Knowledge of X12 EDI standards in healthcare domain. • Excellent problem-solving skills and attention to detail. • Strong communication and collaboration skills.

Requirements