Our client is seeking an experienced and detail-oriented Product Support Manager to join the Data Warehouse Operations team. Key Responsibilities: • Monitor and ensure the health and stability of data pipelines and batch jobs running across Azure, Databricks, and TWS. • Proactively identify, investigate, and resolve data pipeline failures or performance bottlenecks. • Lead the triage and troubleshooting of production issues, working closely with engineering and operations teams. • Collaborate with data engineers to optimize the performance and scalability of data workflows. • Ensure adherence to SLAs and report on pipeline performance metrics. • Maintain and update operational runbooks, documenting key workflows and troubleshooting steps. • Manage the lifecycle of TWS job schedules, ensuring seamless batch processing and on-time execution. • Provide leadership and mentorship to junior support team members. • Develop and implement continuous improvement strategies for data operations. Qualifications: • Bachelor's degree in Computer Science, Information Technology, or a related field. • 10+ years of experience in a data operations or production support role, preferably in data warehouses or cloud-based environments. • Strong experience with Azure cloud services, including data storage, Azure Data Lake, Azure Databricks. • Hands-on experience with Databricks for data engineering, ETL processing, and pipeline orchestration. • Deep understanding of TWS (Tivoli Workload Scheduler) or similar tools for batch processing and scheduling. • Strong troubleshooting skills, with the ability to quickly diagnose and resolve production issues. • Knowledge of database technologies SQL, NoSQL and data integration tools. • Excellent communication skills, with the ability to work collaboratively across technical and business teams. • Strong organizational skills and the ability to manage multiple priorities in a fast-paced environment.
Job Type
Fulltime role
Skills required
Azure, NoSQL
Location
Location not specified
Salary
No salary information was found.
Date Posted
November 16, 2024
RSC Solutions is seeking a Production Support Manager with expertise in Azure cloud to oversee data pipeline health and performance. The role involves troubleshooting production issues and collaborating with engineering teams to optimize data workflows.