Overview:

We are looking for a Medior level Data Ops Engineer with expertise in Microsoft Azure to support and optimize our data pipelines and operations. This role focuses on ensuring the reliability, availability, and efficiency of data pipelines, databases, and cloud-based storage solutions. You will work closely with Data Engineering Development and Design teams to manage day-to-day data operations, monitor performance, and troubleshoot issues.

Key Responsibilities:

???? Data Operations & Monitoring

Ensure reliability, scalability, and availability of Azure-based data solutions. Monitor Azure Data Factory, Synapse Analytics, and SQL databases for performance issues. Implement alerts, dashboards, and logs using Azure Monitor, Log Analytics, and Application Insights. Maintain data quality, consistency, and governance across the pipeline.

???? Incident Management & Troubleshooting

Act as support for data pipeline failures, performance degradation, and job failures. Investigate and resolve issues related to data ingestion, storage, and transformation. Perform root cause analysis (RCA) and implement long-term fixes to prevent recurring issues. Work closely with DevOps and Cloud teams to resolve infrastructure-related problems.

???? Automation & Process Optimization

Automate repetitive operational tasks using PowerShell, Python, or Azure Functions. Optimize ETL/ELT performance and reduce operational overhead. Improve cost efficiency of data solutions by monitoring Azure cost and usage.

???? Security & Compliance

Ensure data security and compliance with internal policies and regulatory requirements (GDPR, ISO 27001, etc.). Implement role-based access control (RBAC), encryption, and authentication mechanisms. Conduct regular audits and access reviews for data services.

???? Collaboration & Documentation

Work closely with Data Engineers  to streamline data operations. Document SOPs (Standard Operating Procedures), troubleshooting guides, and runbooks. Provide training and knowledge-sharing sessions for junior team members.

Required Skills & Qualifications:

✅ Education & Experience:

3-5 years of experience in DataOps, Data Engineering or Cloud Operations. Hands-on experience with Microsoft Azure Data Services. Experience managing Azure-based data infrastructure and pipelines.

✅ Technical Skills:

Azure Data Factory, Synapse Analytics, Azure SQL Database, Azure Functions, Stream Analytics and Data Lake. Monitoring & logging: Azure Monitor, Log Analytics, Application Insights. Automation & scripting: PowerShell, Python, or Bash. CI/CD & Infrastructure as Code: Azure DevOps, Terraform, or Bicep. Data security & compliance: RBAC, encryption, access control policies.

✅ Soft Skills:

Strong analytical and troubleshooting skills. Ability to work under pressure and manage multiple priorities. Excellent documentation and communication skills.

Nice-to-Have Skills:

Experience with Azure Purview for data governance, Azure Fabrics Knowledge of ITIL processes for operations management.