Job Title: Lead Data Engineer
Experience: 8+ years
Location: Remote

About the Role:

In this role, you will be responsible for designing, developing, and implementing advanced data engineering solutions using Azure cloud technologies. You will leverage your expertise in Azure Data Factory, Azure Databricks, Synapse, and Azure SQL to create scalable data pipelines and architectures. The ideal candidate will also have a strong ability to mentor junior team members and lead complex data projects.

Key Responsibilities:

Design and implement end-to-end data engineering solutions using Azure Data Factory, Azure Databricks, Synapse, and Azure SQL. Lead the development and optimization of ETL processes, data pipelines, and data warehouse solutions. Create and maintain data models and data integration workflows across various Azure services, ensuring data quality and scalability. Collaborate with data scientists, analysts, and business teams to understand data requirements and translate them into robust, high-performance solutions. Develop and implement CI/CD pipelines for automating the deployment and maintenance of data solutions. Manage Azure DevOps Boards, ensuring timely project delivery and tracking of tasks, sprints, and issues. Build and optimize data workflows using Python/PySpark and SQL to ensure high performance and minimal downtime. Provide leadership and mentorship to junior data engineers, guiding them through complex technical challenges and helping them grow their skills. Design and document data architectures and solutioning approaches to meet business and technical requirements. Troubleshoot and resolve data processing issues, optimizing existing pipelines for performance and reliability. Stay up to date with the latest trends and technologies in cloud data engineering and Azure ecosystem.

Key Skills & Qualifications:

8+ years of experience as a Data Engineer or similar role, with a strong focus on Azure Data Factory, Azure Databricks, Synapse, and Azure SQL. Expertise in designing and managing ETL processes and working with Data Warehouses in a cloud environment. Strong experience with Python/PySpark for data processing and SQL for querying and managing large datasets. In-depth knowledge of Azure DevOps Boards for tracking, project management, and collaboration. Proven experience in architecture design and solutioning for large-scale data solutions. Solid understanding of CI/CD practices and automation for deployment and maintenance of data solutions. Demonstrated leadership abilities, with experience mentoring and guiding junior engineers. Excellent problem-solving skills with a focus on optimization and scalability. Strong communication skills with the ability to collaborate across teams and stakeholders.

Good to Have:

Familiarity with Cosmos DB and integrating it with data solutions. Experience with additional Azure services like Azure Synapse Analytics or Azure Machine Learning. Exposure to Agile/Scrum methodologies for project management.

Why Join Us:

Work remotely from anywhere with flexible working hours. Opportunity to lead cutting-edge data projects and influence the data engineering strategy. Be part of a dynamic, collaborative team with a focus on innovation. Competitive salary and benefits package. Continuous opportunities for learning, development, and career advancement.