Azure Data Engineer
- 8 Year +
- Remote
Job Description
We are seeking a highly skilled Azure Data Engineer to join our dynamic team. The ideal candidate will have a strong technical background and hands-on experience with modern data engineering tools and technologies. This role is critical in designing, building, and maintaining scalable and efficient data solutions in a cloud environment.
Key Responsibilities:
- Develop, implement, and optimize data pipelines using Azure Data Factory (ADF), Databricks, and PySpark.
- Design and maintain robust ETL/ELT workflows for processing large datasets.
- Write complex SQL queries and optimize database performance for efficient data retrieval.
- Collaborate with cross-functional teams using Azure DevOps (ADO) and Git for source control and CI/CD workflows.
- Create and maintain basic dashboards and reports using Power BI for data visualization.
- Work with Unity Catalog to manage and govern data across multiple workspaces (preferred).
- Ensure data quality, integrity, and security across all stages of the data lifecycle.
Required Skills
- Strong expertise in ADF, Azure, Databricks, and PySpark.
- Proficiency in SQL, ADO, and Git.
- Familiarity with Power BI for creating basic visualizations and reports.
- Excellent problem-solving and communication skills.
Preferred Skills:
- Experience with Unity Catalog for data governance and cataloging.
Educational Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
