azure data engineer.

Summary of the Role:

This role will design, develop, and maintain the data processing platform on Azure. The purpose of the data platform is to integrate data across the organization to empower and provide business partners, vendors, and customers with actionable insights. The right candidate will implement best practices using expertise in Azure Data Services to build a scalable, secure, and governed platform.

Responsibilities / Accountabilities:  

·Develop pipelines in Synapse that ingest data from a growing number of data sources.

·Implement data quality checks and validation processes to ensure accuracy, consistency, and integrity.

·Identify, design, and integrate process improvements: automate manual processes, timely data delivery, and re-designing for future use cases.

·Monitor pipeline operations, tasks, resource utilization, and failures.

·Support HA, DR, Backup, and retention policies on all data platforms Ensure compliance with IT General Controls, provide needed information in support of audits and to substantiate process and controls compliance.

·Produce documentation for data models, transformations, business rules, and lessons learned that allows other staff members to understand the ingestion process and maintain and troubleshoot it

·Understand technical requirement of project and execute in data platform

Requirements (education, experience, competencies and specific job requirements):

·7 years of IT experience in Data and Analytics, data integration or data ingestion.

·3+ years of experience in Azure Cloud Services (PaaS & IaaS), Azure Data Factory, Azure Synapse Analytics, Azure Analysis Service, Application Insights, Azure Monitoring, Azure Data Lake.

Education / Certification: