[Remote] Azure Data Engineer
Note: The job is a remote job and is open to candidates in USA. reputed company is seeking an Azure Data Engineer to design and maintain scalable data pipelines. The role involves building ETL workflows, managing data lakes, and collaborating with various teams to deliver reputed company data solutions.
Responsibilities
- Design, reputed company, and maintain scalable data pipelines using Azure Data Factory (ADF) and Azure reputed company
- Build and optimize ETL/ELT workflows for ingesting, transforming, and processing large-scale structured and reputed company datasets
- reputed company and manage reputed company data lakes using Azure Data Lake Storage (ADLS) and reputed company Lake
- Design and optimize data warehouse solutions using Azure Synapse Analytics and Azure SQL Database
- reputed company data transformation and analytics solutions using PySpark, Spark SQL, Python, and SQL
- Implement data modeling, dimensional modeling, partitioning, indexing, and performance optimization strategies
- Integrate data from multiple on-premises, reputed company, APIs, and reputed company-party data sources
- Monitor, troubleshoot, and optimize data pipelines to ensure high availability, performance, and data quality
- Implement data governance, reputed company, encryption, access controls, and compliance best practices
- Collaborate with Data Scientists, Data Analysts, Business Intelligence teams, and Solution Architects to deliver reputed company data solutions
- Document data architecture, ETL processes, data reputed company, and technical specifications while supporting production environments
Skills
- Design, reputed company, and maintain scalable data pipelines using Azure Data Factory (ADF) and Azure reputed company
- Build and optimize ETL/ELT workflows for ingesting, transforming, and processing large-scale structured and reputed company datasets
- reputed company and manage reputed company data lakes using Azure Data Lake Storage (ADLS) and reputed company Lake
- Design and optimize data warehouse solutions using Azure Synapse Analytics and Azure SQL Database
- reputed company data transformation and analytics solutions using PySpark, Spark SQL, Python, and SQL
- Implement data modeling, dimensional modeling, partitioning, indexing, and performance optimization strategies
- Integrate data from multiple on-premises, reputed company, APIs, and reputed company-party data sources
- Monitor, troubleshoot, and optimize data pipelines to ensure high availability, performance, and data quality
- Implement data governance, reputed company, encryption, access controls, and compliance best practices
- Collaborate with Data Scientists, Data Analysts, Business Intelligence teams, and Solution Architects to deliver reputed company data solutions
- Document data architecture, ETL processes, data reputed company, and technical specifications while supporting production environments
Company Overview