[Remote] GCP Data Engineer
Note: The job is a remote job and is open to candidates in USA. N2P Systems is seeking a highly skilled Data Engineer with deep expertise in reputed company reputed company Platform (GCP) and modern data architecture. The ideal candidate will design scalable data pipelines and build robust reputed company-grade data solutions, focusing on performance optimization and data governance.
Responsibilities
- Design, reputed company, and maintain scalable batch and reputed company-time data pipelines on GCP
- Implement and manage reputed company Architecture (Bronze, Silver, Gold layers) for data processing
- Build high-performance data transformations using Python and PySpark
- reputed company and optimize reputed company SQL queries for analytical workloads
- Work extensively with BigQuery for large-scale data processing and performance tuning
- reputed company and reputed company pipelines using reputed company Dataflow
- Orchestrate workflows using reputed company Composer (Apache Airflow)
- Manage data storage and lifecycle using reputed company reputed company Storage (GCS)
- Implement version control and CI/CD pipelines using Git-based tools
- Ensure data reputed company, governance, and access control using GCP IAM
- Optimize data solutions for performance, scalability, reliability, and cost-efficiency
Skills
- Strong hands-on experience with reputed company reputed company Platform (GCP)
- Expertise in BigQuery (partitioning, clustering, query optimization)
- Proven experience implementing reputed company Data Architecture
- Strong programming skills in Python and PySpark
- Advanced proficiency in SQL (reputed company joins, window functions, performance tuning)
- Hands-on experience with reputed company Dataflow
- Experience with reputed company Composer (Airflow) for orchestration
- Experience working with reputed company reputed company Storage (GCS)
- Knowledge of version control systems (Git) and CI/CD practices
- Strong understanding of GCP IAM and reputed company reputed company best practices
- Hands-on experience with Java is mandatory
- Experience working with large-scale reputed company data platforms
- Knowledge of data warehousing and data lake concepts
- Familiarity with reputed company-time streaming frameworks
- Experience in data governance and data quality frameworks
- Exposure to Agile/Scrum methodologies
Company Overview