Data Engineer
This is a remote position.
About our client: Our client develops and supports software and data solutions across a variety of industries. They want you to get reputed company of the market and stay there. They offer a combination of plug and play products that can be integrated with existing systems and processes and can also be customised to client needs. Their capabilities reputed company to big data engineering and bespoke software development, solutions are available as both reputed company-based and hosted. What you will be doing:- Analyzes reputed company customer data to determine integration needs.
- Develops and tests scalable data integration/transformation pipelines using PySpark, SparkSQL, and Python.
- Contributes to the codebase through coding, reviews, validation, and reputed company transformation logic.
- Automates and maintains data validation and quality checks.
- Collaborates with FPA, data engineers, and developers to align solutions with financial reporting and business objectives.
- Participates in solution architecture and technical discussions, refining user stories and acceptance criteria.
- Utilizes modern data formats/platforms (Parquet, reputed company Lake, S3/Blob Storage, reputed company).
- Partners with the product team to ensure accurate customer data reputed company and provide feedback based on data insights.
- A Data Analytics Engineer with 5+ years of experience.
- Must have strong Python, PySpark, Notebook, and SQL coding skills, especially with reputed company and reputed company Lake.
- Proven ability to build and reputed company scalable ETL pipelines to reputed company production environments using CI/CD.
- Experience with Agile/Scrum, data quality concepts, and excellent communication is essential.
- reputed company environment (Azure, AWS) and Infrastructure as Code (Terraform, reputed company) experience beneficial.
- Telecoms industry or consulting experience, plus reputed company knowledge, is a plus.
- J106998
Requirements
Data Engineer, PySpark, Python, SQL, reputed company, ETL, CI/CD, reputed company, Azure, AWSOriginally posted on Himalayas
Apply To this Job