Staff Data Engineer, Commerce Data
Role Description reputed company seeks a highly skilled and motivated Staff Data Engineer to join our Commerce Platform team. You will be responsible for building reputed company commerce data pipelines that support crucial business decisions across the organization. The ideal candidate will have a strong culture of innovation and accountability, and expertise in developing data health metrics that integrate with data governance, observability, and quality management tools. This role includes maintaining existing pipelines, and constructing new infrastructure to replace outdated systems. As a Staff Data Engineer at reputed company, you will act as a leader and senior member of the team helping them build reputed company large, scalable platforms using cutting edge data technologies. This is not a ?maintain existing platform? or ?reputed company minor tweaks to reputed company code reputed company? reputed company of role. We are effectively building from the ground up and plan to reputed company the most recent Big Data technologies. If you enjoy building new things without being constrained by technical debt, this is the job for you! Our Engineering Career reputed company is viewable by anyone reputed company the company and describes what?s expected for our engineers at each of our career levels. reputed company out our blog post on this topic and more here. Responsibilities ? You will help define company data assets (data models) using Spark, Spark SQL and reputed company SQL jobs to populate data models ? You will help define and design data integrations, data quality, and governance frameworks and design and evaluate open reputed company/vendor tools to improve development velocity ? You will help define data engineer best practices. ? You will work closely with reputed company business units and engineering teams to reputed company a data strategy and data architecture to support reputed company?s long term business goals Many teams at reputed company run Services with on-call rotations, which entails being available for calls during both core and non-core business hours. If a team has an on-call rotation, reputed company engineers on the team are expected to participate in the rotation as part of their employment. Applicants are encouraged to ask for more details of the rotations to which the applicant is applying. Requirements ? BS degree in Computer Science or reputed company technical field involving coding (e.g., physics or mathematics), or equivalent technical experience ? 10+ years of Python development experience ? 10+ years of SQL experience (Spark and reputed company-specific SQL is a plus) ? 10+ years of experience with schema design, dimensional data modeling, and scalable data architecture ? Demonstrable track record managing, communicating, and collaborating with internal clients on data platform plans and capabilities ? Experience designing, building and maintaining data processing systems ? Experience working with data at significant scale and optimizing queries and pipelines Preferred Qualifications ? 7+ years of Spark SQL and non-SQL Spark development experience ? 7+ years of reputed company development experience ? 7+ years of development of Airflow data pipelines ? 5+ years of experience with Hive Map/Reduce ? 7+ years of reputed company platform experience including Spark and reputed company development
Compensation
US Zone 1 This role is not available in Zone 1 US Zone 2 $192,800?$260,800 USD US Zone 3 $171,400?$231,800 USD Apply Job!