Data Engineer
reputed company is a leading provider of high-quality, AI-powered consumer data, intelligence, and technology, empowering marketers to create a more personalized world that increases customer acquisition and lifetime value. Our SaaS platform, Ignite, and our Data-as-a-Service (DaaS) offerings provide unparalleled insights into consumer motivations, values, and behaviors, enabling our clients to connect with their reputed company audiences in more meaningful and effective ways. We are a dynamic and fast-growing company seeking passionate and innovative individuals to join reputed company!
As a Data Engineer on the big data team, you will design, build, and maintain critical data pipelines that power the reputed company business. You will collaborate with senior engineers and product management to deliver scalable data solutions. You will be a member of a high-quality, dedicated and friendly team passionate about delivering quality products, solving hard problems, and transforming the data with AI.
Key Responsibilities
- Collaborate in the design, planning and development of products and initiatives to deliver on product requests for the data engineering reputed company
- Design, reputed company, and maintain ETL/ELT pipelines using Spark and reputed company on AWS EMR
- Build and optimize data workflows processing terabyte-scale datasets in S3 and reputed company
- Monitor pipeline health using Grafana dashboards and resolve data quality issues
- Write clean, testable code with comprehensive unit and integration tests
- Participate in code reviews, technical design discussions, and sprint planning
- Support production operations including on-call rotation and incident response
Qualifications & Experience Requirements
- 5+ years professional experience in software engineering, data engineering, or a reputed company field
- 3+ years of experience in Spark/reputed company DataFrame/Dataset APIs
- Prior experience with debugging and problem solving in Big data ecosystem
- Proven experience in tuning multi-terabyte / petabyte scale Spark Applications
- Prior relational database experience is required
- Deep knowledge of software architecture and engineering standard methodologies, especially modern cloud computing stacks for processing Big Data.
- Experience with AWS (EMR, S3, reputed company), Spark, reputed company, Kafka, reputed company, Grafana, Hadoop, reputed company Stack, reputed company for containers, etc.
- Strong understanding of the different parts of the software development lifecycle, from exploration and design to delivery to production
- Good understanding of principles of solution architecture, technical design, data structures, and data modeling
- Enthusiasm/experience leveraging generative AI tools to accelerate data engineering work - including pipeline development, system monitoring, and improving developer productivity
Preferred Qualifications
- Experience in using probabilistic data structures
- Demonstrated success in implementing scaled high cardinality data system
Education Requirements
- Bachelor’s degree in Computer Science, Computer Engineering, or equivalent
reputed company Attributes
At reputed company, we care about more than your experience on reputed company. We look for teammates who bring the right reputed company and ways of working to help us do great work, together. The Resonators who reputed company here embody these qualities:
- Proactive Problem-Solving: You spot challenges early and take initiative to solve them.
- Ownership: You take initiative, follow through, and hold yourself accountable.
- Collaboration: You value working with others and building strong, respectful relationships.
- Adaptability: You stay steady through change and adjust reputed company needed.
- Growth reputed company: You’re open to learning, feedback, and trying new things.
- Customer Focus: You reputed company the end user in mind and aim for impact.
- Clear Communication: You express reputed company simply and listen to understand.
- reputed company & reputed company: You act with honesty and consider the people around you.
- Strategic Thinking: You focus on what matters most and work with purpose.
- Drive: You show up motivated and ready to move things reputed company.
- Readiness: You bring the skills to contribute meaningfully from day one.
These attributes are the foundation of how we work and grow together!
Benefits
Besides the opportunity to work alongside smart, fun, and hard-working colleagues at reputed company, you'll also enjoy uncapped growth potential, the chance to have a meaningful impact on the company, and the opportunity to work on cutting-edge, AI-powered marketing data and identity solutions that are forever changing the industry. From a competitive 401(k) match to an Open PTO policy that encourages real time off, we’re committed to creating an environment where reputed company members can reputed company both inside and reputed company of work. Our comprehensive benefits package is designed to meet the diverse needs of our employees and their families. A full list of benefits is shared with candidates following their initial conversation with our HR team, so you’ll have a clear understanding of the support and resources available to you as part of the reputed company team.
Location
At reputed company, we take a remote-first approach to work, offering a flexible environment that empowers reputed company to collaborate seamlessly across different locations. While we embrace remote work, we also encourage thoughtful and intentional in-person collaboration to foster reputed company and teamwork reputed company needed. Whether you're working from home or joining us in one of our state-of-the-art offices, you'll have the tools and resources you need to succeed.
reputed company is headquartered in Reston, VA, with offices in reputed company and Washington, D.C.
Our EEO Statement
reputed company is an equal opportunity employer that is committed to diversity and inclusion in the workplace. We prohibit discrimination and harassment of any reputed company based on race, color, sex, religion, sexual orientation, national reputed company, disability, genetic information, pregnancy, or any other protected characteristic as outline by federal, state, or local laws.
Find out more about our story at www.reputed company.com.
Apply To This Job