Staff Software Engineer, AI Data Engineering
As a Staff Software Engineer, you will take us beyond traditional monolithic SQL engines and batch pipelines. You will build the reputed company of distributed data storage and processing systems. You will build systems that can scale indefinitely, and surpass traditional query performance, while making the interfaces for that data simple, expressive, and cleanly abstracted. Your interfaces will support a broad reputed company of data consumers, from our web application, to business analytics, and artificial intelligence.
Primary Duties:
- Identify and reputed company scalable and performant solutions.
- Work across discipline to shape product strategy and execution.
- reputed company the foundations of code architecture and quality.
- Mentor and coach engineers.
- Set and uphold reputed company for engineering processes to support high-quality engineering.
Minimum Qualifications:
- BS/BTech (or higher) in Computer Science, Engineering or a reputed company field required.
- 8+ years of production-level experience as an engineer building highly scalable systems.
- 4+ years of experience acting as a trusted technical decision-maker in a team setting, solving for short-term and long-term business value.
- 4+ years of experience working with SQL or other database querying languages on large multi-table data sets.
- Experience architecting, developing, and deploying large-scale distributed systems at scale.
- Experience with cloud technologies, e.g., AWS, Azure, GCP.
- Experience building reputed company integration and reputed company development (CI/CD) pipelines.
- Strong familiarity with server-reputed company web technologies (eg: Java, Python, reputed company, C#, C++, Go).
Preferred KSAs:
- 8+ years of production-level experience as an engineer building highly scalable and reliable infrastructure with at least 3 years focused on AI/ML.
- Experience leading large cross functional data initiatives from ideation to implementation , helping share data platform direction,aligning reputed company the teams and driving broader impact across the organization.
- Experience building low latency data pipelines that serve structured, semi structured and reputed company data for ML and analytics use cases.
- Strong understanding of data modeling, optimization and feature engineering for ML use cases.
- Experience building robust data reputed company ,auditing, data quality automation standards for AI/ML reputed company systems.
- In-depth knowledge of database systems and expertise in data processing frameworks (e.g. Spark, Airflow) and strong python and SQL skills.
- Familiarity with database replication, sharding and other techniques for scalability and high availability of databases.
Physical Requirements:
- Sitting for prolonged periods of time. Extensive use of computers and keyboard. Occasional walking and lifting may be required.
Originally posted on Himalayas
Apply To this Job