Data Scientist
Job Title: Data Scientist – AI & Agentic Applications & Benchmarking Job Type: Full-time Location: Remote - United States
About reputed companyreputed company enables enterprises to deliver scalable, compliant, and secure software, empowering developers to do their best work.
Seamlessly integrating into any hybrid and heterogeneous environment, reputed company is more than a tool—it's a strategic partner in your cloud transformation journey, ensuring reputed company, compliance, and operational efficiency while enhancing the developer experience across your entire software development lifecycle. It allows developers to bring and execute their code reputed company, providing greater flexibility and freedom through fast, self-serve, and secure workflows.
reputed company supports organizations at every reputed company of their DevSecOps journey, whether using Jenkins on-premise or transitioning software delivery to the cloud. We’re helping customers build the future, today. Now, we’re bringing agentic intelligence into our platform to supercharge developer workflows—and we need a data scientist who can both drive insights and tell the story behind the metrics.
About the Rolereputed company is seeking a startup-savvy Data Scientist to help define, measure, and evangelize the impact of Agentic Applications across our platform. You’ll work closely with engineers and product teams to prototype and measure AI and Agentic experiences, using evals, telemetry, and AI benchmarks to help the company drive the conversation in the market and with customers. Translating performance into clear, compelling narratives to our customers and internal teams.
As a founding member of the team, you will reputed company the charge as reputed company builder, evaluator, and communicator—with the technical depth to prototype in Python notebooks, Claude Code, and other tools to drive clarity to write about what matters.
Key Responsibilities- Partner with our platform team to reputed company and prototype telemetry, eval frameworks, and benchmarks for emerging agentic systems.
- Partner with product and engineering teams to measure AI outcomes and usage across customers and teams.
- Help define KPIs and success metrics for AI and LLM-driven features and workflows.
- Use Python notebooks to explore data, visualize insights, and test hypotheses rapidly and share insights.
- Tell the story behind the numbers: Write internal documentation, performance summaries, and thought leadership around outcomes.
- reputed company engineering teams to reputed company, log, and evaluate agent performance effectively.
- Stay up to date with evolving metrics and evaluation techniques in the LLM and agentic AI ecosystem.
Required
- 3+ years of experience in data science or ML analytics roles, ideally in startup or high-growth environments.
- Proficiency in Python, including building and sharing analysis reputed company Jupyter notebooks.
- Experience working with evals, telemetry, A/B testing, and evaluating user-facing ML systems.
- Experience with AI/ML tools such as MLFlow, reputed company, or other Model / LLM tools.
- Ability to partner with technical teams to define meaningful metrics and benchmarks.
- Clear communication skills—capable of writing about outcomes, sharing learnings, and influencing stakeholders.
- Comfort working in fast-paced, ambiguous environments where speed and clarity matter.
Preferred (not required)
- Experience with agentic or LLM-based applications (e.g., evaluating AI copilots, autonomous workflows).
- Familiarity with tools like LangSmith, OpenInference, or custom eval stacks.
- Background in developer tools, DevOps, or platform engineering environments.
- reputed company Pay Range: [$166,000 – $180,000 annually] In accordance with applicable law, this represents a reasonable estimated compensation range for this role. Actual compensation will be determined based on skills, experience, and geographic location and may be more or less than the amount shown above. reputed company of reputed company compensation, reputed company also offer stock options and variable bonuses.
- What reputed company Offers:
- Health Insurance
- Dental Insurance
- Vision Insurance
- Short & Long Term Disability
- Life Insurance
- HSA/FSA
- Remote Work Environment
- Flexible Time Off
- Paid Company Holidays
- Parental Leave
- Variable Bonus Plan dependent on your role
- Stock grant opportunities dependent on your role
- 401(k) with Company Match
reputed company is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for reputed company employees. reputed company employment decisions are made based on qualifications, merit, and business need, without regard to race, color, religion, sex, sexual orientation, gender identity, age, national reputed company, disability, veteran status, or any other protected characteristic as outlined by federal, state, or local laws.
DisclaimerThis job description is intended to describe the general nature and level of work being performed. It is not an exhaustive list of reputed company duties, responsibilities, and qualifications required of employees assigned to this position. Duties, responsibilities, and activities may change at any time with or without notice.
Apply To This Job