Make Your Resume Now

Staff Backend Engineer

Posted July 02, 2025
FullTime

Job Overview

Our Purpose

At Fiddler, we understand the implications of AI and the impact that it has on human lives. Our company was born with the mission of building trust into AI. The rise of Generative AI and Agents has unlocked generalized intelligence but also widened the risk aperture and made it harder to ensure that AI applications are working well. Fiddler enables organizations to get ahead of these issues by helping deploy trustworthy, and transparent AI solutions. 

Fiddler partners with AI-first organizations to help build a long-term framework for responsible AI practices, which, in turn, builds trust with their user base. AI Engineers, Data Science, and business teams use Fiddler AI to monitor, evaluate, secure, analyze, and improve their AI solutions to drive better outcomes. Our platform enables engineering teams and business stakeholders alike to understand the "what", “why”, and "how" behind AI outcomes.  

Our Founders

Fiddler AI is founded by Krishna Gade (engineering leader at Facebook, Pinterest, Twitter, and Microsoft) and Amit Paka (product leader at Microsoft, Samsung, Paypal and two-time founder). We are backed by Insight Partners, Lightspeed Venture Partners, and Lux Capital. 

Why Join Us

Our team is motivated to help build trust into AI to enable society harness the power of AI. Joining us means you get to make an impact by ensuring that AI applications at production scale across industries have operational transparency and security.  We are an early-stage startup and have a rapidly growing team of intelligent and empathetic doers, thinkers, creators, builders, and everyone in between. The AI and ML industry has a rapid pace of innovation and the learning opportunities here are monumental. This is your chance to be a trailblazer.  

Fiddler is recognized as a pioneer in the field of AI Observability and has received numerous accolades, including:  2022 a16z Data50 list, 2021 CB Insights AI 100 most promising startups, 2020 WEF Technology Pioneer, 2020 Forbes AI 50 most promising startups of 2020, and a 2019 Gartner Cool Vendor in Enterprise AI Governance and Ethical Response. By joining our brilliant (at least we think so) team, you will help pave the way in the AI Observability space.

What You'll Do

  • Design and build a world-class cloud platform to help enterprises monitor and analyze their ML models, covering both predictive models as well as LLM and Generative models Design enterprise-grade, scalable APIs and frameworks to run analysis and validation of customers’ ML models and workflows

  • Develop new types of metrics and evaluation methods for quality and robustness of ML models

  • Work with product and customer facing teams to enhance and expand our product

  • Recommend and implement engineering best practices, improve the functionality of existing software, and ensure that the design, application, and maintenance of software meets quality standards

What We're Looking For

  • Masters/Bachelor's Degree in Computer Science or equivalent

  • 10+ years of working experience

  • Proficiency with Python

  • Experience debugging and troubleshooting production systems

  • On call support experience

  • Experience working with common distributed systems infrastructure: Redis, Postgres, RabbitMQ, Celery, Flask

Nice to have:

  • Experience working with ML models in production.

  • Experience with common LLM frameworks (Langchain, Llamaindex, RAG, HuggingFace, and eval frameworks like Ragas or Presidio)

  • Knowledge of infrastructure management (AWS / Google Cloud, Kubernetes, or equivalent on-premises technologies)

  • Experience building large scale distributed systems and working with columnar and vector databases

The posted range represents the expected salary range for this job requisition and does not include any other potential components of the compensation package and perks previously outlined. Ultimately, in determining pay, we'll consider your experience, leveling, location, and other job-related factors.

Fiddler is proud to be an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. If you require special accommodations in order to complete the interviews or perform job duties, please inform the recruiter at the beginning of the process.

Beware of job scam fraud! We prioritize candidate safety. Our recruiters use @fiddler.ai email addresses exclusively. In the US, we do not conduct interviews via text or instant message, or to provide sensitive personally identifiable information such as bank account or social security numbers. If you have been contacted by someone claiming to be from a different domain about a job offer, please report it as potential job fraud to [email protected].

Ready to Apply?

Take the next step in your career journey

Stand out with a professional resume tailored for this role

Build Your Resume – It’s Free!