Senior Backend Engineer - MLOps Group, JFrog ML

At JFrog, we’re reinventing DevOps and MLOps to help the world’s greatest companies innovate – and we want you along for the ride. This is a special place with a unique combination of brilliance, spirit and just all-around great people. Here, if you’re willing to do more, your career can take off. And since software plays a central role in everyone’s lives, you’ll be part of an important mission. Thousands of customers, including the majority of the Fortune 100, trust JFrog to manage, accelerate, and secure their software delivery from code to production – a concept we call “liquid software.” Wouldn't it be amazing if you could join us on our journey?

We are looking for a skilled and highly motivated software engineer to join and play an integral role on the Runtime team, part of the MLOps group at JFrog ML. This team is responsible for building high-quality, enterprise-grade deployment and serving infrastructure for classic ML models and LLMs – ensuring they are efficiently deployed, monitored, and scaled to handle millions of requests across multiple cloud platforms, including GPU-powered machines.

As a core member of the team, you’ll tackle meaningful and engaging challenges across a diverse technological stack.

We value creative, fast learners and independent thinkers who are proactive, collaborative, and capable of driving tasks from concept to production.

• Be an integral part of a highly skilled team working to build the leading MLOps platform in the industry.
• Maintain and evolve the Runtime team’s products, ensuring their reliability and scalability.
• Design and develop a complete hosting system that supports various types of inference, analytics, monitoring, distribution, and more – enabling customers to run large-scale real-time, batch, and streaming ML pipelines.
• Play a key role in shaping our cross-company engineering culture. 
• Conduct high-quality design reviews with a strong emphasis on scalability, maintainability, security, and sound use of design patterns.
• Write maintainable, well-tested code in multiple programming languages.
• Continuously improve the efficiency, scalability, and stability of critical system components.

• 5+ years of proven experience in software development.
• Strong background in designing, developing, and debugging complex distributed systems (e.g., microservices, event-driven architectures).
• Hands-on experience with containerized environments, microservices, and Kubernetes.
• Proven experience with at least one major cloud provider (e.g., AWS, GCP, Azure).
• Ability to lead technical discussions, mentor engineers, and drive architectural decisions.

• Experience in designing, structuring, and maintaining Python SDKs.
• Background in building tools for Data Science or Data Engineering.
• Familiarity with observability or automation tools.
• DevOps experience.