Back End Developer

Job Description

Backend Engineer – AI Systems


London (Remote)



AI products are only as good as the systems behind them.


This is an opportunity to join a well-funded AI scale-up building technology that moves beyond simple chatbot interactions. The product is focused on solving real-world problems through intelligent automation, long-running workflows and highly reliable AI systems that users can genuinely depend on.


Backed by significant investment and led by an ambitious engineering team, the company is now looking for Backend Engineers to help build the infrastructure that powers every AI interaction across its platform.


If you're excited by distributed systems, production AI and solving complex engineering challenges at scale, this is the kind of role where your work will have immediate impact.


You'll sit at the heart of the AI platform, building the inference and orchestration layer that connects foundation models with real users.


Your focus will be on creating backend systems that are fast, reliable and observable, ensuring AI-powered features perform consistently in production while handling the complexities of multi-step reasoning, tool integrations and long-running workflows.


Working closely with product and machine learning engineers, you'll help transform cutting-edge AI capabilities into production-grade services used across multiple applications.


What You'll Be Doing


• Build and operate backend services that power AI features in production.


• Design inference pipelines and orchestration systems for complex AI workflows.


• Manage routing, caching, batching, streaming and request lifecycle management.


• Improve latency, throughput, scalability and cost efficiency across AI infrastructure.


• Build resilient systems capable of handling unpredictable model behaviour and external dependencies.


• Develop robust observability through logging, tracing and debugging.


• Collaborate with ML and Product teams to deliver reliable APIs and production-ready AI services.


You'll likely have experience with some of the following:


• Strong backend engineering experience within production environments.


• Experience building high-throughput, low-latency distributed systems.


• Exposure to modern AI technologies including LLMs, embeddings or multimodal models.


• Confidence debugging complex distributed systems.


• A pragmatic mindset with a focus on shipping high-quality software and continuously improving through production learnings.


You'll be working with technologies including:


• Python


• Node.js


• PyTorch


• OpenAI, Anthropic and open-source LLMs


• SQL & NoSQL databases


• Kubernetes


• Docker


You'll be joining a highly talented engineering team where you'll work on genuinely challenging technical problems at the forefront of AI infrastructure.

Send me alerts about jobs like this.

Please enter your email address to continue setting up an email alert for similar jobs to this one. By entering your email address and clicking apply you will sign up to Jobs4 and agree to our terms and conditions.

Job Overview

ID:

2534693

Date Posted:

Posted 8 hours ago

Expiration Date:

29/07/2026

Location:

City Of London

Salary:

Competitive

Send me alerts about jobs like this.

Please enter your email address to continue setting up an email alert for similar jobs to this one. By entering your email address and clicking apply you will sign up to Jobs4 and agree to our terms and conditions.

Share

Complete the form below to send this job to a friend.

Job Location

Complete the form below to report this job.