Senior Backend Developer – AI Pods

About the role

EPAM is seeking a Senior Backend Developer to join its AI Pods team. You will design and deliver AI‑powered API services that enable large language models to interact securely with internal systems, vector databases and external tools.

Key responsibilities

• Architect and develop backend API services together with LLM orchestration layers.
• Build and maintain sophisticated RAG pipelines for document ingestion, chunking, embedding and retrieval optimization.
• Create and integrate agent tools using LangChain, LangGraph and potentially the Model Context Protocol (MCP).
• Ensure security, privacy, enterprise‑grade observability and comprehensive test coverage across all backend workflows.
• Shape architecture decisions and engineering standards within the pod.
• Collaborate with frontend engineers, data engineers and infrastructure teams.
• Own API contracts and service reliability, handling graceful failure of AI edge cases.
• Deliver reusable orchestration frameworks and logic for downstream developer consumption.

Required profile

• 3+ years of backend engineering experience focused on microservices and distributed systems.
• 2+ years of Python development for high‑performance, cloud‑native APIs.
• Strong expertise in AWS, Docker and ECS/EKS.
• Proven background in RESTful API development.
• Knowledge of secure coding practices and solid authentication/authorization fundamentals.
• Upper‑intermediate English proficiency (B2).

Required skills

• Python
• AWS
• Docker
• ECS
• EKS
• RESTful API
• LangChain
• LangGraph
• MCP (Model Context Protocol)
• Amazon Kendra
• OpenSearch
• React
• TypeScript