Machine Learning Engineer (m/w/d)

You build productive AI systems (LLM, RAG, agents) for large customers in the public sector. Not a prototype for the drawer, but software that runs in regular operation. Who we are Rockstardevelopers, founded in 2015, offices in Stuttgart and Munich.

From hundreds of projects for enterprise and medium-sized customers, we know how to build software that will last in an emergency. For a while now, our focus has been shifting towards AI: LLM applications, RAG, agent systems that are really productive for customers. That's exactly

What We're Looking For

you for. What it's about Our customers are IT service providers in the public sector, a regulated environment with high demands on data protection and operational security. There you integrate AI solutions into existing industry solutions: dialog systems, semantic search, RAG pipelines, agents, all in real productive operation for many users.

Project language is German. A word about remote, because it is often the first question: everyday life runs remotely-first within the DACH region. Every now and then you are on site, the rest of the time you work from where you work well.

Your tasks build LLM applications. You develop dialog-based systems and semantic search and integrate them into the technical applications of the industry solution. Set up and maintain RAG systems.

Including knowledge base management: indexing, updating, clean, source-separated storage of structured and unstructured content. Operation and monitoring. MLOps in productive operation: Observability, structured logging, error analysis.

You make sure that the systems are running, not just that they were running once. Put agents productive. From development to integration and connection to portal systems to stable delivery.

Improve based on data. Based on monitoring data, tests and user feedback, you make the solutions better step by step. Try new things.

You identify new AI application areas, try them out and build the data pipelines from preparation through model creation to production. This is what you have to bring with you The following four points are tough

Requirements

, each of which must be verifiable. If one of these is missing, unfortunately we cannot send you into the race. We would rather be honest in advance than steal your time.

At least 3 years of professional experience as a machine learning engineer in the conception, development, implementation and optimization of scalable ML solutions. At least 2 years of experience in agile development teams. German at least at C1 level, spoken and written, verifiable via a language certificate or as a native language.

Completed studies in computer science, business informatics or comparable training, proven by certificate or self-declaration. Ideally, you bring this with you. Not a must, but the more of them, the better: Vector search and semantic indexing in vector databases, ideally Milvus backend development with Python, preferably FastAPI LLM orchestration with LangChain or LangGraph Operation of production-related AI systems: monitoring (ideally Grafana), structured logging, error analysis, deployment Data protection-compliant AI design, especially when dealing with personal data in logging and observability GenAI in use for many users, ideally in a multi-client environment Kubernetes, ArgoCD, Jenkins Experience with agile delivery structures, ideally SAFe Experience from public administration projects What we offer Real productive projects.

AI that goes into operation at the customer. No innovation lab, no slides. Remote-first in the DACH region.

Occasionally on site, otherwise you work from where you work well. Modern AI stack. RAG, agents, vector search, MLOps.

Current stack, no legacy baggage. Internal upskilling. We invest in your AI skills.

MacBook, unless the customer provides their own hardware. Flat hierarchies. The founders are your direct contacts.

A team that knows each other, even when working distributedly. Sound like you? Then apply, a CV is enough, you don't need a cover letter.

If you're available early, that's a definite plus. We will get back to you within a few days. Find more English Speaking Jobs in Germany on Arbeitnow