AI Solution Architect (m/w/d)

As an IT service provider, we drive the digitalization of the public sector and create real added value for millions of people in Germany. We can do a lot of things really well, but not everything. That's why we're always looking for new colleagues who want to make a difference with their ideas, skills and commitment.

Do you feel addressed? Then shape your world for the better and become part of our Customer Cluster Environment, Transportation & Energy. YOUR MISSION As an AI Solution Architect (m/f/d) you will design the overall AI/ML architecture for complex enterprise environments on Azure.

You combine in-depth expertise in ML engineering, RAG architectures and MLOps with a strong understanding of governance, compliance and technical leadership. In this way, you will contribute to implementing AI solutions in a production-ready, scalable and rule-compliant manner.Your tasks:Design and further development of the overall AI/ML architecture on Azure as an enterprise AI platformTechnical management of ML pipeline projects, especially in the areas of training, deployment, monitoring and drift detection, as well as conception and optimization of RAG architectures, for example with regard to chunking, retrieval, guardrails and Context OrchestrationDefinition of MLOps strategies including CI/CD for models, experiment tracking and model registryTechnical leadership and coordination of an interdisciplinary team of ML/AI Engineers, LLM Engineers and MLOps EngineersAdvice on AI Governance, Responsible AI and EU AI Act compliance as well as stakeholder management through architecture presentations to IT management and specialist departmentsTHIS IS IMPORTANT TO USIn-depth experience with Azure-based AI/ML solutions, particularly with Azure Machine Learning and Azure OpenAI Service; Knowledge of other Azure AI services is an advantage. In addition, you have practical experience with MLOps concepts and corresponding tools, such as MLflow, Kubeflow or Azure ML Pipelines.

Experience in building RAG architectures, in prompt engineering and in dealing with vector databases as well as knowledge in integrating language models via APIs. Experience with orchestration frameworks such as LangChain or LlamaIndex is an advantage. Experience with CI/CD for ML applications and strong Python knowledge.

Hands-on experience with at least two common machine learning frameworks, such as scikit-learn, PyTorch or TensorFlow. Experience in building enterprise architectures in cloud environments. Knowledge in related areas such as data platforms, containerization, container orchestration, infrastructure as code and observability is an advantage, for example with Databricks, Azure Data Factory, Azure Data Lake, Docker, Kubernetes, Terraform, Prometheus, Grafana or Application Insights.

Understanding of governance, security and compliance

Requirements

in regulated environments. Knowledge of relevant standards and regulations such as ISO 27001, NIS2, BSI specifications or the EU AI Act as well as corresponding governance tools is an advantage.Several years of experience with ML/AI architectures or comparable technical tasks in enterprise environments.Experience in a technical management or architectural role is desirable; Relevant Azure certifications are a plus.Ideally, experience in the energy industry or utility industry, with predictive maintenance, time series analyzes or public procurement procedures such as VgV and EVB-IT.Very good knowledge of German (native language level) and good knowledge of EnglishYOUR NEW JOBWhat counts for us? Clearly defined roles, genuine cooperation and a common goal.

We call this responsiveness - transparent, appreciative and goal-oriented. Here you are directly involved in the change if you want. - Take part in projects that develop us as a company. Flexible working hours and remote work? - Are self-evident.Individual hardware budget? - Put together your workspace the way you feel most comfortable.Mental health? - Your mental well-being is important to us.

With OpenUp we support you and offer you free access to professional psychological support at any time.Individual training budget? - Whether it’s the next certification or a long-awaited language course - you decide what and when you want to continue your training. Employee PC program? - Simply lease your next device for purely private use via virtual7.JobRad or company car? - We help you to be as mobile as you need. Tell me who you are and when you can start.

Gladly over too