Jobs

Staff Software Engineer - AI Orchestration 💰 Salary: $188,000 - 275,000 per year

At CoreWeave we are looking for a ML, AI engineer!

🛠️ Our tech stack:
AI, Cloud, Support, Kubernetes, Machine-Learning

📝 Rquirements:
- Over 8 years of experience in software engineering, particularly in distributed systems or cloud platforms
- Strong knowledge of Go programming language and experience in creating large-scale, long-term production systems
- In-depth understanding of Kubernetes internals, scheduling strategies, and controller-based architectures
- Proven experience in designing or enhancing orchestration, scheduling, or resource-management platforms
- Ability to lead technical projects across teams without direct authority
- Strong operational mindset with a background in managing mission-critical systems at scale
- Preferred experience with orchestration frameworks such as Kueue, Volcano, Ray, or similar Kubernetes-native tools
- Background in AI infrastructure, ML platforms, HPC, or extensive batch and streaming systems
- Comprehensive understanding of scheduling principles including fairness, pre-emption, quota management, and multi-tenant isolation
- Experience in defining and managing SLOs, capacity models, and significant reliability enhancements
- Contributions to open-source infrastructure or orchestration initiatives

👩‍💻👨‍💻 Your responsibilities are:
- Drive the technical vision and architecture for key aspects of the AI Workload Orchestration Platform
- Create scalable and reliable orchestration components for AI workloads across diverse schedulers and environments
- Lead cross-functional architectural reviews and ensure alignment among infrastructure, CKS, and managed inference teams
- Establish platform standards for reliability, observability, capacity management, and operational excellence
- Identify and address systemic performance, scalability, and fairness challenges across large GPU clusters
- Mentor senior engineers and foster technical leadership

Key Responsibilities Develop and maintain backend services using Core Java and Spring Boot. Integrate AI/LLM workflows into Java applications using frameworks like Spring AI. Design and consume RESTful APIs; familiarity with SOAP/WSDL/XML is a plus. Build and support event-driven systems using Kafka, JMS, and other messaging platforms. Collaborate on frontend development using frameworks such as React, Angular, or Vue. Implement observability tools for logging, metrics, and tracing. Contribute to CI/CD pipelines, containerization (Docker), and orchestration (Kubernetes). Apply clean architecture principles and design patterns in system design. Participate in technical discussions, mentor team members, and collaborate across teams. Skill Metrics Restful APIs Docker Kubernetes Ai/LLM Java Spring Boot Required Skills 7–10+ years of experience in Java development and Spring ecosystem. Experience with AI/LLM integration in Java applications. Strong knowledge of REST APIs and event-driven architecture. Familiarity with frontend frameworks and responsive design. Experience with observability tools (Logback, Prometheus, OpenTelemetry). Proficiency in CI/CD, Docker, Kubernetes, and version control systems. Solid understanding of software design principles and architecture. Preferred Qualifications Experience with Spring Cloud and microservices components. Familiarity with vector databases (Pinecone, Milvus, Redis vector). Knowledge of domain-driven design, CQRS, and reactive programming (Spring WebFlux). Understanding of OAuth, JWT, and enterprise security protocols. Exposure to cloud-native AI deployments (AWS Lambda, Azure AI, Google Vertex AI). Experience with legacy system modernization and hybrid deployments. Knowledge of AI orchestration, prompt chaining, and multi-agent workflows. Experience with feature toggles, A/B testing, and canary deployments. Seniority level Mid-Senior level Employment type Contract Job function Engineering and Information Technology Industr

Dice is the leading career destination for tech experts at every stage of their careers. Our client, Atika Tech, is seeking the following. Apply via Dice today!

Position: Agentic AI Engineer

Location: Chicago, IL

Duration: 12+ Months

Key Responsibilities

Architecture & Design: Lead the design and implementation of stateful, multi-agent systems using frameworks like LangGraph, CrewAI, or AutoGen.

Agent Orchestration: Develop robust reasoning loops (e.g., ReAct, Chain-of-Thought) and manage complex state, memory, and task hand-offs between specialized agents.

System Integration: Build secure interfaces (e.g., using Model Context Protocol (MCP)) to connect agents with enterprise APIs, databases, and external tools.

Production Excellence: Own the deployment, monitoring, and observability of agents in production using tools like Langfuse or LangSmith to trace reasoning and optimize performance.

Guardrails & Safety: Implement human-in-the-loop (HITL) mechanisms, input/output validation, and ethical guardrails to ensure agents operate safely and within regulatory boundaries.

Leadership: Mentor junior engineers, define coding standards for non-deterministic AI outputs, and drive the technical roadmap for agentic systems.

Required Technical Skills

Programming: Deep proficiency in Python and experience with backend frameworks like FastAPI.

AI Frameworks: Hands-on expertise in LangChain, LlamaIndex, and agent-specific orchestration patterns.

Data Systems: Strong knowledge of Vector Databases (e.g., Pinecone, Chroma), RAG architectures, and knowledge graphs.

Cloud & DevOps: Experience deploying AI workloads on AWS, Azure, or Google Cloud Platform using Docker and Kubernetes.

Evaluation: Proficiency in building automated evaluation harnesses (e.g., LLM-as-a-Judge) to measure accuracy and reduce hallucinations.

Qualifications

Experience: 5 8+ years in software engineering, with at least 2+ years focused on GenAI/Agentic AI implementations.

Education: Bachelor s

We Are

A forward-thinking services company at the forefront of AI-native innovation. We partner with enterprise clients to create next-generation, agent-powered workflows engineered to scale in real-world settings. Our engineers embed deeply with customers, moving projects beyond experimentation into operational reality.

You are

An AI Native Engineer with a strong foundation in building cloud-native solutions and hands-on experience designing and deploying agentic systems, especially for enterprise environments. You’re a critical thinker who thrives in ambiguity, delivering concrete results by designing, building, and running AI agents that augment workflows and scale across modern infrastructure.

You'll shape how enterprises adopt AI-native engineering - either by leading complex agentic solutions and developing engineering talent, or by owning critical technical areas end-to-end as a senior IC

The Work

You’ll partner directly with client stakeholders — acting as both technologist and trusted advisor. You’ll partner with stakeholders to define use cases, rapidly prototype, and deploy agentic workflows that are robust, secure, and operational in complex enterprise domains. Often, these will be net-new platforms and systems that need to be stitched together in our clients’ environments alongside our ecosystem partners.

Agent Architecture & Engineering
• Design and build enterprise-ready AI agents incorporating retrieval, orchestration, policy-based routing, tool invocation, evaluation harnesses, and lifecycle observability.
• Implement resilient, testable, and maintainable agentic workflows that can be iterated on quickly.

AI Platform Integration
• Develop and/or extend abstraction layers across AI providers (Anthropic, Google, OpenAI, etc.) to enable seamless integration and multi-provider enablement.
• Contribute to shared libraries, SDKs, and patterns that can be reused across clients.

Cloud-Native Engineering
• Leverage containerization (Kubernetes, Dock