Senior Agentic AI Engineer - Summit Strategic Search - Summit, NJ
Summit Strategic Search
Our client is a world-renowned biotech powerhouse, but they're currently operating with the speed and ambition of a startup in the AI space. We aren't just looking for someone to build chatbots; we need a Senior Agentic AI Modeler who can architect systems that actually reason, plan, and solve complex problems autonomously.
If you’re obsessed with the 'bilingual' intersection of traditional predictive modeling and the new frontier of Multi-Agent orchestration (and you've already started playing with MCPs), we should talk.
• You'll have the freedom of a heavily remote schedule, with the added benefit of joining the team in the office roughly once a week (about 5 days a month) to stay connected.
About the Role:
Agentic System Design & Development
• Architect and implement autonomous and semi-autonomous agent workflows using modern frameworks (LangChain, OpenAI Assistants, Semantic Kernel, LlamaIndex, CrewAI, DSPy, etc.)
• Build agents capable of multi-step reasoning, task decomposition, planning, and tool execution.
• Develop tooling ecosystems—function APIs, retrieval endpoints, evaluators, monitoring hooks—for agent orchestration.
• Prototype, fine-tune, and optimize LLMs, RAG systems, and multi-agent architectures for reliability and low hallucination rates.
Modeling & Prompt Engineering
• Create robust prompt pipelines, templates, and routing strategies for diverse commercial/analytics use cases.
• Optimize agent behaviors via prompt distillation, chain-of-thought design, system message tuning, guardrails, and evaluation frameworks.
• Use datasets and logs to refine agent behavior through supervised fine-tuning or RLAIF where applicable.
Solution Integration & Delivery
• Integrate agents with enterprise systems, APIs, data stores, CRMs, search tooling, and business applications.
• Implement observability for agent decision-making: trace logs, tool call audits, success/failure rates, safety events, drift.
• Partner with engineering and MLOps to deploy agentic