Key Skills: Prompt Engineering, LLMs (GPT/Claude), Prompt Evaluation & Optimization, LangChain, RAG & AI Agents, Python, API Integration, LLM Security & Guardrails
Having 8+ years of experience on the following:
Prompt Design & Optimization – Craft, test, and refine prompts for LLMs to maximize accuracy, relevance, and consistency across use cases (chatbots, agents, RAG systems).
Evaluation & Experimentation – Design evaluation frameworks (A/B testing, benchmarking, rubric-based scoring) to measure prompt performance and iterate systematically.
LLM & Tooling Expertise – Deep understanding of LLM behavior (GPT, Claude, etc.), context windows, tokenization, fine-tuning vs. prompting trade-offs, and frameworks like LangChain or similar orchestration tools.
Cross-functional Collaboration – Work closely with product, engineering, and data science teams to translate business requirements into effective prompt/agent workflows.
Technical & Analytical Skills – Strong Python scripting, API integration, data analysis, and familiarity with prompt security/safety practices (jailbreak prevention, bias mitigation, guardrails).
Prompt Engineer in providence at Unknown Company
This position is listed as full time and onsite.