Unknown Company

Principal AI/ML Software Engineer

houston, tx • Posted 1 weeks ago
Remote Full Time General

Principal Software DeveloperJob Location (Short): Houston, Texas-USA | Madison, Alabama-USA Workplace Type: RemotePosition OverviewWe are seeking a motivated AI/ML Engineer to build reliable, scalable systems and Generative AI and Agentic AI features, and build and deploy data-driven solutions for our document-based compliance management platform. This role requires a technical expert who can develop, deploy, and maintain ML systems in production environments.Key ResponsibilitiesBuild and deploy Generative AI features using foundation models (AWS Bedrock, OpenAI, Anthropic Claude) and inference pipelines with optimization of latency and costDesign agentic AI systems that autonomously handle compliance workflows, document review, regulatory mapping, and multi-step reasoning tasksIntegrate comprehensive LLM evaluation frameworks with development and production systemsBuild and operate end-to-end MLOps pipelines, deployment systems, monitoring, and rollbacks workflowsImplement explainability frameworks (SHAP/LIME) and monitoring dashboards ensuring transparency and regulatory adherenceCollaborate with cross-functional teams to translate business needs into ML solutions and communicate insights to stakeholdersEducation / QualificationsTechnical SkillsPython (5+ years): Production-level experience with Pandas, NumPy, scikit-learn, XGBoost, TensorFlow/PyTorch, Hugging Face Transformers, FastAPI/Flask, MLflow, and pytestSQL: Advanced proficiency with complex queries, window functions, and optimizationMachine Learning & NLP: Strong foundation in supervised/unsupervised learning, deep learning, document understanding, text classification, and semantic analysisGenerative AI & LLMs: Hands-on experience with foundation models (GPT, Claude, Llama), prompt engineering, RAG architectures, and vector databases (Pinecone, Weaviate, Chroma)MLOps & ModelOps: End-to-end experience with ML pipelines, model versioning, feature stores, drift detection, CI/CD for ML, and Docker containerizationLLM Evaluation: Experience with evaluation frameworks (RAGAS, DeepEval), custom metrics, benchmark datasets, and human-in-the-loop validationCloud & AWS: Experience with AWS services including SageMaker, Bedrock, S3, Lambda, EC2, and CloudWatchStatistics & Experimentation: Strong foundation in statistics, A/B testing, causal inference, and experimental designVisualization: Proficiency with Tableau, Power BI, or Python visualization librariesExperience & Education5+ years in data science, ML engineering, or related roles3+ years building NLP/generative AI applications and implementing MLOps in productionBachelor's or Master's degree in Data Science, Computer Science, Statistics, or related fieldPreferred QualificationsExperience with agentic AI frameworks (LangGraph, LangChain, AutoGen, CrewAI)Knowledge of Life Sciences/regulated industries (FDA, EMA, ISO, GxP) and compliance management systemsFamiliarity with big data tools (Spark, Databricks, Snowflake), orchestration (Airflow, Kubeflow), and monitoring tools (Datadog, Prometheus)Experience with LLM fine-tuning, document processing libraries, multi-modal AI, or distributed trainingUnderstanding of ML governance, bias detection, model risk management, and data privacy regulations (GDPR, CCPA, HIPAA)Experience working in agile environments with JiraAWS ML certifications or similar credentialsKey CompetenciesStrong communication skills explaining complex models to technical and nontechnical audiencesAbility to work independently and collaboratively in fast-paced environmentsProven ability to convert POCs into production-grade solutionsUnderstanding of ethical AI and building trustworthy, explainable systems for regulated environmentsWhat You'll BuildLLM evaluation frameworks ensuring 95%+ accuracy for compliance-critical featuresPrompts for LLMs to achieve specific, high-quality outcomesAgentic AI systems autonomously handling document review and compliance workflowsGenAI document understanding features processing millions of regulatory documentsPredictive models identifying compliance risks before they occurReal-time semantic search and explainable ML systems meeting regulatory requirementsProduction MLOps pipelines supporting dozens of models with automated monitoring and retrainingGrowth OpportunitiesDrive adoption of emerging AI technologies and establish best practicesMentor ML engineersShape AI/ML roadmap and establish center of excellence for compliance AICollaborate with product leadership on long-term vision for AI-powered complianceAbout OctaveOctave provides mission-critical software that empowers organizations to make informed decisions across every stage of the asset lifecycle - Design, Build, Operate and Protect - where performance, safety, and reliability are non-negotiable and failure is not an option. Turning complex operational data into actionable intelligence, Octave connects expertise, real-world conditions and enterprise-scale insight to improve performance, resilience and incident response where it matters most. Octave has more than 7,000 employees in 45 countries. Learn more at octave.com and follow us on LinkedIn.Why Work for Octave?All in.

Always forward. That's the way we do things around here. We put trust in our people because we believe it's the best way to unleash potential, bring ideas to life, and keep moving ahead. And it's why we're committed to creating an environment that's truly supportive, providing you with the resources you need to support your ambitions, no matter who you are or where you are in the world. Everyone is welcome At Octave, we believe that diverse and inclusive teams are critical to the success of our people and our business.

Here, everyone is welcome. As an inclusive workplace, we don't discriminate. In fact, we embrace differences and are fully committed to creating equal opportunities, an inclusive environment, and fairness for all. Respect is the cornerstone of how we operate, so speak up and be yourself. You're valued here.Recruitment Fraud Alert Octave posts all official job opportunities on either or and communicates only from email addresses ending in @octave.com.

We never request payment or personal banking information during recruitment. No offers will ever be extended without a proper interview via Teams or in person, never done over email alone. If you suspect fraud, it probably is, and contact us at

Principal AI/ML Software Engineer in houston at Unknown Company

This position is listed as full time and able to be worked remotely.

Back to Job Search