Unknown Company

AI Controls Testing Analyst

malvern, pa • Posted 4 days ago
Onsite Full Time General

Gen AI Controls Testing SpecialistConduct testing of operational controls and compliance with controls standards and requirements for Gen AI tools in production.Analyze, interpret and report on the results of the testing.Conduct root cause analysis, identify controls gaps and deficiencies.Evaluate inherent and residual risk for Gen AI technology reviewed.Makes recommendations for remediation.Knowledge of AI / ML concepts, especially Gen AI (LLMs)Understanding of Gen AI risks, familiarity with AI governance standards and AI ethics principles (bias, fairness, transparency, responsible AI usage)Control frameworks expertise (NIST)Audit and compliance testing – ability to test whether AI tools are compliance with organizational controls policies (access controls, data handling, model explainability)Data analysis – collect and analyze relevant data to ensure AI tools perform as expected and identifying potential risks and control gaps.Problem solving and critical thinking: issue identification, root cause analysis.

Back to Job Search