Privacy & Disclosure-Risk Analyst

Overview

We are seeking a Privacy & Disclosure-Risk Analyst responsible for evaluating privacy and data disclosure risks associated with AI/ML models and federated learning environments. This role will perform technical privacy testing to identify potential exposure of sensitive or training data through model leakage, membership inference, federated-update reconstruction, and related disclosure-risk techniques.

The Privacy & Disclosure-Risk Analyst will analyze testing results, assess the potential impact of identified privacy vulnerabilities and information exposure, and collaborate with technical teams to identify and validate appropriate risk mitigation measures. This role requires a strong understanding of machine learning concepts, data privacy risks, applicable privacy requirements, and technical approaches for evaluating potential information disclosure from AI/ML systems.

Responsibilities

• Assess privacy and disclosure risks associated with AI/ML models, training data, and federated learning environments
• Conduct model-leakage testing to identify potential exposure of sensitive, protected, or training data
• Perform membership-inference testing to evaluate whether information about training data can be inferred from model behavior or outputs
• Conduct federated-update reconstruction testing to evaluate potential disclosure of sensitive information from federated learning workflows
• Evaluate AI/ML systems for privacy vulnerabilities, unintended information exposure, and potential disclosure risks
• Develop and execute technical test scenarios and methodologies for evaluating model and data privacy risks
• Analyze testing results to determine the likelihood, severity, and potential impact of identified disclosure risks, including potential impacts to individuals whose information may be exposed
• Evaluate the effectiveness of privacy-preserving controls and recommend appropriate risk mitigation measures
• Collaborate with machine learning engineers, data scientists, cybersecurity teams, and other technical stakeholders to identify and address privacy risks
• Conduct follow-up testing to validate remediation and privacy risk mitigation measures
• Document testing methodologies, technical findings, supporting evidence, risk assessments, and recommended mitigation actions
• Communicate technical privacy and disclosure risks to technical and non-technical stakeholders
• Maintain awareness of emerging AI/ML privacy attacks, disclosure-risk techniques, privacy-preserving machine learning approaches, and evolving AI privacy and risk management guidance

Qualifications

• Ability to obtain and maintain a government security clearance
• Bachelor’s degree in Computer Science, Data Science, Artificial Intelligence, Machine Learning, Cybersecurity, Information Technology, or a related technical discipline, or equivalent relevant experience
• 5+ years of experience in cybersecurity, data privacy, machine learning, AI/ML security, or related technical disciplines
• Experience assessing privacy, data exposure, or disclosure risks within technical systems or data environments
• Strong understanding of machine learning concepts, model training, model outputs, and associated data privacy risks
• Knowledge of AI/ML privacy attack techniques, including model leakage, membership inference, reconstruction, or related disclosure-risk methods
• Experience conducting technical security, privacy, data risk, or adversarial assessments
• Understanding of federated learning or distributed machine learning concepts and associated privacy risks
• Knowledge of privacy-preserving techniques and controls used to reduce unintended information disclosure
• Knowledge of AI risk management principles and frameworks, including the NIST AI Risk Management Framework (AI RMF) or similar guidance
• Ability to analyze technical testing results and assess the potential impact and severity of identified privacy risks
• Experience documenting technical testing methodologies, findings, risks, and recommended mitigation actions
• Strong analytical, problem-solving, communication, and collaboration skills

Preferred:

• Hands-on experience conducting model-leakage, membership-inference, model inversion, reconstruction, or similar AI/ML privacy testing
• Hands-on experience assessing privacy and disclosure risks within federated learning environments
• Experience with differential privacy or other privacy-preserving machine learning techniques
• Experience with privacy-enhancing technologies, data minimization, de-identification, anonymization, or related data protection techniques
• Experience using Python or other programming languages for technical privacy, security, or machine learning analysis
• Knowledge of applicable federal privacy laws, regulations, policies, and standards related to sensitive data and information disclosure
• Familiarity with privacy requirements applicable to health, biomedical, research, or other sensitive data
• Experience working with sensitive, health, biomedical, research, or other protected data
• Experience working within federal government or other highly regulated environments
• Relevant privacy, cybersecurity, data science, or AI/ML certification