- Menlo Ventures (San Francisco, CA)
- Anthropic, a public benefit corporation, is seeking a trust and safety software engineer to develop systems that ensure user well-being and prevent misuse of AI ... models. The role involves building monitoring systems, analyzing user reports, and collaborating with research teams to enhance model integrity. Candidates should have a Bachelor's degree in a related field and significant experience in software engineering.… more
- OpenAI (San Francisco, CA)
- …We are looking for a software engineer with anti fraud & abuse experience to help architect and build our next-generation anti-fraud systems. Responsibilities ... Design and build systems for fraud detection and remediation while balancing fraud loss, cost of...closely with finance, security, product, research, and trust & safety operations to holistically combat fraudulent and abusive actors… more
- OpenAI (San Francisco, CA)
- …human- AI -human interactions. In this role, you will own the analytical view of safety and abuse risks in AI ‑social environments: Sora content and ... strategic analysis and future‑looking perspectives Produce concise, decision‑ready briefs on AI ‑social risks for leadership, safety forums, and partner teams.… more
- vercel (San Francisco, CA)
- …growing companies. You have applied experience building and maintaining scaled abuse detection and restriction/checkpoint systems in a professional setting. ... personalized web. As the team behind v0, Next.js, and AI SDK, Vercel helps customers like Ramp, Supreme, PayPal,...what we do is keeping up with Trust & Safety issues. Whether it's building out detection … more
- Menlo Ventures (San Francisco, CA)
- …our customers. The team will use statistical and machine learning techniques for fraud and abuse detection on our platforms using state of the art methods. The ... world's best and most secure platform for data and AI . We innovate and deploy industry‑leading solutions in security,...work in fraud and abuse detection is dynamic and essential, offering… more
- Pantera Capital (Palo Alto, CA)
- …Develop and maintain backend and data systems to support high-scale event processing for abuse detection , spam remediation, child safety , and related ... About xAI xAI's mission is to create AI systems that can accurately understand the universe... or security challenges in large-scale platforms, such as abuse detection or fraud prevention. Proven ability… more
- King River Capital Group (San Francisco, CA)
- …most complex and high-impact challenges in safety , including adversarial abuse , harmful content detection , and evolving threat vectors. Develop cutting-edge ... state-of-the-art ML to detect and prevent harm while staying ahead of emerging abuse patterns. Influence the company's direction on safety , clearly communicating… more
- Menlo Ventures (San Francisco, CA)
- …candidates may also: Have experience building trust and safety mechanisms for AI /ML systems, such as fraud detection models or security monitoring tools or ... in internal dashboards to analysts for manual review Build abuse detection mechanisms and infrastructure Surface ...Laws, AI & Compute, Concrete Problems in AI Safety , and Learning from Human Preferences.… more
- Pantera Capital (Palo Alto, CA)
- …Applied Safety team. The role involves developing backend systems for abuse detection and collaborating with cross-functional teams to address safety ... A leading AI company in California is seeking a Software Engineer to join their… more
- OpenAI (San Francisco, CA)
- …enables our partner teams to develop data-backed product policies and build scaled safety mitigations. Precisely understanding abuse allows us to safely enable ... especially those that are not caught by our existing safety systems. This will require expert understanding of our...monitoring subtasks. Prototype and mature into production systems of detection , review, and enforcement of abuse for… more
- Apple Inc. (San Diego, CA)
- …and ensure optimal performance and user experience Drive advancement in techniques for abuse detection and prevention We are seeking a strong technical hands‑on ... be collaborating with various teams like Apple Trust and Safety , Anti- abuse Operations team, and other key...Responsibilities Build and improve systems for spam, phishing and abuse prevention using advanced AI /ML techniques Improve… more
- Liberty Mutual Insurance (Boston, MA)
- …content moderation, prompt hardening, retrieval sanitization, adversarial training, rate limiting/ abuse detection ). Drive monitoring for model drift, anomaly ... deliver secure AI solutions quickly and efficiently. Adversarial robustness and safety . Recommend/consult on adversarial testing and red teaming for AI … more
- Pantera Capital (Palo Alto, CA)
- About xAI xAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly ... responsible for protecting users and the platform from fraud, abuse , and risk. You'll play a key role in...ground up. What You\'ll Do Design and implement fraud detection and prevention systems that operate at global scale… more
- Icon Ventures (San Francisco, CA)
- …engagement Trust & Safety Systems: Build infrastructure to support abuse detection , content moderation, and policy enforcement Privacy and Consent ... Future of Learning Join us to design and deliver AI -powered learning tools that scale across the world and...identity, account management, user communication infrastructure, and trust & safety systems at Quizlet. This high-impact role will help… more
- Icon Ventures (San Francisco, CA)
- …like Braze Implement features that support moderation, privacy requests, and abuse detection Ensure regulatory compliance through thoughtful consent flows ... tools. Let's Build the Future of Learning Join us to design and deliver AI -powered learning tools that scale across the world and unlock human potential. About the… more
- Icon Ventures (San Francisco, CA)
- …systems like Braze. Implement features that support moderation, privacy requests, and abuse detection . Collaborate with teammates to ensure compliance through ... tools. Let's Build the Future of Learning Join us to design and deliver AI -powered learning tools that scale across the world and unlock human potential. About the… more
- UNI (Cedar Falls, IA)
- …privileged access, and related governance and controls.* Lead incident monitoring, detection , investigation, and response, including post incident reviews that drive ... including vendor and third-party technology risk, digital accessibility, and AI related initiatives.* Develop and champion security awareness and education… more
- LinkedIn (Sunnyvale, CA)
- …will help achieve this mission by pivotally building out our next generation of abuse detection systems to keep fake accounts and entities off LinkedIn, reducing ... + Experience working on a variety of trust and safety domains including account integrity, behavior abuse ,...+ Former work experience in a technology-related field (especially AI /ML) + Experience building web products with a demonstrated… more
- Microsoft Corporation (Redmond, WA)
- … driven by ethical principles. We are looking for an experienced **Senior Product Manager - AI Safety and Security** to join a high-impact team that sits at the ... AI products. This encompasses providing an infrastructure for AI safety and security; serving as a...-native threats like the manufacture of sexual exploitation and abuse material (SEAM) or deep fake production or the… more
- Microsoft Corporation (Redmond, WA)
- …billions of lives around the world. We are seeking an experienced **Senior Software Engineer - AI Safety and Security** to join a high impact team sitting at the ... generative AI . As an engineer on the AI Safety and Security Platform team, you...and determine what additional infrastructure should be built. + ** Detection Engineering** : Partner with AI Incident… more
