Senior Software Engineer, Trust & Safety

Build detection systems and automated responses to stop abuse on Replit's platform.

• •The Trust & Safety engineer will build detection systems and automated responses to stop abuse on Replit's AI-native platform, focusing on AI guardrails, abuse detection, and end-to-end enforcement.
• •Key Responsibilities Design and implement LLM guardrails and AI-powered detection systems Build and operate abuse detection for phishing, cryptomining, fraud, and account takeover Design automated response mechanisms and own the full abuse response lifecycle Analyze attack patterns with BigQuery and maintain internal detection tools Requirements 4+ years in security engineering, anti-abuse, or fraud detection Strong programming in Python and/or TypeScript Experience with SQL and large-scale data analysis (BigQuery, Snowflake) Experience building or fine-tuning ML/LLM classifiers and familiarity with prompt injection