whereismyai
AI Slop Detection Reproduction
AI Slop Detection Reproduction is an open source Python package for reproducing AI-written movie review detection experiments.
This package contains the exact review files and scripts used for the experiment described in the accompanying article. It lets users rerun the detector comparison, sentiment classifier evaluation, and Mendeley collection audit on a local computer. The software requires Python 3.11 or newer and about 2 gigabytes of free disk space for pretrained model downloads from Hugging Face. It scores training reviews with four detector scores including perplexity, near-duplicate similarity, embedding density, and a combined score. It also trains and evaluates a sentiment classifier using four data treatments. The repository includes training and test review files, analysis scripts, and reference outputs for comparison.
AI Slop Detection Reproduction at a glance
Key features
- Scores training reviews with four detector scores
- Trains and evaluates sentiment classifiers
- Reruns detector comparisons locally
- Audits source collections from Mendeley Data
- Includes exact generated and source review files
- Compares results with captured reference outputs
Use it for
- Rerun detector comparisons on a local computer
- Evaluate sentiment classifiers using reported data treatments
- Audit the Mendeley source collection archive
Alternatives to AI Slop Detection Reproduction
- ASReview — It reduces the manual workload of large-scale text screening by up to 95%.
- GLiNER — Enables zero-shot entity extraction without labeled training data on consumer CPUs.
- jevgrep — Reduces coding agent costs by providing targeted, relevant repository context.
- Argilla — Provides programmatic tools for continuous data evaluation and human-in-the-loop feedback.
- Hugging Face Transformers — It provides a unified API for over 1M+ pretrained model checkpoints on the Hub.
- Evidently — Provides 100+ built-in metrics and test suites for machine learning and LLM systems.
- RAG Evaluation Starter — Runs five metrics locally with no SaaS signup or mandatory API key required.
- CodeRabbit — Most-installed AI PR reviewer, built to check code from coding agents
- Label Studio — Supports all data modalities and custom layouts for diverse AI pipelines.
- SwanLab — Tracks training metrics and system performance with minimal code integration.
- Anti Slop — Filters out generic AI-generated UI designs, text, and code.
- fal — Access 1,000+ generative models and high-performance serverless GPUs.
All AI Slop Detection Reproduction alternatives