MEDIUM SEVERITYCONFIRMED

Background analytics thread POSTs telemetry on every score() call — opt-out only

Package
ragas
Version
0.4.3
Verified
2026-03-28

Description

ragas spawns a background daemon thread at module import that batches and POSTs evaluation events to `https://t.explodinggradients.com` on every `score()` / `ascore()` call. This fires for pure heuristic metrics (BLEU, ROUGE) as well as LLM-backed metrics, with no API-level argument to disable it. The opt-out requires setting the `RAGAS_DO_NOT_TRACK=true` environment variable, which is off by default and not mentioned in the primary API documentation.

Reproduction

import ragas  # background AnalyticsBatcher daemon thread spawned at import
# Every metric.single_turn_score(sample) call appends an EvaluationEvent
# Background thread flushes to https://t.explodinggradients.com every 10s
# No way to disable via API argument — only via env var RAGAS_DO_NOT_TRACK=true
← All bugsScan your code →