data-observability-installer
Installer for DataKitchen's Open Source Data Observability Products including TestGen and Observability. Provides tools to detect data quality issues, monitor data pipelines, and ensure data reliability across your data estate.
Ficha actualizada 22 sept 2026, 22:24 · upstream 22 sept 2026, 22:05 · release latest
Qué es data-observability-installer
Descripción editorial construida a partir del repositorio, su documentación y sus señales de mantenimiento.
Data breaks. Servers break. Your toolchain breaks. Ensure your team is the first to know and the first to solve with visibility across and down your data estate. Save time with simple, fast data quality test generation and execution. Trust your data, tools, and systems end to end.
This repository contains the installer and quickstart setup for the DataKitchen Open Source Data Observability product suite. It provides two main products:
1. DataOps TestGen: A data quality verification tool that performs five core tasks — data profiling, new dataset screening and hygiene review, algorithmic generation of data quality validation tests, ongoing production testing of new data refreshes, and continuous periodic monitoring for anomalies.
2. DataOps Observability: Monitors every tool used in the data journey from source to customer value across all environments, tools, teams, datasets, and databases, enabling immediate detection, localization, and understanding of problems.
- Detect data quality issues before they impact downstream analytics or business decisions
- Monitor data freshness and integrity when new sources are added to production
- Automatically generate data quality tests for existing datasets without manual effort
- Track data journey health across multiple tools, datasets, and environments in real-time
- Alert teams on anomalies detected during production data refreshes or monitoring cycles
- Supports both Docker Compose deployment (persistent storage) and pip installation for environments without Docker
- Generates demo data automatically upon first run, allowing immediate demonstration of features
- Provides a clean uninstallation process that removes all generated demo artifacts
- Includes comprehensive documentation with tutorials covering both products
- Requires Python 3.9 or higher for installation and execution
- Docker Compose is required for persistent storage of TestGen; pip install works but lacks persistence
- Demo data generated during setup is not automatically cleaned up after use
- Observability requires Docker to run the agent heartbeat demo
Perfil de infraestructura
Estimación inicial derivada del repositorio y de los servicios detectados.
Despliegue detectado
Qué señales reales de instalación hemos encontrado.
Install TestGen via `python3 dk-installer.py tg install` (pip mode) or `--docker` flag for persistent storage. Install Observability with `python3 dk-installer.py obs install`. Both products can be upgraded and restarted using the same commands. For Docker deployments, use `docker compose up` to start TestGen and `docker compose -f obs-docker-compose.yml up` for Observability. Use `dk-installer.py tg delete` or `dk-installer.py obs delete` to remove installed applications cleanly.
Stack y dependencias
Componentes inferidos a partir de manifests, configuración y documentación.
Puede sustituir a
Relaciones detectadas por el análisis del repositorio y su categoría.
Experiencia real de la comunidad
Ayuda a contrastar la estimación automática con instalaciones reales.
Todavía no hay datos comunitarios para este proyecto.