One pipeline per source
CSV, ERP, API and spreadsheets become separate implementations, with standards that drift across teams.
Eclusa, by Aule
v2.0Install it in your workspace, run setup and register one configuration row per dataset. Eclusa handles loading, quality and auditing without requiring a new pipeline for every source.
Requires a Databricks workspace with Unity Catalog enabled. Nothing runs outside it.
eclusa.whl
installed on the cluster, no external service
The repeated foundation
The first months of a data platform are often consumed by necessary but repetitive work.
CSV, ERP, API and spreadsheets become separate implementations, with standards that drift across teams.
Rules live across notebooks and may detect a problem only after the data has already been written.
Logs, history and load identifiers vary by project, making failures harder to trace.
How it works
The flow is parameter-driven: configuration is validated before execution and behavior stays consistent across every dataset.
Add the Python wheel to the customer's Databricks workspace.
The command provisions the control catalog in Unity Catalog. It is idempotent and safe to run again.
Define source, destination, load strategy and quality rules in a typed contract.
The engine validates, ingests and records the run with quality and auditing inside the customer's environment.
Available today
design partners
Managed tables with no mounts, fixed paths or external infrastructure.
Versioned configuration with fail-fast validation before execution.
Warn or fail rules. A blocking violation keeps bad data from being written.
Every load gets a correlated run_id recorded in the customer's environment.
The default profile is medallion, while naming can follow the customer's standards.
Setup, validation, registration and execution through clear, reproducible commands.
9 source formats
Current batch engine support, extensible through plugins without changing the core.
4 load strategies
The strategy is declared per dataset and applied consistently.
Control by architecture
The product is installed in the customer's Databricks workspace. Aule does not host, access or store the processed data.
Configuration, execution and auditing remain inside the customer's cloud and policies.
Setup uses Unity Catalog tables and does not depend on a vendor database or infrastructure.
Technical questions