Skip to main content

Dora Core Library

Project description

Dora

Dora is a declarative ETL framework that simplifies and optimizes ETL workflows for Data Intelligence Platforms by automating task orchestration, computation management, monitoring, data quality, and error handling. It allows data teams to work entirely with SQL, seamlessly converting statements into tables and provisioning infrastructure as code. With efficient ingestion and a streamlined medallion architecture, Dora ensures high data quality and maximizes business value. By adopting best practices from software engineering, it enhances reliability and efficiency in data workflows, enabling engineers to focus on delivering high-quality data instead of managing pipelines.

Features

  • Declarative: Define data transformations effortlessly using SQL statements.
  • Automated: Convert SQL statements into data assets and automatically provision the necessary infrastructure.
  • Orchestration: Handle task orchestration, computation management, monitoring, data quality, and error handling seamlessly.
  • Cost-Efficient Ingestion: Enable fast, scalable, and cost-effective data ingestion.
  • Infrastructure as Code: Provision and manage infrastructure as a deployable, version-controlled code stack.
  • Simplified Operations: Automate operational complexities, allowing teams to focus on delivering high-quality data.
  • Data Quality: Ensure and continuously monitor data quality to maximize business value.
  • Comprehensive Monitoring: Track all workflows as interconnected data assets, providing a unified, real-time view of the entire data ecosystem.
  • Best Practices: Empower data analysts and engineers to apply the same robust practices used in software engineering for reliability, scalability, and maintainability.
  • Medallion Architecture: Streamline data workflows with a medallion architecture that ensures high data quality and maximizes business value.
  • Efficiency: Enhance reliability and efficiency in data workflows, enabling engineers to focus on delivering high-quality data instead of managing pipelines.
  • Global Data Asset Lineage: Track data assets across the entire data ecosystem, providing a comprehensive view of data lineage.
  • Data Intelligence Platform: Simplify and optimize ETL workflows for Data Intelligence Platforms.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dora_core-0.1.0.tar.gz (26.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dora_core-0.1.0-py3-none-any.whl (29.8 kB view details)

Uploaded Python 3

File details

Details for the file dora_core-0.1.0.tar.gz.

File metadata

  • Download URL: dora_core-0.1.0.tar.gz
  • Upload date:
  • Size: 26.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.10.12 Linux/5.15.167.4-microsoft-standard-WSL2

File hashes

Hashes for dora_core-0.1.0.tar.gz
Algorithm Hash digest
SHA256 6f40c3bcc64e0abd5127991ae61226acb2e0d96b650c1a897289acbf12b43b4e
MD5 817f9f7fa0679c23e606dfb55a9a8022
BLAKE2b-256 4885a2aa1fcce93f8f9c3a055033f63deedfc3e72bafbe4fb19d76450720bda9

See more details on using hashes here.

File details

Details for the file dora_core-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: dora_core-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 29.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.10.12 Linux/5.15.167.4-microsoft-standard-WSL2

File hashes

Hashes for dora_core-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 a1ef8ceb705d38117c9dc927e32196d440a371ce77d156d030c805a9839e4150
MD5 8c85d5c371d7e8047a096a50851b0f0d
BLAKE2b-256 2872849f4b7346fb53d907f1a32a5e6226edbd7910f01261b3dbc11b4c0a3aad

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page