Skip to main content

Python ETL framework

Project description

https://travis-ci.com/AsyncMicroStack/kigo-etl.svg?branch=master

Declarative ETL engine.

Example of usege

Let’s assume that we have a file named input_1

aaaaaaaaaaaaaaaaaaaaaabbbbbbbbbsome data 11      some data 2Y
aaaaaaaaaaaaaaaaaaaaaabbbbbbbbbsome data 12      some data 2Y
aaaaaaaaaaaaaaaaaaaaaabbbbbbbbbsome data 13      some data 2N
# helloworld.py

from kigo.etl.mapper.mapping import mapping
from kigo.etl.extractors.fabric import Extract


@mapping
class SomeClass:
    data_1 = Extract.TextSlice[31:43]
    data_2 = Extract.TextSlice[49:61]

What we expect is to have 3 instances of classes SomeClass where data_1 and data_2 will have proper ranges of data. For example first instance will look like:

data_1 -> 'some data 11'
data_2 -> 'some data 2Y'

Documentation

Documentation and links to additional resources are available at https://www.asyncstack.org/kigo-etl

License

Apache 2.0. See LICENSE for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kigo-etl-0.0.9.tar.gz (13.6 kB view details)

Uploaded Source

File details

Details for the file kigo-etl-0.0.9.tar.gz.

File metadata

  • Download URL: kigo-etl-0.0.9.tar.gz
  • Upload date:
  • Size: 13.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.6.0 importlib_metadata/4.8.2 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.10.0

File hashes

Hashes for kigo-etl-0.0.9.tar.gz
Algorithm Hash digest
SHA256 ed319eab945618235197593aaa8c09b3540d21d0fadd36eb9f6869c784b0cc51
MD5 f5fec520576e24d1484097a17250a223
BLAKE2b-256 116abe2a1a48972290865d4f71f51d0346567debcb9935526598e3bbf5161686

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page