Skip to main content

Super simple Docker Build Dependency Pipeline

Project description

baker-cli

A small, pragmatic Python CLI that controls your Docker build cascades uniformly locally and in CI:

  • Targets & Bundles are defined in YAML
  • Tags are created by checksum (self / self+deps) or by expressions (ENV, files, Git-SHA, ...)
  • Build only when necessary: Existence check locally or in registry
  • Optionally generates a docker-bake.hcl and builds via docker buildx bake
  • Build-Args are definable, get interpolated and flow into the hash
  • Configuration values can be overridden via CLI (--set key=value)

Contents


Quickstart

1) Installation with venv (Recommended)

mkdir my-project

cd my-project

python3 -m venv .venv
source .venv/bin/activate

pip install baker-cli

baker init

2) Global installation (pip/pipx)

# With pip
pip install baker-cli

# Or with pipx (recommended for global CLIs)
pipx install baker-cli

# Initialize project (current directory or target folder)
baker init
# or
baker init ./my-project

2) Development (local, .venv)

# Create virtual environment
python -m venv .venv
source .venv/bin/activate

# Install project locally (editable)
pip install -U pip
pip install -e .

# Initialize project (if not yet present)
baker init

# Optional: Generate CI workflow
baker ci --settings build-settings.yml

# Example: Plan & Build
baker plan
baker build --push --targets base

Prerequisites

  • Python 3.11+
  • Docker (with buildx plugin)

Repository Layout

demo/                           # Project name
├── build-settings.yml          # Build configuration
├── sqlite/                     # Sample Stage "sqlite"
│   └── Dockerfile              # Related Dockerfile
└── ui/                         # Sample Stage "ui"
    └── Dockerfile              # Related Dockerfile

Configuration (build-settings.yml)

Targets

targets:
  cascade-base:
    dockerfile: Dockerfile.sqlite
    context: .
    tags:
      - "cascade-base:{{ checksum_self }}"
    build-args:
      CONDUCTOR_VERSION: "3.16.0"
      JAVA_VERSION: "17"

  cascade-ui:
    dockerfile: ui/Dockerfile
    context: .
    tags:
      - "cascade-ui:{{ checksum_self }}"
    depends_on:
      - cascade-base
    build-args:
      BASE_IMAGE: "cascade-base:{{ checksum_self }}"

Bundles

bundles:
  all:
    targets:
      - cascade-base
      - cascade-ui

  sqlite:
    targets:
      - cascade-base

Interpolation & Expressions

targets:
  my-target:
    tags:
      - "my-app:{{ env.BUILD_VERSION }}"
      - "my-app:{{ git.short_sha }}"
      - "my-app:{{ file_hash('package.json') }}"
    build-args:
      VERSION: "{{ env.BUILD_VERSION }}"
      COMMIT_SHA: "{{ git.full_sha }}"

Tag Expressions (Functions)

  • {{ checksum_self }} - Hash of Dockerfile + context
  • {{ checksum_deps }} - Hash of dependencies
  • {{ env.VAR_NAME }} - Environment variable
  • {{ git.short_sha }} - Short Git commit hash
  • {{ git.full_sha }} - Full Git commit hash
  • {{ file_hash('path/to/file') }} - Hash of specific file
  • {{ timestamp }} - Current timestamp

Build-Args & Hashing

Build-args are interpolated and included in the hash calculation:

targets:
  my-target:
    build-args:
      VERSION: "{{ env.BUILD_VERSION }}"
      FEATURE_FLAG: "{{ env.ENABLE_FEATURE }}"
    # These args flow into the checksum calculation

CLI

plan

Show what would be built:

# Show plan for specific targets
python baker.py plan --targets cascade-base

# Show plan with existence check
python baker.py plan --check local --targets cascade-base

# Show plan for bundles
python baker.py plan --targets all

gen-hcl

Generate docker-bake.hcl file:

# Generate HCL file
python baker.py gen-hcl --targets cascade-base

# Generate for all targets
python baker.py gen-hcl --targets all

gen-docker

Generate Dockerfiles from Jinja2 templates with platform-specific recipes:

# Generate Dockerfiles for debian variant (default)
baker gen-docker

# Generate for alpine variant
baker gen-docker --variant alpine

# Generate for specific targets only
baker gen-docker --targets base dev --variant alpine

# Dry-run: show what would be generated
baker gen-docker --dry-run

# Show diff against existing Dockerfiles
baker gen-docker --diff --variant alpine

Setup:

  1. Add dockerfile_template to your targets in build-settings.yml:
targets:
  base:
    dockerfile: docker/Dockerfile.base          # Generated output
    dockerfile_template: docker-templates/base/Dockerfile.j2  # Source template
    context: .
  1. Create template files using Jinja2 syntax with recipes:
# docker-templates/base/Dockerfile.j2
FROM {{ base_image }}

# Use platform-specific recipe for package installation
{{ recipe("install_packages", packages=["curl", "ca-certificates"]) }}

# Conditional recipe
{% if has_recipe("compile_postgres") %}
{{ recipe("compile_postgres", pg_version="16.4") }}
{% endif %}
  1. (Optional) Create variant-specific configs in docker-templates/base/variants/:
# variants/alpine.yml
system_packages:
  - curl
  - ca-certificates
  1. (Optional) Define custom recipes in dockerfile-recipes.yml:
recipes:
  my_custom_recipe:
    debian: |
      RUN apt-get install -y {{ packages | join(' ') }}
    alpine: |
      RUN apk add {{ packages | join(' ') }}

Built-in Recipes:

Recipe Description
install_packages Install system packages (apt/apk)
install_build_packages Install build dependencies
cleanup_build_packages Remove build dependencies
pip_install Install Python packages
create_user Create non-root user
compile_postgres Build minimal psql (debian only)
install_postgres_client Install psql via package manager
compile_nginx Build nginx with minimal modules (debian only)
install_nginx Install nginx via package manager
cleanup_caches Remove pip/yarn/uv caches

build

Build Docker images:

# Build locally
baker build --check local --no-push --targets base

# Build and push
baker build --check remote --push --targets base

# Build with Dockerfile generation (for templated projects)
baker build --gen-docker --variant debian --targets base

# Build alpine variant
baker build --gen-docker --variant alpine --targets base

Global Overrides (--set)

Override configuration values:

# Override build args
python baker.py build --set CONDUCTOR_VERSION=3.17.0 --targets cascade-base

# Override multiple values
python baker.py build --set CONDUCTOR_VERSION=3.17.0 --set JAVA_VERSION=21 --targets cascade-base

Existence Check & Push Strategy

Local Check

python baker.py build --check local --push=off --targets cascade-base
  • Checks if image exists locally
  • Skips build if found

Registry Check

python baker.py build --check registry --push=on --targets cascade-base
  • Checks if image exists in registry
  • Skips build if found
  • Pushes after successful build

No Check

python baker.py build --check=off --push=on --targets cascade-base
  • Always builds
  • Pushes after successful build

GitHub Actions Example

name: Build and Push

on:
  push:
    branches: [main]
  pull_request:
    branches: [main]

jobs:
  build:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v3

      - name: Set up Python
        uses: actions/setup-python@v4
        with:
          python-version: '3.9'

      - name: Install dependencies
        run: pip install pyyaml

      - name: Build images
        run: |
          python baker.py build \
            --check registry \
            --push=on \
            --targets all \
            --set BUILD_VERSION=${{ github.sha }}

rm

Remove local Docker images for specific or all targets:

# Dry-run: show what would be removed for specific targets
baker rm --targets base app --dry-run

# Remove only primary tags for all targets
baker rm

# Remove all tags for selected targets
baker rm --targets base app --all-tags

# Force remove (dangling/used) images
baker rm --targets base --force

Tips & Best Practices

1. Use Checksums for Reproducible Builds

targets:
  my-target:
    tags:
      - "my-app:{{ checksum_self }}"

2. Leverage Dependencies

targets:
  base:
    dockerfile: Dockerfile.base

  app:
    dockerfile: Dockerfile.app
    depends_on:
      - base
    build-args:
      BASE_IMAGE: "base:{{ checksum_self }}"

3. Use Environment Variables for Dynamic Values

targets:
  my-target:
    build-args:
      VERSION: "{{ env.BUILD_VERSION }}"
      COMMIT_SHA: "{{ git.short_sha }}"

4. Group Related Targets in Bundles

bundles:
  production:
    targets:
      - base
      - app
      - worker

  development:
    targets:
      - base
      - dev-tools

Troubleshooting

Common Issues

1. Docker Buildx Not Available

# Enable buildx
docker buildx create --use

2. Registry Authentication

# Login to registry
docker login my-registry.com

3. Build Context Issues

# Ensure context includes all necessary files
targets:
  my-target:
    context: .  # Use project root
    dockerfile: path/to/Dockerfile

4. Tag Collisions

# Use unique tags
targets:
  my-target:
    tags:
      - "my-app:{{ checksum_self }}"
      - "my-app:latest"  # Only if appropriate

Security Notes

1. Build-Args Security

  • Build-args are visible in image history
  • Don't pass secrets via build-args
  • Use multi-stage builds for sensitive data

2. Registry Security

  • Use authenticated registries
  • Scan images for vulnerabilities
  • Use specific tags, avoid latest

3. Context Security

  • Use .dockerignore to exclude sensitive files
  • Minimize build context size
  • Review Dockerfile for security best practices

Advanced Usage

Custom Tag Functions

targets:
  my-target:
    tags:
      - "my-app:{{ env.BUILD_VERSION }}-{{ git.short_sha }}"
      - "my-app:{{ file_hash('package.json') }}"

Conditional Builds

targets:
  my-target:
    dockerfile: Dockerfile
    tags:
      - "my-app:{{ checksum_self }}"
    # Only build if specific conditions are met
    build-args:
      BUILD_TYPE: "{{ env.BUILD_TYPE }}"

Multi-Architecture Builds

targets:
  my-target:
    platforms:
      - linux/amd64
      - linux/arm64
    tags:
      - "my-app:{{ checksum_self }}"

This baker-cli provides a powerful yet simple way to manage Docker builds with consistency between local development and CI/CD pipelines.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

baker_cli-1.1.3.tar.gz (34.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

baker_cli-1.1.3-py3-none-any.whl (35.8 kB view details)

Uploaded Python 3

File details

Details for the file baker_cli-1.1.3.tar.gz.

File metadata

  • Download URL: baker_cli-1.1.3.tar.gz
  • Upload date:
  • Size: 34.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for baker_cli-1.1.3.tar.gz
Algorithm Hash digest
SHA256 fe7d3230d968d323d20dd0ef91fcf587515dfe9168bc5a81fa4f63615be69f0d
MD5 c617dbecee42f0103608685e194f93d8
BLAKE2b-256 3e031fd722fd2a6e283479cc6acf55b95ae3957fe5ce315186cbd8a13382f668

See more details on using hashes here.

File details

Details for the file baker_cli-1.1.3-py3-none-any.whl.

File metadata

  • Download URL: baker_cli-1.1.3-py3-none-any.whl
  • Upload date:
  • Size: 35.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for baker_cli-1.1.3-py3-none-any.whl
Algorithm Hash digest
SHA256 b8268641d99f1b21e582fa7bb388c379022e2d89bb3bdcdee80ca138c83e91e5
MD5 190974e8ba43fb520a7a798356a8b57d
BLAKE2b-256 65cec14085593a8b05e68555e094ee785e599859d0e3b66fc3ec8699756bfee9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page