Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.109.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

json_file_split-0.0.109-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.109.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.109.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.3.2 CPython/3.10.6 Linux/5.15.0-1030-azure

File hashes

Hashes for json_file_split-0.0.109.tar.gz
Algorithm Hash digest
SHA256 e4a37fd7d4a87a2e17c03305edfbff134e947412febab8126cf65b9d8d04021f
MD5 1a8090c93b6df961c448260adebbecfc
BLAKE2b-256 2a6522b798ef4450100fad3722f2c396f360be16b1aff093f1c4426b6fab6722

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.109-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.109-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.3.2 CPython/3.10.6 Linux/5.15.0-1030-azure

File hashes

Hashes for json_file_split-0.0.109-py3-none-any.whl
Algorithm Hash digest
SHA256 8e20f5dd52055caa6a0329dcf0f25a7b3f6631dd441b1536ee18b146c790ef74
MD5 15c3412ea65db33025accbab89df3fd5
BLAKE2b-256 8ab4f2d1514d5416027235d3d315bb4ff1cb45564f4ee2be3d0409b9a7ab6c40

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page