Skip to main content

GGUF connector(s) with GUI

Project description

GGUF connector

GGUF (GPT-Generated Unified Format) is a successor of GGML (GPT-Generated Model Language), it was released on August 21, 2023; by the way, GPT stands for Generative Pre-trained Transformer.

This package is a simple graphical user interface (GUI) application that uses the ctransformers or llama.cpp to interact with a chat model for generating responses.

Install the connector via pip (once only):

pip install gguf-connector

Update the connector (if previous version installed) by:

pip install gguf-connector --upgrade

With this version, you can interact straight with the GGUF file(s) available in the same directory by a simple command.

Graphical User Interface (GUI)

Select model(s) with llama.cpp connector:

gguf cpp

Select model(s) with ctransformers:

gguf c

Command Line Interface (CLI)

Select model(s) with ctransformers:

gguf g

Select model(s) with llama.cpp connector:

gguf gpp

Connector selection menu

You can even choose which connector (either ctransformers or llama.cpp) to be used at the very beginning.

gguf m

Import as a module

Include the connector selection menu to your code by:

from gguf_connector import menu

For standalone version please refer to the repository in the reference list (below).

References

model selector (standalone version; installable package)

cgg (cmd-based tool)

Resources

ctransformers llama.cpp

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gguf_connector-0.3.8.tar.gz (5.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

gguf_connector-0.3.8-py2.py3-none-any.whl (8.1 kB view details)

Uploaded Python 2Python 3

File details

Details for the file gguf_connector-0.3.8.tar.gz.

File metadata

  • Download URL: gguf_connector-0.3.8.tar.gz
  • Upload date:
  • Size: 5.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.4

File hashes

Hashes for gguf_connector-0.3.8.tar.gz
Algorithm Hash digest
SHA256 84f3611e3e15801824f67c44bbe2c407f82d4bb9e90449d0195b99ab3ec3aada
MD5 936706cd3308d9c752506d9d862bbfa3
BLAKE2b-256 d90185b9d4c29285c5e1ed4273b60aef78d46ca771dc5b5247b6a65cfb36712e

See more details on using hashes here.

File details

Details for the file gguf_connector-0.3.8-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for gguf_connector-0.3.8-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 0eb6c3ee5fe210ad56fbb257c37a2066be418c806eba74b6ad938c1e617f670f
MD5 2645b124f3f2c49d773b886833b4ee77
BLAKE2b-256 23b9c8306567abf0825179301a7f1d2c122600958f7cbe7108f96b0a23d3ad4c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page