Run next-generation LLMs and VLMs locally, natively, and at top speed on any hardware.
Project description
nexaai
Run next-generation LLMs and VLMs locally, natively, and at top speed on any hardware.
nexaai is the official Python SDK for NexaSDK/NexaML:
An NPU‑first cross‑platform inference engine that powers LLMs, VLMs, embeddings, audio, and vision models across NPU, GPU, and CPU—on desktop, mobile, automotive, and IoT.
Features
- 🚀 NPU‑First Performance — Accelerated AI with automatic device selection and backend optimizations.
- 🔮 Day‑0 Architecture Support — Run new LLMs, VLMs, ASR, and CV models immediately (GGUF, MLX, .nexa, and more).
- 🧩 True Multimodality — Seamless pipelines for text, vision, and audio.
- 🤖 OpenAI-Compatible Server — Supports serving, chat, and function calling.
- 🏆 Cross‑Platform — macOS (Apple Silicon), Windows (x64, ARM64), Linux, mobile, embedded.
What is it?
nexaai offers a clean Python API over NexaML’s runtime. Build modern AI applications—chatbots, copilots, vision tools—that run fully on-device with maximal hardware utilization. Designed for rapid adoption of new models and formats, especially with NPU acceleration.
Installation & Quickstart
Please refer to our official docs for up-to-date install steps, environment notes, and code examples:
- Overview: NexaAI Python SDK Overview
- Quickstart: Quickstart Guide
The docs include supported Python versions, backend requirements (NPU, MLX, GPU, CPU), and ready-to-run examples for LLMs, VLMs, embeddings, and audio.
Links
- 📚 Docs: https://docs.nexa.ai/nexa-sdk-python/overview
- 🐞 Issues/Discussions: NexaAI Issues
- 💬 Community:
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file nexaai-1.0.44.tar.gz.
File metadata
- Download URL: nexaai-1.0.44.tar.gz
- Upload date:
- Size: 74.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.10.19
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
220a78239fa880eaf356c1fded659d16fea60114cb300c4c7cac6d047635f1fb
|
|
| MD5 |
10f1dbe38e401c2871ab5af9c6126fd7
|
|
| BLAKE2b-256 |
0d4e561727d8e3b3717116a41075a166622c0ee715012a56a92bc1154432c242
|
