llama-cpp-python

toolsbackend

source

GitHub - abetlen/llama-cpp-python: Python bindings for llama.cpp

what

• python bindings for llama-cpp

features

• Low-level access to C API via ctypes interface.
• High-level Python API for text completion
• OpenAI compatible web server