Anubis 70 B v1 G G U F B R O K E N

Introduction

Anubis-70B-v1-GGUF-BROKEN is a conversational AI model developed by TheDrummer. It is a fine-tuned version of the L3.3 model, praised for its creativity and natural dialogue capabilities.

Architecture

Anubis-70B is designed to be a balanced model within the L3.3 tunes, providing creative and engaging interaction. It is optimized to perform beyond its baseline 70 billion parameters, with capabilities likened to models in the 120 billion range.

Training

The model has been fine-tuned to deliver natural-sounding dialogue and prose, excelling in creating engaging scenarios and bringing characters to life. Its creativity and adherence to instructions make it stand out among similar models.

Guide: Running Locally

1. Installation: Clone the repository from Hugging Face.
2. Dependencies: Ensure that all required libraries are installed, typically via pip install.
3. Execution: Run the model using a supported environment. Note that some quantized versions in this repository are broken; it is advised to use quantizations from other users like Bartowski.
4. Hardware: For optimal performance, consider using cloud GPUs such as those provided by AWS, Google Cloud, or Azure.

License

This model is released under a non-standard license, indicated as "other" in the repository.