Rocinante 12 B v1.1

Introduction

Rocinante 12B v1.1 is a versatile language model designed for a range of adventures, offering enhanced storytelling and creative capabilities. The model is enriched with new vocabulary and engaging prose, making it ideal for creative writing and role-playing scenarios.

Architecture

The Rocinante 12B v1.1 model supports multiple chat templates, including ChatML for role-playing, Alpaca for story and instructive adventures, and Mistral for NeMo applications. Users can experiment with different templates to find the best fit for their needs.

Training

Rocinante 12B v1.1 was developed with a focus on creativity and rich prose, incorporating feedback from testers to enhance its storytelling abilities. The model features adjustable sampling settings, such as a temperature of 0.7 for a more relaxed experience and 1.2 for heightened creativity.

Guide: Running Locally

1. Clone the Repository: Download the model from its Hugging Face page.
2. Install Dependencies: Ensure that you have the necessary libraries installed, such as transformers and torch.
3. Load the Model: Use the Hugging Face transformers library to load the Rocinante 12B v1.1 model.
4. Run the Model: Utilize available chat templates and adjust sampling settings to tailor the output to your preferences.

For optimal performance, consider using cloud GPUs from providers like AWS, Google Cloud, or Azure.

License

The Rocinante 12B v1.1 model is distributed under a custom license. For specific terms and conditions, refer to the model's page on Hugging Face.