Introduction

NovelAI is an AI platform created by Anlatan, providing story continuation and image generation services, particularly popular among Chinese ACG enthusiasts. It utilizes the Stable Diffusion model and focuses on Japanese-style anime images. Users can generate images by inputting keywords or text and make adjustments post-generation. Due to its high pricing and reliance on open-source models, the model files were leaked and are often used with the "stable-diffusion-webui" project by AUTOMATIC1111.

Architecture

NovelAI leverages the Stable Diffusion model for its image generation capabilities. The platform's architecture includes several components from the Stable Diffusion ecosystem, allowing users to generate and modify images based on textual inputs.

Training

The leaked files include resources necessary to train or fine-tune models akin to NovelAI's. This encompasses Stable Diffusion checkpoints and various training scripts, enabling users to create custom models.

Guide: Running Locally

To run NovelAI locally, follow these basic steps:

  1. Download the Model:

    from modelscope import snapshot_download
    model_dir = snapshot_download('Genius-Society/NovelAI')
    
  2. Clone the Repository:

    git clone git@hf.co:Genius-Society/NovelAI
    cd NovelAI
    
  3. Set Up the Environment: Use a compatible UI like "stable-diffusion-webui" by AUTOMATIC1111 to interact with the model.

  4. Utilize Cloud GPUs: For optimal performance, especially when generating high-quality images, consider using cloud GPU services such as AWS, Google Cloud, or Azure.

License

The NovelAI model is shared under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (cc-by-nc-sa-4.0). This license permits non-commercial sharing and adaptation with appropriate credit and under the same license terms.

More Related APIs