F L U X.1 dev Lo R A Vector Journey

Introduction

The FLUX.1-DEV-LoRA-Vector-Journey model is a text-to-image generation model trained using LoRA (Low-Rank Adaptation) techniques. It integrates a cartoon illustration style with realistic backgrounds, allowing for the creation of visually engaging images by blending reality and illustration elements.

Architecture

The model is based on the FLUX.1-dev architecture. It utilizes the Diffusers library, which is a framework for building and training diffusion models. This architecture allows for efficient image generation by refining random noise into coherent images based on a given text prompt.

Training

The model was trained by Muertu, a user on Shakker AI. It uses LoRA techniques to achieve a balance between cartoon-style illustrations and realistic backgrounds. This method ensures high-quality image synthesis with a focus on artistic style blending. The training data and weights are maintained under the flux-1-dev-non-commercial-license.

Guide: Running Locally

To run the model locally, follow these steps:

1. Install the Necessary Libraries: Ensure you have torch and diffusers installed in your Python environment.

   pip install torch diffusers
   

2. Load the Model: Use the following Python script to load the model and generate an image.

   import torch
   from diffusers import FluxPipeline
   
   pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16)
   pipe.load_lora_weights("Shakker-Labs/FLUX.1-dev-LoRA-Vector-Journey", weight_name="FLUX-dev-lora-Vector-Journey.safetensors")
   pipe.fuse_lora(lora_scale=1.0)
   pipe.to("cuda")
   
   prompt = "A cartoon-style Batman, walking on the street, the art style combines reality and illustration elements."
   image = pipe(prompt, num_inference_steps=24, guidance_scale=3.5, width=768, height=1024).images[0]
   image.save(f"example.png")
   

3. Suggest Cloud GPUs: For optimal performance, consider running the model on cloud-based GPU services like AWS EC2, Google Cloud, or Azure, which offer scalable and powerful GPU resources.

License

The FLUX.1-DEV-LoRA-Vector-Journey model is released under the flux-1-dev-non-commercial-license. This license permits the use of the model for non-commercial purposes. For more details, refer to the license document.