Skip to main content

Stable Diffusion Guide: SDXL & Variants

Stable Diffusion Models
info

For detailed information about using models with APIpie, check out our Models Overview and Completions Guide.

Description​

Stable Diffusion, developed by Stability AI, represents a state-of-the-art collection of image generation models. These models excel at creating high-quality images from text descriptions, offering enterprise-grade reliability through APIpie's routing system. The technology is built on CompVis's Latent Diffusion architecture and has been trained on LAION's extensive dataset.

For community resources and discussions, visit the Stable Diffusion subreddit or join the official Discord. The models have been extensively benchmarked and compared in various studies.

Technical Specifications​

Performance Metrics​

Model Families​

Stable Diffusion Series:

  • SDXL Models: Latest generation including animagineXL, dreamshaperXL, and sd_xl_base
  • SD V1-V2 Models: Classic models including v1-4, v1-5, and v2-1
  • Specialized Models:
    • Realistic Vision series for photorealism
    • Anime-focused models like dreamlike-anime
    • Artist-specific models and style variants
    • Children's story models
    • Epic realism series
    • Dreamshaper variants

Key Features​

  • Diverse Generation Capabilities: Over 100 models for different artistic styles and use cases
  • Provider Options: Available through multiple providers including Prodia, Bedrock, DeepInfra, and Together
  • Performance Options: From high-quality SDXL to efficient SD base models
  • Enterprise Focus: Built for production-grade image generation applications

Model List​

Model List updates dynamically please see the Models Route for the up to date list of models​

Model NameProviderTypeDescriptionBest For
3Guofeng3_v34ProdiaImageSpecialized artistic styleArtistic
absolutereality_V16ProdiaImagePhotorealistic generationRealism
absolutereality_v181ProdiaImageEnhanced realismRealism
amIReal_V41ProdiaImageReality simulationPhotorealism
analog-diffusion-1.0ProdiaImageAnalog photo styleVintage
anythingv3_0-prunedProdiaImageGeneral purposeVersatile
anything-v4.5-prunedProdiaImageUpdated general purposeVersatile
anythingV5_PrtREProdiaImageLatest anything variantVersatile
AOM3A3_orangemixsProdiaImageStyle mixing modelCreative
blazing_drive_v10gProdiaImageDynamic scene generationAction scenes
breakdomain_I2428ProdiaImageDomain transferStyle transfer
breakdomain_M2150ProdiaImageEnhanced domain transferStyle transfer
cetusMix_Version35ProdiaImageMixed style generationHybrid styles
childrensStories_v13DProdiaImageChildren's book styleKids content
childrensStories_v1SemiRealProdiaImageSemi-realistic children's styleKids content
childrensStories_v1ToonAnimeProdiaImageAnimated children's styleKids animation
Counterfeit_v30ProdiaImageStyle replicationStyle matching
cuteyukimixAdorable_midchapter3ProdiaImageCute anime styleAnime
cyberrealistic_v33ProdiaImageCyberpunk realismSci-fi realism
dalcefo_v4ProdiaImageArtistic styleCreative
deliberate_v2ProdiaImageControlled generationPrecise output
deliberate_v3ProdiaImageEnhanced controlPrecise output
dreamlike-anime-1.0ProdiaImageAnime art generationAnime
dreamlike-diffusion-1.0ProdiaImageGeneral purposeVersatile
dreamlike-photoreal-2.0ProdiaImagePhotorealistic outputPhotography
dreamshaper_6BakedVaeProdiaImageOptimized dreamshaperPerformance
dreamshaper_7ProdiaImageUpdated dreamshaperQuality
dreamshaper_8ProdiaImageLatest dreamshaperBest quality
edgeOfRealism_eorV20ProdiaImageRealistic edge detectionDetail focus
EimisAnimeDiffusion_V1ProdiaImageSpecialized animeAnime
elldreths-vivid-mixProdiaImageVivid style mixingVibrant art
epicphotogasm_xPlusPlusProdiaImageEnhanced photographyPhotography
epicrealism_naturalSinRC1VAEProdiaImageNatural realismNature scenes
epicrealism_pureEvolutionV3ProdiaImagePure realismRealism
ICantBelieveItsNotPhotography_secoProdiaImagePhotorealistic outputPhotography
indigoFurryMix_v75HybridProdiaImageFurry art styleCharacter art
juggernaut_aftermathProdiaImagePost-processing focusEffects
lofi_v4ProdiaImageLo-fi aestheticStylized
lyriel_v16ProdiaImageArtistic styleCreative
majicmixRealistic_v4ProdiaImageMagic realismFantasy realism
mechamix_v10ProdiaImageMechanical styleMecha
meinamix_meinaV9ProdiaImageStyle mixingCreative
meinamix_meinaV11ProdiaImageEnhanced mixingCreative
neverendingDream_v122ProdiaImageDreamlike qualitySurreal
openjourney_V4ProdiaImageOpen source variantGeneral use
pastelMixStylizedAnime_pruned_fp16ProdiaImagePastel anime styleAnime
portraitplus_V1.0ProdiaImagePortrait generationPortraits
protogenx34ProdiaImageGeneral purposeVersatile
Realistic_Vision_V1.4ProdiaImageRealistic generationRealism
Realistic_Vision_V2.0ProdiaImageEnhanced realismRealism
Realistic_Vision_V4.0ProdiaImageAdvanced realismRealism
Realistic_Vision_V5.0ProdiaImageLatest realismRealism
Realistic_Vision_V5.1ProdiaImageCurrent realismRealism
redshift_diffusion-V10ProdiaImageColor enhancementColor focus
revAnimated_v122ProdiaImageAnimated styleAnimation
rundiffusionFX25D_v10ProdiaImage2.5D effectsDimensional
rundiffusionFX_v10ProdiaImageSpecial effectsEffects
sdv1_4ProdiaImageBase SD v1.4General use
v1-5-pruned-emaonlyProdiaImageOptimized v1.5Efficiency
v1-5-inpaintingProdiaImageInpainting specialistEditing
shoninsBeautiful_v10ProdiaImageBeautiful styleAesthetics
theallys-mix-ii-churnedProdiaImageStyle mixtureCreative
timeless-1.0ProdiaImageTimeless aestheticClassic style
toonyou_beta6ProdiaImageCartoon styleAnimation
animagineXLV3_v30ProdiaImageSDXL animeAnime
dreamshaperXL10_alpha2ProdiaImageSDXL dreamshaperQuality
dynavisionXL_0411ProdiaImageSDXL dynamicMotion
juggernautXL_v45ProdiaImageSDXL effectsEffects
realismEngineSDXL_v10ProdiaImageSDXL realismRealism
realvisxlV40ProdiaImageSDXL visionVision
sd_xl_base_1.0ProdiaImageSDXL baseFoundation
sd_xl_base_1.0_inpainting_0.1ProdiaImageSDXL inpaintingEditing
turbovisionXL_v431ProdiaImageSDXL turboSpeed
aniverse_v30ProdiaImageAnime universeAnime
devlishphotorealism_sdxl15ProdiaImageSDXL photorealismRealism
stable-diffusion-xlBedrockImageAWS SDXLEnterprise
stable-diffusion-xl-v0BedrockImageAWS SDXL baseEnterprise
stable-diffusion-xl-v1BedrockImageAWS SDXL latestEnterprise
stable-diffusion-v1-4DeepInfraImageSD v1.4General use
stable-diffusion-v1-5DeepInfraImageSD v1.5General use
stable-diffusion-2-1DeepInfraImageSD v2.1General use
stable-diffusion-xl-base-1.0TogetherImageSDXL baseGeneral use

Example API Call​

Below is an example of how to use the Image Generation API with a Stable Diffusion model:

curl -L -X POST 'https://apipie.ai/v1/images/generations' \
-H 'Content-Type: application/json' \
-H 'Accept: application/json' \
-H 'Authorization: Bearer <YOUR_API_KEY>' \
--data-raw '{
  "provider": "prodia",
  "model": "sd_xl_base_1.0",
  "prompt": "A serene landscape with mountains reflected in a calm lake at sunset",
  "n": 1,
  "size": "1024x1024"
}'

Response Example​

The expected response structure for a Stable Diffusion model:

{
  "created": 1729535643,
  "data": [
    {
      "url": "https://example.com/generated-image.png",
      "b64_json": null
    }
  ],
  "usage": {
    "prompt_tokens": 15,
    "total_tokens": 15,
    "cost": 0.008000,
    "latency_ms": 5200
  }
}

API Highlights and Integration​

  • Model Selection:
    • Use SDXL variants for highest quality
    • Choose specialized models for specific styles (anime, realistic, artistic)
    • Select provider based on needs (Prodia, Bedrock, DeepInfra, Together)
  • Parameters:
    • Customize image size, quality, and generation parameters
    • Support for advanced prompting techniques
  • Response: Receive generated images as URLs or base64 encoded data

Applications and Success Stories​

  • Creative Applications:

    • Digital art creation with tools like Automatic1111's Web UI
    • Anime and illustration using specialized models
    • Character design for games and animation
    • Concept art for production pipelines

  • Professional Use:

    • Product visualization for e-commerce
    • Marketing materials and advertising
    • Stock photo alternatives
    • Content creation for social media
    • Architecture and interior design

  • Specialized Tasks:

    • Photorealistic imaging
    • Artistic style transfer and remixing
    • Character generation for gaming
    • Scene composition for storyboarding
    • Fashion design and visualization

  • Research and Development:

    • AI art research and experimentation
    • Model fine-tuning and customization
    • Novel image generation techniques
    • Computer vision applications

Ethical Considerations​

Stable Diffusion models should be used responsibly with appropriate content filtering and bias consideration. For more information, visit Stability AI's safety Policy.

Licensing and Resources​

Stable Diffusion models are available under the CreativeML Open RAIL-M license.

Additional Resources:

tip

Try out the Stable Diffusion models in APIpie's various supported integrations.