Local Diffusion

Text-to-image generator based on Stable Diffusion. Powered by blace.ai
Learn about license types
Description

Local Diffusion

Local Diffusion is a Stable Diffusion based image generator and interpolator running locally and native inside AE.

shipsprompt interpolation example using the latest interactive model


Features


explode

New: Stable Diffusion XL

We now integrate the latest state-of-the-art image model! Use SDXL for unmatched fidelity, details and photorealism.

Versatile prompting

We have implemented a simple and effective prompting mechanism. Prompts are entered via mask names and can be weighted by the masks opacity.
river
dreamy forest, spring, fairytale vibes, narnia, mystical world, peaceful setting, a calm river, mountains in the background, matte painting panorama, detailed
orc
mechanical orc made of metal parts on the battlefield, trending on artstation, dramatic lighting, firesparks
city 2
futuristic gigantic city, highly detailed, cinematic, photorealistic rendering, digital skyscrapers, flying cars and spaceships

Interpolate prompts

Keyframe the prompts weight to interpolate between objects and find interesting concepts.
clown zombie"a zombie" -> "a clown"

i2i source i2i res

Guide creation by source layer

The Source+Text mode allows you to specify a layer which guides the images creation. This way prompting and interpolation can be applied to your own footage.
<- "industrial robot" to "person made of clay"

Full control over generation exposed!

You get full control over the model used, the aspect ratio, guidance scale and the seed. This allows for fast iterations and experimentation.
params

how to

Easy to use and performant

This is a native port into our ai framework and therefore easy to install and use. Local Diffusion makes use of some state-of-the-art performance optimizations and produces images fast!

Integrated Superresolution

We ship an integrated superresolution ai with the plugin. Up to 3072x3072 pixel output!
sr before sr after

neg prompt

Negative prompts

Simply add a "-" in front of the text to use it as negative prompt.

More features to come...

While you play with Local Diffusion, we are already working hard on integrating more features :)


Hardware support


cpu mode hardware acceleration
Windows with NVIDIA GPU
Windows with other GPU
MacOS ≥ 12.3 (M1/M2 or Intel with AMD GPU) MacOS ≥ 11.5

Hardware acceleration will run orders of magnitude faster than the cpu mode.


Tutorials & Documentation


Documentation


Additional Infos


Compatibility

It runs on AE 2022 and above. Please test your configuration using the free trial before purchasing.

Limitations

GPU mode may be not as stable as cpu mode.

On Windows an Nvidia graphics card is needed for gpu version of the plugin.

Trial version

The trial is fully functional with a blue cross watermark which is removed once a valid license is entered.

Credits

Based on research and implementation of Stability Ai.


Social Media


Discussions

Want to talk about it?

Head over to r/aescripts to chat with fellow users about this product.

Need Support?

Please open a support ticket to be connected directly with the author of this product

Version History

2.3.42 -

Nov 10, 2025

Updated licensing framework. Fix installer sometimes not pulling all needed libraries. Please update all of our other plugins as well.

2.3.41 -

Nov 3, 2025

Improve stability in composition with multiple effect instances. Please update all of our other plugins as well.

2.3.40 -

Oct 16, 2025

Fix black frame bug.

2.3.39 -

Oct 15, 2025

Update shared AI libraries.

2.3.36 -

Aug 11, 2025

Fix initializing bug on some systems with AMD cards.

2.3.35 -

Aug 3, 2025

Fix initializing bug with RTX 5xxx cards.

2.3.33 -

Jul 27, 2025

Improve error logging.

2.3.31 -

Jul 15, 2025

Compatibility update.

2.3.30 -

Jul 14, 2025

Fix for memory leak that could appear under some settings.

2.3.29 -

Jul 6, 2025

Compatibility update.

2.3.28 -

Jun 30, 2025

Fix 16bit mode causing artifacts in bright areas.

2.3.27 -

Jun 15, 2025

Fix for memory leak that could appear under some settings.

2.3.26 -

Jun 11, 2025

Enable support for NVIDIA 5xxx series. Fix loading conflict with some other 3rdparty plugins.

2.3.23 -

May 12, 2025

Make non-cuda version dependent on less system libraries.

2.3.20 -

May 8, 2025

Fix links of optional models.

2.2.20 -

May 6, 2025

Small performance update.

2.2.19 -

Apr 21, 2025

Fix bug which lead to gpu memory filling up.

2.2.18 -

Apr 16, 2025

Improve result caching. Fix conflicts with AE-internal GPU-enabled effects.

2.2.17 -

Apr 16, 2025

Fix error with 16bit compositions.

2.2.16 -

Apr 14, 2025

Improve plugin loading times.

2.2.15 -

Apr 1, 2025

Fix plugin loading on new AE versions for MacOS.

2.2.1 -

Nov 17, 2024

Compatibility update. If you use several of our plugins please update all to the latest version.

2.1.20 -

Oct 16, 2024

Update installers to recognize latest AE release.

2.1.19 -

Oct 6, 2024

Fix component manager not being shown sometimes.

2.1.18 -

Sep 29, 2024

Fix crash on loading project with certain other effects present.

2.1.17 -

Sep 18, 2024

Fix crash on cpu-only installations.

2.1.16 -

Sep 15, 2024

Update some libraries to ensure compatibility across plugins.

2.1.15 -

Aug 27, 2024

Improve loading times if certain other plugins are present.

2.1.14 -

Aug 18, 2024

Fix loading error on systems with some 3rdparty plugins.

2.1.13 -

Aug 12, 2024

Fix crash on playback stopping.

2.1.12 -

Jul 31, 2024

Add back missing register button.

2.1.10 -

Jul 29, 2024

Fix flag mismatch.

2.1.9 -

Jul 28, 2024

All our plugins can be run in the same AE session now.

2.1.6 -

Jun 30, 2024

- fixed memory leak that could lead to crashes during long renderings
- ensure proper error logging if startup fails

2.1.3 -

Apr 28, 2024

- improved responsiveness on parameter dragging
- fixed model loading bug

2.0.12 -

Mar 10, 2024

- make installer run on systems with non-default windows configurations

2.0.9 -

Feb 28, 2024

- fix installer not being accessible from aescripts manager app

2.0.7 -

Feb 26, 2024

- added fallback server to our installers. only use this option if you have trouble connecting to our primary servers. on MacOS we provide a second installer and on Windows you can choose the fallback server from the installer.

2.0.6 -

Feb 15, 2024

- improved internal caching mechanism. this will render faster in some cases.

2.0.5 -

Feb 8, 2024

- fix wrong frame rendered if effect applied to trimmed precomp
- better error logging

2.0.3 -

Feb 6, 2024

- fix version number initialization

2.0.2 -

Feb 6, 2024

- fix crash on effect duplication

2.0.0 -

Jan 3, 2024

- added a latent consistency model. it gives good results in much fewer (4-8) steps
- added switch for decoding quality, this setting it to "Preview" will give another speedup
- introduction of a component manager. this allows for flexible installation of older models (https://docs.blaceplugins.com/installation.html#components).

1.6.14 -

Nov 27, 2023

- show progress bar during model running and be more responsive if cancelled

1.6.13 -

Nov 21, 2023

- fix crashes during rendering with media encoder

1.6.9 -

Nov 15, 2023

- fix cuda initialization on some devices

1.6.6 -

Nov 6, 2023

- fix bug which only permitted text inputs of 32 characters

1.6.5 -

Oct 30, 2023

- move installer payload to more stable server. no functional changes.

1.6.4 -

Oct 16, 2023

- fix another library loading bug

1.6.1 -

Oct 15, 2023

- fix plugin initialization on non-nvidia systems

1.6.0 -

Oct 8, 2023

- update underlying ai libraries for better performance and stability

1.5.6 -

Oct 4, 2023

- fix installer bug which lead to missing dependency on some systems

1.5.5 -

Oct 4, 2023

- make installer compatible with upcoming AE 2024

1.5.4 -

Sep 20, 2023

- increase logging verbosity during plugin loading

1.5.3 -

Sep 18, 2023

-better initialization logging

1.5.2 -

Sep 11, 2023

- add stable diffusion xl model

1.4.9 -

Aug 31, 2023

- improve loading time on MacOS Big Sur

1.4.6 -

Aug 31, 2023

- fix initialization bug on MacOS Big Sur

1.4.5 -

Aug 29, 2023

- fix plugin initialization on some systems

1.4.3 -

Aug 20, 2023

- bug fixes

1.3.2 -

Jul 6, 2023

-bug fixes

1.3.0 -

May 29, 2023

- added new scheduler "Multistep DPM-Solver" which gives good results with much lower steps
- fixed bug in base model, This may lead to slightly different outputs than in the last version and therefore breaks backwards compatibility for the "base" model

1.2.0 -

May 22, 2023

- support for negative prompts. Simply append a "-" before the prompt and it will be used for negative conditioning.

1.1.0 -

May 4, 2023

- add "source + text" mode. this allows for image generation based on input layer and (interpolated) prompt

1.0.0 -

May 4, 2023

Initial release

Compatibility

After Effects

2025, 2024, 2023