Add Kandinsky 2.1#3308

Merged

yiyixuxu merged 188 commits intomainfrom

May 25, 2023

Commits on May 1, 2023

add prior
yiyixuxu
committed
add conversion script
yiyixuxu
committed

Commits on May 3, 2023

fix file name
yiyixuxu
committed

Commits on May 4, 2023

add unet + text_proj
yiyixuxu
committed

Commits on May 6, 2023

Merge remote-tracking branch 'origin/main' into kandinsky
yiyixuxu
committed
soft dependency on m-clip
yiyixuxu
committed
add dynamic thresholding to unclip
yiyixuxu
committed

Commits on May 7, 2023

Revert "soft dependency on m-clip"
yiyixuxu
committed
fix a bug in text_proj
yiyixuxu
committed

Commits on May 10, 2023

add PipelineKandinsky
yiyixuxu
committed
[WIP] add Kandinsky image encoder and Multi-clip model (#3373)

authored
add image_encoder to prior
yiyixuxu
committed
add mclip text encoder/tokenizer
yiyixuxu
committed
add
yiyixuxu
committed
remove comments about batch_size
yiyixuxu
committed
refactor dynamic threholding
yiyixuxu
committed
put prior pipeline into a seperate file
yiyixuxu
committed
add more copy from methods
yiyixuxu
committed
make style
yiyixuxu
committed
fix _execution_device for prior pipeline
yiyixuxu
committed
make fix-copies
yiyixuxu
committed
make style
yiyixuxu
committed
fix some doc string
yiyixuxu
committed
style
yiyixuxu
committed

Commits on May 11, 2023

Commits on May 12, 2023

fix height and width arg
yiyixuxu
committed
add inpaint
yiyixuxu
committed
refactor text2imge pipeline
yiyixuxu
committed
add a note about batch_size argument
yiyixuxu
committed
finish inpaint pipeline first draft
yiyixuxu
committed
add post-processing to inpaint
yiyixuxu
committed
Merge remote-tracking branch 'origin/main' into kandinsky
yiyixuxu
committed
[WIP] Add Kandinsky decoder (#3330)

authored
Revert "[WIP] Add Kandinsky decoder (#3330)"
yiyixuxu
committed
ayusha's PR to add MoVQ

ayushmangal
authored and
yiyixuxu
committed

Commits on May 13, 2023

adapt attention_processor for movq
yiyixuxu
committed
add movq module
yiyixuxu
committed
make style
yiyixuxu
committed
add vq_emb and spatial_norm step bo attnprocessor2.0
yiyixuxu
committed

Commits on May 15, 2023

image_embeds and negative_image_embeds arguments are required
yiyixuxu
committed
add tests
yiyixuxu
committed
fix
yiyixuxu
committed
fix image_embeds dtype
yiyixuxu
committed
fix cpu offload
yiyixuxu
committed
fix batch consistent
yiyixuxu
committed
remove print line
yiyixuxu
committed
fix inpaint pipeline
yiyixuxu
committed

Commits on May 16, 2023

refactor image and mask pre-processing
yiyixuxu
committed
fix
yiyixuxu
committed
refactor adding movq_scale_factor
yiyixuxu
committed
fix mask dtype
yiyixuxu
committed
fix mask shape
yiyixuxu
committed
add inpaint test
yiyixuxu
committed
make style
yiyixuxu
committed
prior_num_inference_steps -> num_inference_steps
yiyixuxu
committed
clean up prior pipeline args
yiyixuxu
committed
remove the hardcoded clip image size
yiyixuxu
committed
output
yiyixuxu
committed
add tests for prior
yiyixuxu
committed
add slow test for text2img
yiyixuxu
committed
more tests
yiyixuxu
committed
Update src/diffusers/pipelines/kandinsky/text_encoder.py

yiyixuxu
and
patrickvonplaten
authored
Update src/diffusers/pipelines/kandinsky/text_encoder.py

yiyixuxu
and
patrickvonplaten
authored
Update src/diffusers/pipelines/kandinsky/text_encoder.py

yiyixuxu
and
patrickvonplaten
authored

Commits on May 17, 2023

fix
yiyixuxu
committed
make style
yiyixuxu
committed
fix tokenizer max_length + fix fast tests for text2img
yiyixuxu
committed
fix inpaint fast test
yiyixuxu
committed
make style
yiyixuxu
committed
fix
yiyixuxu
committed
add doc
yiyixuxu
committed
doc
yiyixuxu
committed
[WIP] Add img2img (#3426)

ayushtues
and
ayushmangal
authored
Revert "[WIP] Add img2img (#3426)"
yiyixuxu
committed
ayush's PR to add img2img #3426

ayushmangal
authored and
yiyixuxu
committed

Commits on May 18, 2023

img2img with ddim
yiyixuxu
committed
remove a manual random seed
yiyixuxu
committed
fix
yiyixuxu
committed
make batch_size latents, instead of x2
yiyixuxu
committed
more clean up
yiyixuxu
committed
fix image pre-processing
yiyixuxu
committed
fix batching
yiyixuxu
committed
add slow test for img2img
yiyixuxu
committed
fix slow tests
yiyixuxu
committed
make style
yiyixuxu
committed
Merge branch 'main' into kandinsky
yiyixuxu
authored
make style
yiyixuxu
committed
add doc
yiyixuxu
committed

Commits on May 19, 2023

Commits on May 20, 2023

Apply suggestions from code review

yiyixuxu
and
patrickvonplaten
authored
fix
yiyixuxu
committed
add interpolate method
yiyixuxu
committed
make style
yiyixuxu
committed
fix
yiyixuxu
committed
add docstring and post-processing to text2img
yiyixuxu
committed
fix doc string for inpaint
yiyixuxu
committed
more docstring fix
yiyixuxu
committed
return a tuple in prior
yiyixuxu
committed

Commits on May 21, 2023

clean up
yiyixuxu
committed
fix copies
yiyixuxu
committed
make style
yiyixuxu
committed
Update src/diffusers/pipelines/kandinsky/pipeline_kandinsky_inpaint.py

yiyixuxu
and
patrickvonplaten
authored
Update src/diffusers/models/vae.py

yiyixuxu
and
patrickvonplaten
authored
Update src/diffusers/pipelines/kandinsky/pipeline_kandinsky_img2img.py

yiyixuxu
and
patrickvonplaten
authored
fix copies + testing removing batch_size
yiyixuxu
committed
update post-processing for prior pipeline
yiyixuxu
committed
update tests (specify steps and cfg arguments)
yiyixuxu
committed
add back batch_size
yiyixuxu
committed
update tests
yiyixuxu
committed
make style
yiyixuxu
committed

Commits on May 22, 2023

Update src/diffusers/pipelines/kandinsky/text_encoder.py

yiyixuxu
and
patrickvonplaten
authored
Update tests/pipelines/kandinsky/test_kandinsky_img2img.py

yiyixuxu
and
patrickvonplaten
authored
Update tests/pipelines/kandinsky/test_kandinsky_inpaint.py

yiyixuxu
and
patrickvonplaten
authored
Update tests/pipelines/kandinsky/test_kandinsky_inpaint.py

yiyixuxu
and
patrickvonplaten
authored
Update src/diffusers/pipelines/kandinsky/pipeline_kandinsky_prior.py

yiyixuxu
and
patrickvonplaten
authored
Merge remote-tracking branch 'origin/main' into kandinsky
yiyixuxu
committed
fix
yiyixuxu
committed
refactor the cfg
yiyixuxu
committed
fix
yiyixuxu
committed

Commits on May 23, 2023

refactor for ddim
yiyixuxu
committed
add a note about ddpm scheduler
yiyixuxu
committed
unclip scheduler -> ddim
yiyixuxu
committed
refactor the cfg in inpaint
yiyixuxu
committed
scheduler step_offset =1 for img2img
yiyixuxu
committed
update test_inference_batch_consistent test: output_type ='np'
yiyixuxu
committed
update tests
yiyixuxu
committed
update valueerror
yiyixuxu
committed
style
yiyixuxu
committed
update doc
yiyixuxu
committed
fix
yiyixuxu
committed
make style
yiyixuxu
committed

Commits on May 24, 2023

slow test
yiyixuxu
committed
style
yiyixuxu
committed
Update docs/source/en/api/pipelines/kandinsky.mdx

yiyixuxu
and
sayakpaul
authored
Update docs/source/en/api/pipelines/kandinsky.mdx

yiyixuxu
and
sayakpaul
authored
Update docs/source/en/api/pipelines/kandinsky.mdx

yiyixuxu
and
sayakpaul
authored
Update docs/source/en/api/pipelines/kandinsky.mdx

yiyixuxu
and
sayakpaul
authored
Update docs/source/en/api/pipelines/kandinsky.mdx

yiyixuxu
and
sayakpaul
authored
Update docs/source/en/api/pipelines/kandinsky.mdx

yiyixuxu
and
sayakpaul
authored
update img2img slow test
yiyixuxu
committed
style
yiyixuxu
committed
Merge branch 'kandinsky' of https://github.com/huggingface/diffusers into kandinsky
yiyixuxu
committed
refactor inpaintpipeline to use ddim
yiyixuxu
committed
update tests for inpaint
yiyixuxu
committed
make style
yiyixuxu
committed
Update docs/source/en/api/pipelines/kandinsky.mdx

yiyixuxu
and
patrickvonplaten
authored
Update docs/source/en/api/pipelines/kandinsky.mdx

yiyixuxu
and
patrickvonplaten
authored
Update docs/source/en/api/pipelines/kandinsky.mdx

yiyixuxu
and
patrickvonplaten
authored
Update docs/source/en/api/pipelines/kandinsky.mdx

yiyixuxu
and
patrickvonplaten
authored
Update docs/source/en/api/pipelines/kandinsky.mdx

yiyixuxu
and
patrickvonplaten
authored
Update docs/source/en/api/pipelines/kandinsky.mdx

yiyixuxu
and
patrickvonplaten
authored
Update docs/source/en/api/pipelines/kandinsky.mdx

yiyixuxu
and
patrickvonplaten
authored
Update docs/source/en/api/pipelines/kandinsky.mdx

yiyixuxu
and
patrickvonplaten
authored
Update docs/source/en/api/pipelines/kandinsky.mdx

yiyixuxu
and
patrickvonplaten
authored
Update docs/source/en/api/pipelines/kandinsky.mdx

yiyixuxu
and
patrickvonplaten
authored
Update src/diffusers/pipelines/kandinsky/pipeline_kandinsky.py

yiyixuxu
and
patrickvonplaten
authored
Update src/diffusers/pipelines/kandinsky/pipeline_kandinsky_prior.py

yiyixuxu
and
patrickvonplaten
authored
Update src/diffusers/pipelines/kandinsky/pipeline_kandinsky_prior.py

yiyixuxu
and
patrickvonplaten
authored
remove torchvision transform
yiyixuxu
committed
fix test for prior
yiyixuxu
committed
style
yiyixuxu
committed
revert unclip scheduler
yiyixuxu
committed
more
yiyixuxu
committed
fix inpaint test - update scheduler
yiyixuxu
committed
make style
yiyixuxu
committed
change checkpoint name for prior
yiyixuxu
committed
update ckpt name for text2img
yiyixuxu
committed
update ckpt for inpaint
yiyixuxu
committed
style
yiyixuxu
committed
explain interpolate
yiyixuxu
committed
style
yiyixuxu
committed
change default num_inference_steps for prior to 25
yiyixuxu
committed
lose test for inpaint
yiyixuxu
committed
remove a comment
yiyixuxu
committed
udpate
yiyixuxu
committed
style
yiyixuxu
committed

Commits on May 25, 2023

Update docs/source/en/api/pipelines/kandinsky.mdx

yiyixuxu
and
sayakpaul
authored
add author names
yiyixuxu
committed
Merge branch 'kandinsky' of https://github.com/huggingface/diffusers into kandinsky
yiyixuxu
committed
remove yiyi files
yiyixuxu
committed