AUTOMATIC1111
337bc4a2fb
Merge pull request #13014 from AUTOMATIC1111/thread-safe-extranetworks-list_items
...
thread safe extra network list_items
2023-11-19 09:09:21 +03:00
v0xie
eb667e715a
feat: LyCORIS/kohya OFT network support
2023-11-15 18:28:48 -08:00
v0xie
d6d0b22e66
fix: ignore calc_scale() for COFT which has very small alpha
2023-11-15 03:08:50 -08:00
v0xie
bbf00a96af
refactor: remove unused function
2023-11-04 14:56:47 -07:00
v0xie
329c8bacce
refactor: use same updown for both kohya OFT and LyCORIS diag-oft
2023-11-04 14:54:36 -07:00
v0xie
f6c8201e56
refactor: move factorization to lyco_helpers, separate calc_updown for kohya and kb
2023-11-03 19:35:15 -07:00
v0xie
fe1967a4c4
skip multihead attn for now
2023-11-03 17:52:55 -07:00
v0xie
d727ddfccd
no idea what i'm doing, trying to support both type of OFT, kblueleaf diag_oft has MultiheadAttn which kohya's doesn't?, attempt create new module based off network_lora.py, errors about tensor dim mismatch
2023-11-02 00:13:11 -07:00
v0xie
65ccd6305f
detect diag_oft type
2023-11-02 00:11:32 -07:00
v0xie
a2fad6ee05
test implementation based on kohaku diag-oft implementation
2023-11-01 22:34:27 -07:00
v0xie
6523edb8a4
style: conform style
2023-10-22 09:31:15 -07:00
v0xie
3b8515d2c9
fix: multiplier applied twice in finalize_updown
2023-10-22 09:27:48 -07:00
v0xie
4a50c9638c
refactor: remove used OFT functions
2023-10-22 08:54:24 -07:00
v0xie
de8ee92ed8
fix: use merge_weight to cache value
2023-10-21 17:37:17 -07:00
v0xie
76f5abdbdb
style: cleanup oft
2023-10-21 16:07:45 -07:00
v0xie
fce86ab7d7
fix: support multiplier, no forward pass hook
2023-10-21 16:03:54 -07:00
v0xie
7683547728
fix: return orig weights during updown, merge weights before forward
2023-10-21 14:42:24 -07:00
v0xie
2d8c894b27
refactor: use forward hook instead of custom forward
2023-10-21 13:43:31 -07:00
v0xie
0550659ce6
style: fix ambiguous variable name
2023-10-19 13:13:02 -07:00
v0xie
d10c4db57e
style: formatting
2023-10-19 12:52:14 -07:00
v0xie
321680ccd0
refactor: fix constraint, re-use get_weight
2023-10-19 12:41:17 -07:00
Kohaku-Blueleaf
7c128bbdac
Add fp8 for sd unet
2023-10-19 13:56:17 +08:00
v0xie
eb01d7f0e0
faster by calculating R in updown and using cached R in forward
2023-10-18 04:56:53 -07:00
v0xie
853e21d98e
faster by using cached R in forward
2023-10-18 04:27:44 -07:00
v0xie
1c6efdbba7
inference working but SLOW
2023-10-18 04:16:01 -07:00
v0xie
ec718f76b5
wip incorrect OFT implementation
2023-10-17 23:35:50 -07:00
AUTOMATIC1111
4be7b620c2
Merge pull request #13568 from AUTOMATIC1111/lora_emb_bundle
...
Add lora-embedding bundle system
2023-10-14 12:18:55 +03:00
AUTOMATIC1111
a8cbe50c9f
remove duplicated code
2023-10-14 12:17:59 +03:00
v0xie
906d1179e9
support inference with LyCORIS GLora networks
2023-10-11 21:26:58 -07:00
Kohaku-Blueleaf
891ccb767c
Fix lint
2023-10-10 15:07:25 +08:00
Kohaku-Blueleaf
81e94de318
Add warning when meet emb name conflicting
...
Choose standalone embedding (in /embeddings folder) first
2023-10-10 14:44:20 +08:00
Kohaku-Blueleaf
2282eb8dd5
Remove dev debug print
2023-10-10 12:11:00 +08:00
Kohaku-Blueleaf
3d8b1af6be
Support string_to_param nested dict
...
format:
bundle_emb.EMBNAME.string_to_param.KEYNAME
2023-10-10 12:09:33 +08:00
Kohaku-Blueleaf
2aa485b5af
add lora bundle system
2023-10-09 22:52:09 +08:00
w-e-w
74b80e7211
add comment
2023-09-12 09:29:07 +09:00
w-e-w
e785402b6a
return nothing if not found
2023-09-11 19:37:55 +09:00
dongwenpu
7d4d871d46
fix: lora-bias-backup don't reset cache
2023-09-10 17:53:42 +08:00
w-e-w
f5959c1c30
thread safe extra network using list
2023-09-09 17:05:50 +09:00
w-e-w
25de9a785c
Revert "thread safe extra network list_items"
...
This reverts commit aab385d01b
2023-09-09 16:56:19 +09:00
w-e-w
aab385d01b
thread safe extra network list_items
2023-09-03 11:56:02 +09:00
bluelovers
d83a1ba65b
feat: display file metadata ss_output_name
...
https://github.com/AUTOMATIC1111/stable-diffusion-webui/issues/12289
2023-08-29 06:33:00 +08:00
AUTOMATIC1111
86221269f9
RAM optimization round 2
2023-08-16 09:55:35 +03:00
AUTOMATIC1111
85fcb7b8df
lint
2023-08-15 19:25:03 +03:00
AUTOMATIC1111
8b181c812f
Merge pull request #12584 from AUTOMATIC1111/full-module-with-bias
...
Add ex_bias into full module
2023-08-15 19:24:15 +03:00
AUTOMATIC1111
f01682ee01
store patches for Lora in a specialized module
2023-08-15 19:23:40 +03:00
Kohaku-Blueleaf
aa57a89a21
full module with ex_bias
2023-08-15 23:41:46 +08:00
Kohaku-Blueleaf
f70ded8936
remove "if bias exist" check
2023-08-14 13:53:40 +08:00
Kohaku-Blueleaf
e7c03ccdce
Merge branch 'dev' into extra-norm-module
2023-08-14 13:34:51 +08:00
Kohaku-Blueleaf
d9cc27cb29
Fix MHA updown err and support ex-bias for no-bias layer
2023-08-14 13:32:51 +08:00
AUTOMATIC1111
1c6ca09992
Merge pull request #12510 from catboxanon/feat/extnet/hashes
...
Support search and display of hashes for all extra network items
2023-08-13 16:46:32 +03:00
AUTOMATIC1111
db40d26d08
linter
2023-08-13 16:38:10 +03:00
AUTOMATIC1111
d8419762c1
Lora: output warnings in UI rather than fail for unfitting loras; switch to logging for error output in console
2023-08-13 15:07:37 +03:00
catboxanon
7fa5ee54b1
Support search and display of hashes for all extra network items
2023-08-13 02:32:54 -04:00
Kohaku-Blueleaf
5881dcb887
remove debug print
2023-08-13 02:36:02 +08:00
Kohaku-Blueleaf
a2b8305096
return None if no ex_bias
2023-08-13 02:35:04 +08:00
Kohaku-Blueleaf
bd4da4474b
Add extra norm module into built-in lora ext
...
refer to LyCORIS 1.9.0.dev6
add new option and module for training norm layer
(Which is reported to be good for style)
2023-08-13 02:27:39 +08:00
catboxanon
4fafc34e49
Fix to make LoRA old method setting work
2023-08-10 23:42:58 -04:00
AUTOMATIC1111
eed963e972
Lora cache in memory
2023-08-09 16:54:49 +03:00
AUTOMATIC1111
362789a379
gradio 3.39
2023-08-04 08:04:23 +03:00
AUTOMATIC1111
91a131aa6c
update lora extension to work with python 3.8
2023-07-27 09:00:47 +03:00
AUTOMATIC1111
d0bf509fa1
fix for #11963
2023-07-25 16:18:10 +03:00
catboxanon
a68f469030
Fix to parse TE in some LoRAs
2023-07-24 17:54:59 -04:00
AUTOMATIC1111
b010eea520
fix incorrect multiplier for Loras
2023-07-19 00:41:00 +03:00
AUTOMATIC1111
136c8859a4
add backwards compatibility --lyco-dir-backcompat option, use that for LyCORIS directory instead of hardcoded value
...
prevent running preload.py for disabled extensions
2023-07-18 20:11:30 +03:00
AUTOMATIC1111
4b5a63aa11
add a bit more metadata info for the lora user metadata page
2023-07-18 17:32:46 +03:00
Kohaku-Blueleaf
3d31caf4a5
use "is not None" for Tensor
2023-07-18 10:45:42 +08:00
Kohaku-Blueleaf
17e14ed2d9
Fix wrong key name in lokr module
2023-07-18 10:23:41 +08:00
AUTOMATIC1111
699108bfbb
hide cards for networks of incompatible stable diffusion version in Lora extra networks interface
2023-07-17 18:56:22 +03:00
AUTOMATIC1111
35510f7529
add alias to lyco network
...
read networks from LyCORIS dir if it exists
add credits
2023-07-17 10:06:02 +03:00
AUTOMATIC1111
2e07a8ae6b
some backwards compatibility
...
linter
2023-07-17 09:05:18 +03:00
AUTOMATIC1111
238adeaffb
support specifying te and unet weights separately
...
update lora code
support full module
2023-07-17 09:00:47 +03:00
AUTOMATIC1111
46466f09d0
Lokr support
2023-07-17 00:29:07 +03:00
AUTOMATIC1111
58c3df32f3
IA3 support
2023-07-17 00:12:18 +03:00
AUTOMATIC1111
ef5dac7786
fix
2023-07-17 00:01:17 +03:00
AUTOMATIC1111
c2297b89d3
linter
2023-07-16 23:14:57 +03:00
AUTOMATIC1111
b75b004fe6
lora extension rework to include other types of networks
2023-07-16 23:13:55 +03:00
AUTOMATIC1111
0198eaec45
Merge pull request #11757 from AUTOMATIC1111/sdxl
...
SD XL support
2023-07-16 12:04:53 +03:00
AUTOMATIC1111
7b052eb70e
add resolution calculation from buckets for lora user metadata page
2023-07-16 10:07:02 +03:00
AUTOMATIC1111
47d9dd0240
speedup extra networks listing
2023-07-16 09:25:32 +03:00
AUTOMATIC1111
a1d6ada69a
allow refreshing single card after editing user metadata instead of all cards
2023-07-16 08:38:23 +03:00
AUTOMATIC1111
11f339733d
add lora user metadata editor dialog inspired by MrKuenning's mockup from #7458
2023-07-16 00:57:45 +03:00
AUTOMATIC1111
e5d3ae2bf4
user metadata system for custom networks
2023-07-15 20:39:10 +03:00
AUTOMATIC1111
dc39061856
thank you linter
2023-07-13 21:19:41 +03:00
AUTOMATIC1111
6c5f83b19b
add support for SDXL loras with te1/te2 modules
2023-07-13 21:17:50 +03:00
AUTOMATIC1111
76ebb175ca
lora support
2023-07-13 12:59:31 +03:00
AUTOMATIC1111
d7d6e8cfc8
use natural sort for shared.walk_files and shared.listfiles, as well as for dirs in extra networks
2023-07-08 16:45:59 +03:00
Aarni Koskela
d75ed52bfc
Don't die when a LoRA is a broken symlink
...
Fixes #11098
2023-06-09 13:26:36 +03:00
AUTOMATIC1111
7a7a201d81
Merge pull request #10956 from akx/len
...
Simplify a bunch of `len(x) > 0`/`len(x) == 0` style expressions
2023-06-05 11:06:37 +03:00
catboxanon
9009e25cb1
Apply suggestions from code review
...
Co-authored-by: Aarni Koskela <akx@iki.fi>
2023-06-02 16:12:24 -04:00
Aarni Koskela
51864790fd
Simplify a bunch of len(x) > 0/len(x) == 0 style expressions
2023-06-02 15:07:10 +03:00
catboxanon
7dca8e7698
Support dynamic sort of extra networks
2023-06-02 04:08:45 +00:00
AUTOMATIC
39ec4f06ff
calculate hashes for Lora
...
add lora hashes to infotext
when pasting infotext, use infotext's lora hashes to find local loras for <lora:xxx:1> entries whose hashes match loras the user has
2023-05-19 22:59:29 +03:00
Aarni Koskela
2725dfd8a6
Fix ruff lint
2023-05-19 12:37:34 +03:00
AUTOMATIC1111
e38e7dbfb9
Merge pull request #10529 from ryankashi/master
...
Added /sdapi/v1/refresh-loras api checkpoint post request
2023-05-19 08:04:13 +03:00
ryankashi
4dd5559162
Added the refresh-loras post request
2023-05-18 14:12:01 -07:00
AUTOMATIC
44c37f94e1
add messages about Loras that failed to load to UI
2023-05-18 16:36:30 +03:00
AUTOMATIC
7001e1ed61
Merge branch 'master' into dev
2023-05-14 13:36:16 +03:00
AUTOMATIC
b9abdb50a3
add a possible fix for 'LatentDiffusion' object has no attribute 'lora_layer_mapping'
2023-05-14 13:31:03 +03:00
AUTOMATIC
e8eea1bb7a
Merge branch 'release_candidate' into dev
2023-05-13 20:26:13 +03:00
AUTOMATIC
477199357f
add an option to always refer to lora by filenames
...
never refer to lora by an alias if multiple loras have same alias or the alias is called none
2023-05-13 20:15:37 +03:00
