41 Commits

Author	SHA1	Message	Date
Kohaku-Blueleaf	851c3d51ed	Fix bugs for torch.nn.MultiheadAttention	2024-03-09 12:31:32 +08:00
Aarni Koskela	e3fa46f26f	Fix various typos with crate-ci/typos	2024-03-04 08:42:07 +02:00
chi2nagisa	e280eb4055	fix using wrong model caused by alias	2024-01-16 03:45:19 +08:00
Kohaku-Blueleaf	18ca987c92	Add general forward method for all modules.	2024-01-05 16:32:19 +08:00
w-e-w	59d060fd5e	More lora not found warning	2023-12-30 17:11:03 +09:00
Kohaku-Blueleaf	0fb34b57b8	Merge branch 'dev' into test-fp8	2023-12-14 16:54:45 +08:00
Rene Kroon	16bdcce92d	#13354: solve lora loading issue	2023-12-08 21:20:55 +01:00
Kohaku-Blueleaf	370a77f8e7	Option for using fp16 weight when apply lora	2023-11-21 19:59:34 +08:00
Kohaku-Blueleaf	b60e1088db	Merge branch 'dev' into test-fp8	2023-11-19 15:24:57 +08:00
v0xie	65ccd6305f	detect diag_oft type	2023-11-02 00:11:32 -07:00
v0xie	d10c4db57e	style: formatting	2023-10-19 12:52:14 -07:00
Kohaku-Blueleaf	7c128bbdac	Add fp8 for sd unet	2023-10-19 13:56:17 +08:00
v0xie	1c6efdbba7	inference working but SLOW	2023-10-18 04:16:01 -07:00
v0xie	ec718f76b5	wip incorrect OFT implementation	2023-10-17 23:35:50 -07:00
AUTOMATIC1111	4be7b620c2	Merge pull request #13568 from AUTOMATIC1111/lora_emb_bundle ... Add lora-embedding bundle system	2023-10-14 12:18:55 +03:00
AUTOMATIC1111	a8cbe50c9f	remove duplicated code	2023-10-14 12:17:59 +03:00
v0xie	906d1179e9	support inference with LyCORIS GLora networks	2023-10-11 21:26:58 -07:00
Kohaku-Blueleaf	81e94de318	Add warning when meet emb name conflicting ... Choose standalone embedding (in /embeddings folder) first	2023-10-10 14:44:20 +08:00
Kohaku-Blueleaf	2282eb8dd5	Remove dev debug print	2023-10-10 12:11:00 +08:00
Kohaku-Blueleaf	3d8b1af6be	Support string_to_param nested dict ... format: bundle_emb.EMBNAME.string_to_param.KEYNAME	2023-10-10 12:09:33 +08:00
Kohaku-Blueleaf	2aa485b5af	add lora bundle system	2023-10-09 22:52:09 +08:00
dongwenpu	7d4d871d46	fix: lora-bias-backup don't reset cache	2023-09-10 17:53:42 +08:00
AUTOMATIC1111	86221269f9	RAM optimization round 2	2023-08-16 09:55:35 +03:00
AUTOMATIC1111	f01682ee01	store patches for Lora in a specialized module	2023-08-15 19:23:40 +03:00
Kohaku-Blueleaf	f70ded8936	remove "if bias exist" check	2023-08-14 13:53:40 +08:00
Kohaku-Blueleaf	e7c03ccdce	Merge branch 'dev' into extra-norm-module	2023-08-14 13:34:51 +08:00
Kohaku-Blueleaf	d9cc27cb29	Fix MHA updown err and support ex-bias for no-bias layer	2023-08-14 13:32:51 +08:00
AUTOMATIC1111	d8419762c1	Lora: output warnings in UI rather than fail for unfitting loras; switch to logging for error output in console	2023-08-13 15:07:37 +03:00
Kohaku-Blueleaf	a2b8305096	return None if no ex_bias	2023-08-13 02:35:04 +08:00
Kohaku-Blueleaf	bd4da4474b	Add extra norm module into built-in lora ext ... refer to LyCORIS 1.9.0.dev6 add new option and module for training norm layer (Which is reported to be good for style)	2023-08-13 02:27:39 +08:00
catboxanon	4fafc34e49	Fix to make LoRA old method setting work	2023-08-10 23:42:58 -04:00
AUTOMATIC1111	eed963e972	Lora cache in memory	2023-08-09 16:54:49 +03:00
AUTOMATIC1111	d0bf509fa1	fix for #11963	2023-07-25 16:18:10 +03:00
catboxanon	a68f469030	Fix to parse TE in some LoRAs	2023-07-24 17:54:59 -04:00
AUTOMATIC1111	136c8859a4	add backwards compatibility --lyco-dir-backcompat option, use that for LyCORIS directory instead of hardcoded value ... prevent running preload.py for disabled extensions	2023-07-18 20:11:30 +03:00
AUTOMATIC1111	35510f7529	add alias to lyco network ... read networks from LyCORIS dir if it exists add credits	2023-07-17 10:06:02 +03:00
AUTOMATIC1111	238adeaffb	support specifying te and unet weights separately ... update lora code support full module	2023-07-17 09:00:47 +03:00
AUTOMATIC1111	46466f09d0	Lokr support	2023-07-17 00:29:07 +03:00
AUTOMATIC1111	58c3df32f3	IA3 support	2023-07-17 00:12:18 +03:00
AUTOMATIC1111	ef5dac7786	fix	2023-07-17 00:01:17 +03:00
AUTOMATIC1111	b75b004fe6	lora extension rework to include other types of networks	2023-07-16 23:13:55 +03:00