177 Commits

Author	SHA1	Message	Date
AUTOMATIC1111	6e4fc5e1a8	Merge pull request #14871 from v0xie/boft ... Support inference with LyCORIS BOFT networks	2024-02-19 10:05:30 +03:00
Kohaku-Blueleaf	4eb949625c	prevent undefined variable	2024-02-19 14:43:07 +08:00
Kohaku-Blueleaf	5a8dd0c549	Fix rescale	2024-02-18 14:58:41 +08:00
catboxanon	06ab10a1be	Normalize cmd arg paths ... In particular, this fixes an issue on Windows where some functions will misbehave if forward slashes are provided rather than double backslashes.	2024-02-15 14:22:13 -05:00
Kohaku-Blueleaf	90441294db	Add rescale mechanism ... LyCORIS will support save oft_blocks instead of oft_diag in the near future (for both OFT and BOFT) But this means we need to store the rescale if user enable it.	2024-02-12 14:25:09 +08:00
v0xie	eb6f2df826	Revert "fix: add butterfly_factor fn" ... This reverts commit 81c16c965e.	2024-02-08 22:00:15 -08:00
v0xie	613b0d9548	doc: add boft comment	2024-02-08 21:58:59 -08:00
v0xie	325eaeb584	fix: get boft params from weight shape	2024-02-08 11:55:05 -08:00
v0xie	2f1073dc6e	style: fix lint	2024-02-07 04:55:11 -08:00
v0xie	81c16c965e	fix: add butterfly_factor fn	2024-02-07 04:54:14 -08:00
v0xie	a4668a16b6	fix: calculate butterfly factor	2024-02-07 04:51:22 -08:00
v0xie	9588721197	feat: support LyCORIS BOFT	2024-02-07 04:49:17 -08:00
AUTOMATIC1111	358e9e2847	Merge pull request #14726 from v0xie/fix-oft-device ... Fix kohya-ss OFT network wrong device for eye and constraint	2024-01-23 22:34:24 +03:00
AUTOMATIC1111	569dc1919c	Merge pull request #14588 from Sj-Si/feature/extra-networks-tree-view ... Feature: Extra Networks Tree View	2024-01-22 22:24:06 +03:00
v0xie	fd383140cf	fix: wrong devices for eye and constraint	2024-01-22 02:52:34 -08:00
chi2nagisa	e280eb4055	fix using wrong model caused by alias	2024-01-16 03:45:19 +08:00
Sj-Si	036500223d	Merge changes from dev	2024-01-11 16:37:35 -05:00
Sj-Si	0726a6e12e	Finish base layout. Fix bugs. Need to test for stability and clean up.	2024-01-11 15:06:57 -05:00
AUTOMATIC1111	8b6848c6db	Merge pull request #14546 from AUTOMATIC1111/fix-oft-dtype ... Fix dtype casting in OFT module	2024-01-06 10:50:38 +03:00
Kohaku-Blueleaf	44744d6005	linting	2024-01-05 16:38:05 +08:00
Kohaku-Blueleaf	18ca987c92	Add general forward method for all modules.	2024-01-05 16:32:19 +08:00
Kohaku-Blueleaf	f8f38c7c28	Fix dtype casting for OFT module	2024-01-05 16:31:48 +08:00
Learwin	d4945f4422	Removed weight slider for negative prompts	2023-12-31 13:22:30 +01:00
Learwin	a2f23f9d22	Code Style fixes	2023-12-30 22:16:51 +01:00
Learwin	bc5ae74c7d	Added negative prompts to extra networks lora	2023-12-30 21:52:27 +01:00
w-e-w	59d060fd5e	More lora not found warning	2023-12-30 17:11:03 +09:00
Kohaku-Blueleaf	0fb34b57b8	Merge branch 'dev' into test-fp8	2023-12-14 16:54:45 +08:00
AUTOMATIC1111	2be85f8fe0	Merge pull request #14237 from ReneKroon/dev ... #13354 : solve lora loading issue	2023-12-14 10:15:36 +03:00
AUTOMATIC1111	6ef0ff39f2	Merge pull request #14300 from AUTOMATIC1111/oft_fixes ... Fix wrong implementation in network_oft	2023-12-14 10:14:19 +03:00
AUTOMATIC1111	778a30a95e	Merge pull request #14237 from ReneKroon/dev ... #13354 : solve lora loading issue	2023-12-14 10:08:03 +03:00
Kohaku-Blueleaf	3772a82a70	better naming and correct order for device.	2023-12-14 01:47:13 +08:00
Kohaku-Blueleaf	8fc67f3851	remove debug print	2023-12-14 01:44:49 +08:00
Kohaku-Blueleaf	265bc26c21	Use self.scale instead of custom finalize	2023-12-14 01:43:24 +08:00
Kohaku-Blueleaf	735c9e8059	Fix network_oft	2023-12-14 01:38:32 +08:00
Rene Kroon	16bdcce92d	#13354: solve lora loading issue	2023-12-08 21:20:55 +01:00
Kohaku-Blueleaf	370a77f8e7	Option for using fp16 weight when apply lora	2023-11-21 19:59:34 +08:00
Kohaku-Blueleaf	b60e1088db	Merge branch 'dev' into test-fp8	2023-11-19 15:24:57 +08:00
AUTOMATIC1111	337bc4a2fb	Merge pull request #13014 from AUTOMATIC1111/thread-safe-extranetworks-list_items ... thread safe extra network list_items	2023-11-19 09:09:21 +03:00
v0xie	eb667e715a	feat: LyCORIS/kohya OFT network support	2023-11-15 18:28:48 -08:00
v0xie	d6d0b22e66	fix: ignore calc_scale() for COFT which has very small alpha	2023-11-15 03:08:50 -08:00
v0xie	bbf00a96af	refactor: remove unused function	2023-11-04 14:56:47 -07:00
v0xie	329c8bacce	refactor: use same updown for both kohya OFT and LyCORIS diag-oft	2023-11-04 14:54:36 -07:00
v0xie	f6c8201e56	refactor: move factorization to lyco_helpers, separate calc_updown for kohya and kb	2023-11-03 19:35:15 -07:00
v0xie	fe1967a4c4	skip multihead attn for now	2023-11-03 17:52:55 -07:00
v0xie	d727ddfccd	no idea what i'm doing, trying to support both type of OFT, kblueleaf diag_oft has MultiheadAttn which kohya's doesn't?, attempt create new module based off network_lora.py, errors about tensor dim mismatch	2023-11-02 00:13:11 -07:00
v0xie	65ccd6305f	detect diag_oft type	2023-11-02 00:11:32 -07:00
v0xie	a2fad6ee05	test implementation based on kohaku diag-oft implementation	2023-11-01 22:34:27 -07:00
v0xie	6523edb8a4	style: conform style	2023-10-22 09:31:15 -07:00
v0xie	3b8515d2c9	fix: multiplier applied twice in finalize_updown	2023-10-22 09:27:48 -07:00
v0xie	4a50c9638c	refactor: remove used OFT functions	2023-10-22 08:54:24 -07:00