154 Commits

Author	SHA1	Message	Date
AUTOMATIC	7d6b388d71	Merge branch 'ae'	2022-10-21 13:35:01 +03:00
AUTOMATIC1111	0c5522ea21	Merge branch 'master' into training-help-text	2022-10-21 09:57:55 +03:00
guaneec	b69c37d25e	Allow datasets with only 1 image in TI	2022-10-21 09:54:09 +03:00
Milly	85dd62c4c7	train: ui: added Split image threshold and Split image overlap ratio to preprocess	2022-10-20 23:35:01 +09:00
Milly	9681419e42	train: fixed preprocess image ratio	2022-10-20 23:32:41 +09:00
captin411	0ddaf8d202	improve face detection a lot	2022-10-20 00:34:55 -07:00
DepFA	858462f719	do caption copy for both flips	2022-10-20 02:57:18 +01:00
captin411	59ed744383	face detection algo, configurability, reusability ... Try to move the crop in the direction of a face if it is present More internal configuration options for choosing weights of each of the algorithm's findings Move logic into its module	2022-10-19 17:19:02 -07:00
DepFA	9b65c4ecf4	pass preprocess_txt_action param	2022-10-20 00:49:23 +01:00
DepFA	fbcce66601	add existing caption file handling	2022-10-20 00:46:54 +01:00
DepFA	c3835ec85c	pass overwrite old flag	2022-10-20 00:24:24 +01:00
DepFA	0087079c2d	allow overwrite old embedding	2022-10-20 00:10:59 +01:00
captin411	41e3877be2	fix entropy point calculation	2022-10-19 13:44:59 -07:00
captin411	abeec4b630	Add auto focal point cropping to Preprocess images ... This algorithm plots a bunch of points of interest on the source image and averages their locations to find a center. Most points come from OpenCV. One point comes from an entropy model. OpenCV points account for 50% of the weight and the entropy based point is the other 50%. The center of all weighted points is calculated and a bounding box is drawn as close to centered over that point as possible.	2022-10-19 03:18:26 -07:00
MalumaDev	1997ccff13	Merge branch 'master' into test_resolve_conflicts	2022-10-18 08:55:08 +02:00
DepFA	62edfae257	print list of embeddings on reload	2022-10-17 08:42:17 +03:00
MalumaDev	ae0fdad64a	Merge branch 'master' into test_resolve_conflicts	2022-10-16 17:55:58 +02:00
MalumaDev	9324cdaa31	ui fix, re organization of the code	2022-10-16 17:53:56 +02:00
AUTOMATIC	0c5fa9a681	do not reload embeddings from disk when doing textual inversion	2022-10-16 09:09:04 +03:00
MalumaDev	97ceaa23d0	Merge branch 'master' into test_resolve_conflicts	2022-10-16 00:06:36 +02:00
DepFA	b6e3b96dab	Change vector size footer label	2022-10-15 17:23:39 +03:00
DepFA	ddf6899df0	generalise to popular lossless formats	2022-10-15 17:23:39 +03:00
DepFA	9a1dcd78ed	add webp for embed load	2022-10-15 17:23:39 +03:00
DepFA	939f16529a	only save 1 image per embedding	2022-10-15 17:23:39 +03:00
DepFA	9e846083b7	add vector size to embed text	2022-10-15 17:23:39 +03:00
MalumaDev	7b7561f6e4	Merge branch 'master' into test_resolve_conflicts	2022-10-15 16:20:17 +02:00
AUTOMATIC1111	ea8aa1701a	Merge branch 'master' into master	2022-10-15 10:13:16 +03:00
AUTOMATIC	c7a86f7fe9	add option to use batch size for training	2022-10-15 09:24:59 +03:00
Melan	4d19f3b7d4	Raise an assertion error if no training images have been found.	2022-10-14 22:45:26 +02:00
AUTOMATIC	03d62538ae	remove duplicate code for log loss, add step, make it read from options rather than gradio input	2022-10-14 22:43:55 +03:00
AUTOMATIC	326fe7d44b	Merge remote-tracking branch 'Melanpan/master'	2022-10-14 22:14:50 +03:00
AUTOMATIC	c344ba3b32	add option to read generation params for learning previews from txt2img	2022-10-14 20:31:49 +03:00
MalumaDev	bb57f30c2d	init	2022-10-14 10:56:41 +02:00
Melan	8636b50aea	Add learn_rate to csv and removed a left-over debug statement	2022-10-13 12:37:58 +02:00
Melan	1cfc2a1898	Save a csv containing the loss while training	2022-10-12 23:36:29 +02:00
Greg Fuller	f776254b12	[2/?] [wip] ignore OPT_INCLUDE_RANKS for training filenames	2022-10-12 13:12:18 -07:00
AUTOMATIC	698d303b04	deepbooru: added option to use spaces or underscores ... deepbooru: added option to quote (\) in tags deepbooru/BLIP: write caption to file instead of image filename deepbooru/BLIP: now possible to use both for captions deepbooru: process is stopped even if an exception occurs	2022-10-12 21:55:43 +03:00
AUTOMATIC	c3c8eef9fd	train: change filename processing to be more simple and configurable ... train: make it possible to make text files with prompts train: rework scheduler so that there's less repeating code in textual inversion and hypernets train: move epochs setting to options	2022-10-12 20:49:47 +03:00
AUTOMATIC1111	cc5803603b	Merge pull request #2037 from AUTOMATIC1111/embed-embeddings-in-images ... Add option to store TI embeddings in png chunks, and load from same.	2022-10-12 15:59:24 +03:00
DepFA	10a2de644f	formatting	2022-10-12 13:15:35 +01:00
DepFA	50be33e953	formatting	2022-10-12 13:13:25 +01:00
JC_Array	f53f703aeb	resolved conflicts, moved settings under interrogate section, settings only show if deepbooru flag is enabled	2022-10-11 18:12:12 -05:00
JC-Array	963d986396	Merge branch 'AUTOMATIC1111:master' into deepdanbooru_pre_process	2022-10-11 17:33:15 -05:00
AUTOMATIC	6be32b31d1	reports that training with medvram is possible.	2022-10-11 23:07:09 +03:00
DepFA	66ec505975	add file based test	2022-10-11 20:21:30 +01:00
DepFA	7e6a6e00ad	Add files via upload	2022-10-11 20:20:46 +01:00
DepFA	5f3317376b	spacing	2022-10-11 20:09:49 +01:00
DepFA	91d7ee0d09	update imports	2022-10-11 20:09:10 +01:00
DepFA	aa75d5cfe8	correct conflict resolution typo	2022-10-11 20:06:13 +01:00
AUTOMATIC	d6fcc6b87b	apply lr schedule to hypernets	2022-10-11 22:03:05 +03:00
DepFA	db71290d26	remove old caption method	2022-10-11 19:55:54 +01:00
DepFA	61788c0538	shift embedding logic out of textual_inversion	2022-10-11 19:50:50 +01:00
AUTOMATIC1111	419e539fe3	Merge branch 'learning_rate-scheduling' into learnschedule	2022-10-11 21:50:19 +03:00
DepFA	c080f52cea	move embedding logic to separate file	2022-10-11 19:37:58 +01:00
AUTOMATIC	d4ea5f4d86	add an option to unload models during hypernetwork training to save VRAM	2022-10-11 19:03:08 +03:00
AUTOMATIC	6d09b8d1df	produce error when training with medvram/lowvram enabled	2022-10-11 18:33:57 +03:00
AUTOMATIC1111	4f96ffd0b5	Merge pull request #2201 from alg-wiki/textual__inversion ... Textual Inversion: Preprocess and Training will only pick-up image files instead	2022-10-11 17:25:36 +03:00
DepFA	1eaad95533	Merge branch 'master' into embed-embeddings-in-images	2022-10-11 15:15:09 +01:00
AUTOMATIC	530103b586	fixes related to merge	2022-10-11 14:53:02 +03:00
alg-wiki	8bacbca0a1	Removed my local edits to checkpoint image generation	2022-10-11 17:35:09 +09:00
alg-wiki	b2368a3bce	Switched to exception handling	2022-10-11 17:32:46 +09:00
AUTOMATIC	5de806184f	Merge branch 'master' into hypernetwork-training	2022-10-11 11:14:36 +03:00
DepFA	7aa8fcac1e	use simple lcg in xor	2022-10-11 04:17:36 +01:00
JC_Array	bb932dbf9f	added alpha sort and threshold variables to create process method in preprocessing	2022-10-10 18:37:52 -05:00
JC-Array	47f5e216da	Merge branch 'deepdanbooru_pre_process' into master	2022-10-10 18:10:49 -05:00
DepFA	e0fbe6d27e	colour depth conversion fix	2022-10-10 23:26:24 +01:00
DepFA	767202a4c3	add dependency	2022-10-10 23:20:52 +01:00
DepFA	315d5a8ed9	update data dis[play style	2022-10-10 23:14:44 +01:00
alg-wiki	907a88b2d0	Added .webp .bmp	2022-10-11 06:35:07 +09:00
Fampai	2536ecbb17	Refactored learning rate code	2022-10-10 17:10:29 -04:00
alg-wiki	f0ab972f85	Merge branch 'master' into textual__inversion	2022-10-11 03:35:28 +08:00
alg-wiki	bc3e183b73	Textual Inversion: Preprocess and Training will only pick-up image files	2022-10-11 04:30:13 +09:00
DepFA	df6d0d9286	convert back to rgb as some hosts add alpha	2022-10-10 15:43:09 +01:00
DepFA	707a431100	add pixel data footer	2022-10-10 15:34:49 +01:00
DepFA	ce2d7f7eac	Merge branch 'master' into embed-embeddings-in-images	2022-10-10 15:13:48 +01:00
alg-wiki	7a20f914ed	Custom Width and Height	2022-10-10 17:05:12 +03:00
alg-wiki	6ad3a53e36	Fixed progress bar output for epoch	2022-10-10 17:05:12 +03:00
alg-wiki	ea00c1624b	Textual Inversion: Added custom training image size and number of repeats per input image in a single epoch	2022-10-10 17:05:12 +03:00
alg-wiki	04c745ea4f	Custom Width and Height	2022-10-10 22:35:35 +09:00
alg-wiki	4ee7519fc2	Fixed progress bar output for epoch	2022-10-10 17:31:33 +09:00
alg-wiki	3110f895b2	Textual Inversion: Added custom training image size and number of repeats per input image in a single epoch	2022-10-10 17:07:46 +09:00
JC_Array	1f92336be7	refactored the deepbooru module to improve speed on running multiple interogations in a row. Added the option to generate deepbooru tags for textual inversion preproccessing.	2022-10-09 23:58:18 -05:00
DepFA	e2c2925eb4	remove braces from steps	2022-10-10 00:12:53 +01:00
DepFA	d6a599ef9b	change caption method	2022-10-10 00:07:52 +01:00
DepFA	01fd9cf0d2	change source of step count	2022-10-09 22:17:02 +01:00
DepFA	96f1e6be59	source checkpoint hash from current checkpoint	2022-10-09 22:14:50 +01:00
DepFA	6684610510	correct case on embeddingFromB64	2022-10-09 22:06:42 +01:00
DepFA	d0184b8f76	change json tensor key name	2022-10-09 22:06:12 +01:00
DepFA	5d12ec82d3	add encoder and decoder classes	2022-10-09 22:05:09 +01:00
DepFA	969bd8256e	add alternate checkpoint hash source	2022-10-09 22:02:28 +01:00
DepFA	03694e1f99	add embedding load and save from b64 json	2022-10-09 21:58:14 +01:00
DepFA	5841990b0d	Update textual_inversion.py	2022-10-09 05:38:38 +01:00
AUTOMATIC	12c4d5c6b5	hypernetwork training mk1	2022-10-07 23:22:22 +03:00
Raphael Stoeckli	4288e53fc2	removed unused import, fixed typo	2022-10-06 08:52:29 +03:00
Raphael Stoeckli	2499fb4e19	Add sanitizer for captions in Textual inversion	2022-10-06 08:52:29 +03:00
AUTOMATIC	5ef0baf5ea	add support for gelbooru tags in filenames for textual inversion	2022-10-04 08:52:27 +03:00
AUTOMATIC	2865ef4b9a	fix broken date in TI	2022-10-03 13:10:03 +03:00
AUTOMATIC	6785331e22	keep textual inversion dataset latents in CPU memory to save a bit of VRAM	2022-10-02 22:59:01 +03:00
AUTOMATIC	c7543d4940	preprocessing for textual inversion added	2022-10-02 22:41:21 +03:00
AUTOMATIC	a1cde7e646	disabled SD model download after multiple complaints	2022-10-02 21:09:10 +03:00