Sketch

Sketch Fine-Tuning Model Lora

Test Results for xyplot as Follows

1. Steps (Recommended 24 steps)

2. Sampler (Recommended euler)

3. Dispatcher (Recommended karras\AYS SD1)

4. CFG (Range 6-8, Recommended 7)

5. Lora Weight (Range 0.6-0.8)

Regarding image-to-sketch conversion, the result with added ccsr enlargement is as follows:

Regarding the direct output effect of Lora without ccsr enlargement:

In conclusion: Prompt words should be combined according to the training data, and the Sampler, Dispatcher, CFG Steps should choose suitable parameters based on the above results.

The training set mainly includes: girl, boy, eyes, eyelashes, eyebrows, hair, etc.

Train for 200 steps over 8 epochs

Train large model: majicv7

Clip: 2

Training Data:

sketch: 182 pencil lines: 178 sketching: 178 monochrome: 178 greyscale: 167 1girl: 170

hair: 147 profile: 145 portrait: 145 simple background: 140 eyelashes: 135 eyebrows: 124

solo: 120 nose: 120 eyes: 119 lips: 118 ladies' hairstyles: 114 realistic: 102 white background: 80

front view: 78 long hair: 81 side view: 68 ears: 65 looking at viewer: 59 closed mouth: 54 upper body: 39

short hair: 33 bangs: 31 parted lips: 30 jewelry: 27 male focus: 26 mens hairstyles: 26 1boy: 26 wavy hair: 21

earrings: 19 eye: 18 lipstick: 17 smile: 17 makeup: 16 shirt: 14 bare shoulders: 13 hand: 13 closed eyes: 11

necklace: 10 from side: 9 fingers: 8 greyscale: 8 collarbone: 7 teeth: 7 nude: 7 left eye: 7 side view: 6

hair ornament: 6 breasts: 6 dress: 6 back view: 6 hair bun: 6 hand up: 6 men's hairstyles: 6 single hair bun: 5

off shoulder: 5 collared shirt: 5 blunt bangs: 5 pompadour: 5 right eye: 5 close-up: 4 bob cut: 4 fingernails: 4 undercut: 4

mole: 4 medium hair: 4 hat: 4 looking back: 4 long sleeves: 4 braid: 4 finger to mouth: 3 looking down: 3 beard: 3

hair over eyes: 3 half-closed eyes: 3 hair over one eye: 3 mohawk: 3 left eye: 3 twin braids: 3 facial hair: 3 head tilt: 3

right eye: 3 looking away: 3 jacket: 3 one eye closed: 3 sepia: 3 looking to the side: 3 from behind: 2 wing collar: 2

tears: 2 tattoo: 2 mature male: 2 japanese clothes: 2 skirt hold: 2 bracelet: 2 round eyewear:2 sweater:2  hoopearrings:2

open mouth: 2 buzz cut: 2 cleavage: 2 very short hair: 2 glasses: 2 black lips: 2 messy hair: 2 looking up: 2 standing: 2

ring: 2 full body: 2 facing away: 2 parted bangs: 2 baseball cap: 2 crying: 2 grey background: 2 crying with eyes open: 2

nape: 2 ponytail: 1 barefoot: 1 strapless dress: 1 hair scrunchie: 1 stud earrings: 1 border: 2 hand on own face: 1

single braid: 1 front eye: 1 choker: 1 long fingernails: 1 braided ponytail: 1 hair ribbon: 1 mustache: 1 off-shoulder shirt: 1

floating hair: 1 **** top: 1 sharp teeth: 1 sleeves past wrists: 1 cabbie hat: 1 bangle: 1 sunglasses: 1 mole under eye: 1

hair censor: 1 striped: 1 hair bow: 1 piercing: 1 mole under mouth: 1 simple background: 1 flower: 1 grin: 1 neck: 1

walking: 1 hair between eyes: 1 armlet: 1 shushing: 1 adjusting eyewear: 1 expressionless: 1 ribbon: 1 hairclip: 1

scrunchie: 1 bow: 1 sash: 1 thick eyebrows: 1 hair over breasts: 1 strapless: 1 striped shirt: 1 brown hair: 1

straight hair: 1 forehead mark: 1 sitting: 1 curtained hair: 1 overalls: 1