It's known that the repo is sloppy with requirements, in particular it needs pip install of:

braceexpand perlin_numpy

This issue replaces dribnet/clipit_old#3 (more context there)

Swirl Demo

RuntimeError Traceback (most recent call last) in () 70 71 settings = pixray.apply_settings() ---> 72 pixray.do_init(settings) 73 pixray.do_run(settings) 74

1 frames /usr/local/lib/python3.7/dist-packages/torch/jit/_script.py in fail(self, *args, **kwargs) 912 def _make_fail(name): 913 def fail(self, *args, **kwargs): --> 914 raise RuntimeError(name + " is not supported on ScriptModules") 915 916 return fail

RuntimeError: requires_grad_ is not supported on ScriptModules

After some experimentation, I've found that the best optimiser to use (at least, for standard VQGAN, not pixel or clipdraw) is DiffGrad, with a step size somewhere around 1. It gives a perfect balance of structure and detail and very rarely screws up!

Prompt: A village inside of a sewer, inhabited by humanoid tardigrades. 8K HD detailed Wallpaper, digital illustration, artstation. Ran for 500 iterations, using sflckr.

What are recommended params for pixel_size? I am trying to achieve smaller pixels; have tried 1,1 - 2,2 - 3,3 - 8,8 - 16,16

Am I doing it incorrectly? Probably. I tried via direct adding pixel_size = [4, 4] as well as clipit.add_settings(pixel_size = [16, 16]). without any change in visual output.

Two new features added: the palette enforcement and the smoothness enforcement. I added several options to "vq_parser" and made minor changes in ascend_txt() (added two new losses). Plus, a new demo notebook included.

"CLIPIT PixelDraw" notebook on commit df1508, which still fails on Colab with the error NameError: name 'PixelDrawer' is not defined.

The error in more detail is:

<ipython-input-2-2646d65429bc> in <module>()
     40 
     41 settings = clipit.apply_settings()
---> 42 clipit.do_init(settings)
     43 clipit.do_run(settings)

/content/clipit/clipit.py in do_init(args)
    395             drawer = PixelDrawer(args.size[0], args.size[1], args.do_mono, [40, 40], scale=args.pixel_scale)
    396         else:
--> 397             drawer = PixelDrawer(args.size[0], args.size[1], args.do_mono, scale=args.pixel_scale)
    398     else:
    399         drawer = VqganDrawer(args.vqgan_model)

NameError: name 'PixelDrawer' is not defined

If I try running just from pixeldrawer import PixelDrawer, I get ModuleNotFoundError: No module named 'pydiffvg'

I can run import diffvg however that is the wrong name.

I changed the install code to:

  !git clone https://github.com/BachiLi/diffvg pydiffvg
  %cd pydiffvg
  # !ls
  !git submodule update --init --recursive
  !python setup.py install

Which worked until I got the error:

----> 1 pydiffvg.set_print_timing

AttributeError: module 'pydiffvg' has no attribute 'set_print_timing'.

Removing this line fixes the error.

Additionally my text editor did auto-blacken on this file to improve the formatting.

NameError                                 Traceback (most recent call last)
<ipython-input-6-e07db4d0b3d4> in <module>()
     40 
     41 settings = clipit.apply_settings()
---> 42 clipit.do_init(settings)
     43 clipit.do_run(settings)

/content/clipit/clipit.py in do_init(args)
    373             drawer = PixelDrawer(args.size[0], args.size[1], args.do_mono, [40, 40], scale=args.pixel_scale)
    374         else:
--> 375             drawer = PixelDrawer(args.size[0], args.size[1], args.do_mono, scale=args.pixel_scale)
    376     else:
    377         drawer = VqganDrawer(args.vqgan_model)

NameError: name 'PixelDrawer' is not defined

Hi, I maybe have missed it, but are there any docs on the parameters? Some I can puzzle together from the code, but others are a little bit more mysterious to me, like spot-prompts or number of cuts for example.

Using device: cuda:0 Optimising using: AdamP Using text prompts: ['leaf:-2', 'area:-3', 'flatness:5', 'text:-2', 'light on silver:3', 'flat Art', 'iridescence:1', 'the light and metallic volume of color luminance displayed'] Using seed: -1 Oops: runtime error: Sizes of tensors must match except in dimension 3. Got 224 and 398 (The offending index is 0) Try reducing --num-cuts to save memory /usr/local/lib/python3.7/dist-packages/torch/nn/functional.py:3613: UserWarning: Default upsampling behavior when mode=bilinear is changed to align_corners=False since 0.4.0. Please specify align_corners=True if the old behavior is desired. See the documentation of nn.Upsample for details. "See the documentation of nn.Upsample for details.".format(mode)

RuntimeError Traceback (most recent call last) in () 104 settings = clipit.apply_settings() 105 clipit.do_init(settings) --> 106 clipit.do_run(settings)

5 frames /content/clipit/clipit.py in forward(self, input, spot) 338 batch2, transforms2 = self.augs_wide(torch.cat(cutouts[self.cutn_zoom:], dim=0)) 339 # print(batch1.shape, batch2.shape) --> 340 batch = torch.cat([batch1, batch2]) 341 # print(batch.shape) 342 self.transforms = torch.cat([transforms1, transforms2])

RuntimeError: Sizes of tensors must match except in dimension 3. Got 224 and 398 (The offending index is 0)`

Basically, I've added two things:

1. I've tried to make enforce_smoothness to be more soft. Originally, this loss was a linear function of the local contrast, so a higher difference between neighbor pixels means a bigger loss. This leads to pale results. Now it's logarithmic, so it penalize the dithering as before but should be less brutal with sharp edges. The changes are minor, however.
2. I've added another enforce_saturation loss, it based on the old "percepted colourfulness" heuristic from Hasler and Süsstrunk’s 2003 paper https://www.researchgate.net/publication/243135534_Measuring_Colourfulness_in_Natural_Images

Dear @pixray

I would like to set up a "pixray" account to be associated with this software. You registered the account several years ago but don't seem to be using it. Please let us know if you might be interested in transferring the account to us so that we could setup a github organization with this same name.

213         if return_transform is not None:
    214             raise ValueError(
--> 215                 "`return_transform` is deprecated. Please access the transformation matrix with "
    216                 "`.transform_matrix`. For chained matrices, please use `AugmentationSequential`."
    217             )

ValueError: `return_transform` is deprecated. Please access the transformation matrix with `.transform_matrix`. For chained matrices, please use `AugmentationSequential`.

KeyError Traceback (most recent call last) in () 69 # pixray.add_settings(iterations=500, display_every=50) 70 ---> 71 settings = pixray.apply_settings() 72 pixray.do_init(settings) 73 pixray.do_run(settings)

/content/pixray/pixray.py in apply_settings() 1567 1568 vq_parser = setup_parser(vq_parser) -> 1569 class_table[settings_core.drawer].add_settings(vq_parser) 1570 1571 if len(global_pixray_settings) > 0:

KeyError: 'pixel'

The pictures from this git in google colab are very beautiful. U've written, that this was a fork of a VQGAN+CLIP. I want to use it on Linux. However, VQGAN+CLIP(https://github.com/nerdyrodent/VQGAN-CLIP) with the same sid, pretrained LPIPS, checkpoints(.ckpt) and optimising(Adam) gives me bad picture. Why? Both projects use CLIP and taming-transformers. What makes picture of your clipit more beautiful. How to import your clipit to Linux or what to change in VQGAN+CLIP to get so nice results? Your clipit(sid 15075320329395737548, 'space ship'): VQGAN+CLIP for linux(the same sid, the same prompt):

I'm attempting to run this in PyCharm. I am getting the error FileNotFoundError: [Errno 2] No such file or directory: 'wget'. It looks to be coming from output = subprocess.check_output(['wget', '-O', out, url]) from the vqgan.py file. I installed wget via pip, but it is still throwing the error. Anyone know why this error may be showing up?

Messing with pixray and during the run I get `--------------------------------------------------------------------------- AttributeError Traceback (most recent call last) in () 26 pixray.do_init(settings) 27 ---> 28 pixray.do_run(settings) 29 30 shutil.copyfile(f"/content/output.png", f"{OUTPUT_DIR}/{text}_{seed}.png")

11 frames /usr/local/lib/python3.7/dist-packages/torch/nn/modules/module.py in getattr(self, name) 1129 return modules[name] 1130 raise AttributeError("'{}' object has no attribute '{}'".format( -> 1131 type(self).name, name)) 1132 1133 def setattr(self, name: str, value: Union[Tensor, 'Module']) -> None:

AttributeError: 'MyRandomPerspective' object has no attribute 'resample'`

Is this due to a simple parameter?