Vincent van Gogh

We apply archetypal analysis to a set of 1154 artworks by Vincent van Gogh obtained from WikiArt. Since this collection is much smaller than the full GanGogh collection, we choose \(k=32\) archetypes.

Archetype Visualizations

The figures below show all 32 archetypes.

/images/neurips18/van_gogh/archetypes/wikiart_512_cov01234_gram_appendmean_triul_svd_full_std_4K_dimnorm_samplenorm_p32_split_00_04.jpg/images/neurips18/van_gogh/archetypes/wikiart_512_cov01234_gram_appendmean_triul_svd_full_std_4K_dimnorm_samplenorm_p32_split_04_08.jpg/images/neurips18/van_gogh/archetypes/wikiart_512_cov01234_gram_appendmean_triul_svd_full_std_4K_dimnorm_samplenorm_p32_split_08_12.jpg/images/neurips18/van_gogh/archetypes/wikiart_512_cov01234_gram_appendmean_triul_svd_full_std_4K_dimnorm_samplenorm_p32_split_12_16.jpg/images/neurips18/van_gogh/archetypes/wikiart_512_cov01234_gram_appendmean_triul_svd_full_std_4K_dimnorm_samplenorm_p32_split_16_20.jpg/images/neurips18/van_gogh/archetypes/wikiart_512_cov01234_gram_appendmean_triul_svd_full_std_4K_dimnorm_samplenorm_p32_split_20_24.jpg/images/neurips18/van_gogh/archetypes/wikiart_512_cov01234_gram_appendmean_triul_svd_full_std_4K_dimnorm_samplenorm_p32_split_24_28.jpg/images/neurips18/van_gogh/archetypes/wikiart_512_cov01234_gram_appendmean_triul_svd_full_std_4K_dimnorm_samplenorm_p32_split_28_32.jpg

Style Enhancement

We enhance the strongest (left side) and second strongest (right side) found in the image relative to the rest of the decomposition.

/images/neurips18/van_gogh/linear_enhancement/enhance_strongest_0930.jpg/images/neurips18/van_gogh/linear_enhancement/enhance_strongest_0975.jpg/images/neurips18/van_gogh/linear_enhancement/enhance_strongest_0870.jpg/images/neurips18/van_gogh/linear_enhancement/enhance_strongest_0860.jpg/images/neurips18/van_gogh/linear_enhancement/enhance_strongest_0285.jpg/images/neurips18/van_gogh/linear_enhancement/enhance_strongest_0495.jpg/images/neurips18/van_gogh/linear_enhancement/enhance_strongest_0640.jpg

Free Style Manipulation

Interpolations between two archetypes on a grid. The archetypes are freely chosen, they are not necessarily present in the image decompositions before stylization. Indeed, this is perfectly possible to apply to natural photographs, as shown below. For each image, we vary \(\gamma\delta\) from 0 (middle) to 0.7 (inner 8 panels) to 0.9 (outer panels).

/images/neurips18/van_gogh/grids/freestyle_620.jpg/images/neurips18/van_gogh/grids/freestyle_avatar.jpg/images/neurips18/van_gogh/grids/freestyle_665.jpg

Image Decompositions

Archetypal analysis allows to decompose an image into its contributing styles. Below are some examples of these decompositions. The contributions of the archetypal styles are visualized in three ways:

  • as a texture synthesized using the archetypal style (left column)
  • as stylization of the image in questions, using a unit vector for each contributing style (top row)
  • as a sum of the (strongest three) contributing images
/images/neurips18/van_gogh/image_decomps/decomp_0800.jpg/images/neurips18/van_gogh/image_decomps/decomp_0440.jpg/images/neurips18/van_gogh/image_decomps/decomp_1120.jpg/images/neurips18/van_gogh/image_decomps/decomp_0880.jpg/images/neurips18/van_gogh/image_decomps/decomp_0850.jpg/images/neurips18/van_gogh/image_decomps/decomp_0285.jpg