AI Sketchbook

Date: 2019, Summer

Advisor: Damjan Jovanovic

This project is called AI sketchbook. It starts with  Unity and tweaks it for creating an initial design idea. Usually we think of computer aided technique a means to develop pre-existing human-based designs, not as generators of new form concepts in themselves.

But I argue that machine creativity gives us fresh, surprising and delightfully non-human ways to approach our world. With AI technologies that are now available, we can dramatically expand our formal repertoire with weird non-native design possibilities.

This is good because now more than ever we need new source of creativity to tackle the masses human and machines have co-created. We can all benefit from bringing all kinds of intelligent animal and machine, human and “artificial” to bear.

I’m working with a huge database of models which are trained in MeshCNN (a convolutional neural network designed specifically for meshes that is capable of analyzing, extracting and segmenting the qualitative features of models). From the perspective of a designer, the result of Mesh-CNN-training reveals specific geometries and spatial relationships inside each model. Based on this, the platform allows users to manipulate the model. In this way, the workflow retains some qualities of the original model while adding new qualities according to the users’ choice.  The workflow leverages the modeling properties of artificial neural networks to capture the designers' intuitive choices and incorporate these aesthetic decisions into precise form, while inherently incorporating its own different aesthetic sensibilities at the same time.

In order to apply the AI technique we have to use different platforms such as rhino, grasshopper, pycharm, tensorflow, blender, anaconda, etc, which make the process heavy, redundant, and difficult. So I try to coordinate the whole system and integrate different steps into a simple interface.

Segmentation Research

MeshCNN, Collapses Example and Segmentation Example

Segmentation Samples by AI Sketchbook

Step 1 : Select Models from Parts Market

Step 2 : Pick one Basic Model

Step 3 : Segment the Basic Model

Step 4 : Assemble the Models


Results after iterations