How to Draw Pictures: Suggestive Contours

Computational Models of Representational Art, Part 2

In the first part of this series, I described Contours, which are the fundamental building blocks of line drawing. Now I will describe an important extension to them, and discuss what these theories tell us about how humans draw lines.

Abstracted shading

Here’s a different interpretation of contours, this time based on shading. This shading interpretation is a little more subtle, but leads to important insights.

We start with a 3D model. In this example, I’ll start with a 3D model of a cow. Let’s paint the cow with matte white paint, and place it in a white room. We’ll photograph it with no lighting other than a headlamp sitting atop the camera. We take a picture with the camera, and it looks like this:

Matte rendering of a cow, lit from the camera position. In computer graphics terminology, this is a white surface rendered with Lambertian shading, without non-local effects like interreflections or cast shadows. (Image created by Pierre Bénard using qrtsc.)

The pixels in this image range from white to gray to black. If the draw lines through just the completely black pixels in this image, we get the contours:

Contour curves on the cow, without any stylization. (Image created by Pierre Bénard using qrtsc.)

If we draw lines through not just the black pixels but also the darkest regions of this image, then we get this drawing:

Contour and Suggestive Contour curves on the cow, without any stylization. (Image created by Pierre Bénard using qrtsc.)

This image includes both the contours, and a new set of curves called the suggestive contours. The suggestive contours were first introduced in a beautiful paper that analyzed their mathematical and geometric properties in considerable depth. Several other methods were developed based on the idea of line drawing as abstracted shading, for example:

Real-time abstracted shading rendering of 3D models, from a 2007 paper by Lee et al.

This idea of making drawings by approximating a shaded rendering with strokes can also be extended to determine stroke thickness, for example:

Rendering with contours and suggestive contours, and stroke thickness based on shading (from our 2007 paper on stroke thickness).

Evaluation

The above explanation of line drawings is a very simple, compact theory of line drawings. How well does it really predict real line drawings?

As one way to demonstrate the effectiveness of these algorithms, my former student Todd Goodwin began with the following drawings of a beetle, from a textbook on technical illustration:

Hand-drawn technical illustrations of a beetle

He then created 3D a models based on the first illustration, and rendered it with a line drawing algorithm based on the principles above. Here’s his 3D dung beetle and line drawing rendering:

3D model, created by Todd Goodwin, and a line rendering of the model. Note that the line drawing looks very similar to hand-made illustration, with similar locations for strokes and variations in stroke thickness.

Amazingly, the line drawings look mostly identical! And he was able to do it a second time, this time using a panel from a comic book:

Left: A panel from the Bone comic. Right: 3D model, based on this panel, constructed by Todd Goodwin, and a line rendering of the model. Strokes appear with the same thicknesses and in the same places as in the original drawing.

He could even animate the model. This demonstrates how a simple theory can capture the complex effects in these illustrations.

Scientific evaluation

In this study, artists were asked to make line drawings of 3D models.

A much more rigorous study was conducted by Forrester Cole and his collaborators. They asked 29 artists to create line drawings from 3D renderings. They found that the lines that artists drew agreed with the predictions of existing line drawing algorithms most of the time. Specifically, image shading gradients were the most reliable predictor of artists’ drawings, since these objects had more complex shading than the model I described above. The shading gradients basically correspond to the curves described above. The cases where they disagreed were subtle, for example, the artists omitted curves that could be inferred by understanding the overall shape of the rest of the object.

Conclusion

As outlined here, the theory of contours and suggestive contours is a simple and compact theory that explains a lot of the way that we draw lines. Understanding this theory ought to be foundational for anyone that wishes to understand the basic mechanics of representational art.

In the final essay in this series, I’ll talk about how these basic foundations can be used to describe many different artistic styles.