Some useful references relating to non-photorealistic rendering and AI in the context of art include the following articles, books, and web sites.
This list is by no means exhaustive. It merely reflects some of the texts I have used in my work.
Anjyo, K. (1999), ‘”Tour into the picture” as a non-photorealistic animation’, SIGGRAPH Comput. Graph. 33(1), 54–55.
Arfib, D.; Couturier, J. M.; Kessous, L. & Verfaille, V. (2002), ‘Strategies of Mapping Between Gesture Data and Synthesis Model Parameters Using Perceptual Spaces’, Org. Sound 7(2), 127–144.
Beyls, P. (1989), The musical universe of cellular automata, in ‘Proceedings of the International Computer Music Conference (ICMC 1989)’, pp. 34–41.
Blackwell, T. (2006), ‘Swarming and Music’, http://www.doc.gold.ac.uk/~mas01tb/papers/ Accessed 06.01.2013.
Boden, M. A. & Edmonds, E. A. (2009), ‘What is generative art ?’, Digital Creativity 20(1/2), 21 – 46.
Bourke, P. (1992), ‘Intersection of a Line and a Sphere (or circle) [Online]. Available at: portal.ku.edu.tr /~cbasdogan /Courses /Robotics /projects /IntersectionLineSphere.pdf Accessed 3.3.2014’.
Brazil, E. V.; Macкdo, I.; Sousa, M. C.; Velho, L. & de Figueiredo, L. H. (2010), A few good samples: shape & tone depiction for Hermite RBF implicits, in ‘Proceedings of the 8th International Symposium on Non-Photorealistic Animation and Rendering’, ACM, New York, NY, USA, pp. 7–15.
Canny, J. (1986), ‘A Computational Approach to Edge Detection’, IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698.
Chu, N.; Baxter, W.; Wei, L.-Y. & Govindaraju, N. (2010), Detail-preserving paint modeling for 3D brushes, in ‘Proceedings of the 8th International Symposium on Non-Photorealistic Animation and Rendering’, ACM, New York, NY, USA, pp. 27–34.
Collomosse, J. P. & Hall, P. M. (2005), ‘Salience-adaptive Painterly Rendering using Genetic Search’, Intl. Journal on Artificial Intelligence Tools (IJAIT) 14(4).
DeCarlo, D.; Finkelstein, A. & Rusinkiewicz, S. (2004), Interactive Rendering of Suggestive Contours with Temporal Coherence, in ‘Proceedings of the 3rd International Symposium on Non-photorealistic Animation and Rendering’, ACM, New York, NY, USA, pp. 15–145.
DeCarlo, D.; Finkelstein, A.; Rusinkiewicz, S. & Santella, A. (2003), ‘Suggestive Contours for Conveying Shape’, ACM Trans. Graph. 22(3), 848–855.
DeCarlo, D. & Santella, A. (2002), Stylization and abstraction of photographs, in ‘Proceedings of the 29th annual conference on Computer graphics and interactive techniques’, ACM, New York, NY, USA, pp. 769–776.
Foley, J. D.; Dam, A. V.; Feiner, S. K. & Hughes, J. F. (1995), Computer Graphics: Principles and Practice, Addison-Wesley.
Foley, J. D.; Dam, A. V.; Feiner, S. K.; Hughes, J. F. & Phillips, R. L. (1997), Introduction to Computer Graphics, Addison-Wesley.
Gamma, E.; Helm, R.; Johnson, R. & Vlissides, J. (1995), Design Patterns: Elements of Reusable Object-oriented Software, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA.
Gombrich, E. H. (1995), The Story of Art, Phaidon.
Gooch, A. A. (2010), Towards mapping the field of non-photorealistic rendering, in ‘Proceedings of the 8th International Symposium on Non-Photorealistic Animation and Rendering’, ACM, New York, NY, USA, pp. 159–164.
Gooch, A. A.; Long, J.; Ji, L.; Estey, A. & Gooch, B. S. (2010), Viewing progress in non-photorealistic rendering through Heinlein’s lens, in ‘Proceedings of the 8th International Symposium on Non-Photorealistic Animation and Rendering’, ACM, New York, NY, USA, pp. 165–171.
Glassner, A. Principles of Digital Image Synthesis. (San Francisco, CA, USA: Morgan Kaufmann Publishers Inc., 1994) http://www.realtimerendering.com/Principles_of_Digital_Image_Synthesis_v1.0.1.pdf
Greenberg, S. (1999), ‘Why non-photorealistic rendering?’, SIGGRAPH Comput. Graph. 33(1), 56–57.
Haeberli, P. (1990), Paint by numbers: abstract image representations, in ‘Proceedings of the 17th annual conference on Computer graphics and interactive techniques’, ACM, New York, NY, USA, pp. 207–214.
Hays, J. & Essa, I. (2004), Image and video based painterly animation, in ‘Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering’, ACM, New York, NY, USA, pp. 113–120.
Hertzmann, A. (2010), Non-Photorealistic Rendering and the science of art, in ‘Proceedings of the 8th International Symposium on Non-Photorealistic Animation and Rendering’, ACM, New York, NY, USA, pp. 147–157.
Hertzmann, A. (2003), ‘A survey of stroke-based rendering’, IEEE Computer Graphics and Applications 23(4), 70–81.
Hertzmann, A. (2003), Machine learning for computer graphics: a manifesto and tutorial, in ‘Proc. 11th Pacific Conf. Computer Graphics and Applications’, pp. 22–36.
Hertzmann, A. (2002), Fast paint texture, in ‘Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering’, ACM, New York, NY, USA, pp. 91–ff.
Hertzmann, A. (2001), Paint by relaxation, in ‘Proc. Computer Graphics Int 2001’, pp. 47–54.
Hertzmann, A. (1998), Painterly rendering with curved brush strokes of multiple sizes, in ‘Proceedings of the 25th annual conference on Computer graphics and interactive techniques’, ACM, New York, NY, USA, pp. 453–460.
Hertzmann, A.; Jacobs, C. E.; Oliver, N.; Curless, B. & Salesin, D. H. (2001), Image analogies, in ‘Proceedings of the 28th annual conference on Computer graphics and interactive techniques’, ACM, New York, NY, USA, pp. 327–340.
Hertzmann, A. & Perlin, K. (2000), Painterly rendering for video and interaction, in ‘Proceedings of the 1st international symposium on Non-photorealistic animation and rendering’, ACM, New York, NY, USA, pp. 7–12.
Hertzmann, A. & Seitz, S. M. (2005), ‘Example-based photometric stereo: shape reconstruction with general, varying BRDFs’, IEEE_J_PAMI 27(8), 1254–1264.
Hertzmann, A. & Seitz, S. M. (2003), Shape and materials by example: a photometric stereo approach, in ‘Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition’.
Hsu, S. C. & Lee, I. H. H. (1994), Drawing and Animation Using Skeletal Strokes, in ‘Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques’, ACM, New York, NY, USA, pp. 109–118.
Hsu, S. C.; Lee, I. H. H. & Wiseman, N. E. (1993), Skeletal Strokes, in ‘Proceedings of the 6th Annual ACM Symposium on User Interface Software and Technology’, ACM, New York, NY, USA, pp. 197–206.
ImageJ (), ‘[Online]. Available at: http://rsb.info.nih.gov/ij/index.html. Accessed on 01.01.2013’.
International Symposium on Non-Photorealistic Animation & Rendering (2014), ‘[Online]. Available at: expressive2014.richardt.name/NPAR/Home Accessed 3.3.2014’.
Jain, A. K.; Murty, M. N. & Flynn, P. J. (1999), ‘Data clustering: a review’, ACM Comput. Surv. 31(3), 264–323.
Jain, R.; Kasturi, R. & Schunck, B. G. (1995), Machine Vision, McGraw-Hill, Inc., New York, NY, USA.
Kalnins, R. D.; Davidson, P. L.; Markosian, L. & Finkelstein, A. (2003), ‘Coherent Stylized Silhouettes’, ACM Trans. Graph. 22(3), 856–861.
Kang, H.; Lee, S. & Chui, C. K. (2009), ‘Flow-Based Image Abstraction’, IEEE Transactions on Visualization and Computer Graphics 15(1), 62–76.
Kang, H.; Lee, S. & Chui, C. K. (2007), Coherent line drawing, in ‘Proceedings of the 5th international symposium on Non-photorealistic animation and rendering’, ACM, New York, NY, USA, pp. 43–50.
Krose, B. & van der Smagt, P. (1996), An Introduction to Neural Networks, University of Amsterdam.
Kyprianidis, J. E.; Collomosse, J.; Wang, T. & Isenberg, T. (2012), ‘State of the Art: A Taxonomy of Artistic Stylization Techniques for Images and Video’, IEEE Transactions on Visualization and Computer Graphics.
Kyprianidis, J. E. & Doellner, J. (2008), Image Abstraction by Structure Adaptive Filtering, in ‘ Proc. EG UK Theory and Practice of Computer Graphics ‘, pp. 51-58 .
Kyprianidis, J. E. & Kang, H. (2011), ‘Image and Video Abstraction by Coherence-Enhancing Filtering’, Computer Graphics Forum 30(2), 593–602.
Li, H. & Mould, D. (2011), Artistic tessellations by growing curves, in ‘Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering’, ACM, New York, NY, USA, pp. 125–134.
Lipscomb, S. D.Tan; Cohen; Lipscomb & Kendall, ed., (2013), Cross-modal alignment of accent structures in multimedia, Oxford University Press Oxford, pp. 192-213.
Litwinowicz, P. (1997), Processing images and video for an impressionist effect, in ‘Proceedings of the 24th annual conference on Computer graphics and interactive techniques’, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, pp. 407–414.
Litwinowicz, P. & Williams, L. (1994), Animating images with drawings, in ‘Proceedings of the 21st annual conference on Computer graphics and interactive techniques’, ACM, New York, NY, USA, pp. 409–412.
Mandryk, R. L.; Mould, D. & Li, H. (2011), Evaluation of emotional response to non-photorealistic images, in ‘Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering’, ACM, New York, NY, USA, pp. 7–16.
Mcilhagga, W. (2011), ‘The Canny Edge Detector Revisited’, Int. J. Comput. Vision 91(3), 251–261.
Meier, B. J. (1996), Painterly Rendering for Animation, in ‘Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques’, ACM, New York, NY, USA, pp. 477–484.
Miranda, E. R. & Todd, P. M. (2003), A-Life and Musical Composition: A Brief Survey, in ‘IN: PROCEEDINGS OF THE IX BRAZILIAN SYMPOSIUM ON COMPUTER MUSIC, CAMPINAS,(BRAZIL) (2003)’.
Moeslund, T. B. (2009), ‘Canny Edge Detection – Course notes’, Technical report, Aalborg University (AAU), Denmark.
Murray, N.; Skaff, S.; Marchesotti, L. & Perronnin, F. (2011), Towards automatic concept transfer, in ‘Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering’, ACM, New York, NY, USA, pp. 167–176.
Noris, G.; Sýkora, D.; Coros, S.; Whited, B.; Simmons, M.; Hornung, A.; Gross, M. & Sumner, R. W. (2011), Temporal noise control for sketchy animation, in ‘Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering’, ACM, New York, NY, USA, pp. 93–98.
Picarougne, F.; Azzag, H.; Venturini, G. & Guinot, C. (2007), ‘A New Approach of Data Clustering Using a Flock of Agents’, Evol. Comput. 15(3), 345–367.
Prusinkiewicz, P. & Lindenmayer, A. (1996), The Algorithmic Beauty of Plants, Springer-Verlag New York, Inc., New York, NY, USA.
Rangarajan, S. (), ‘Algorithms for Edge Detection’.
Reynolds, C. W. (2003), ‘”Stylized depiction in computer graphics.” [Online]. Available: http://www.red3d.com/cwr/npr/ Accessed 16.03.2014’.
Reynolds, C. W. (1987), Flocks, herds and schools: A distributed behavioral model, in ‘Proceedings of the 14th annual conference on Computer graphics and interactive techniques’, ACM, New York, NY, USA, pp. 25–34.
Rusinkiewicz, S.; Cole, F.; DeCarlo, D. & Finkelstein, A. (2008), Line drawings from 3D models, in ‘ACM SIGGRAPH 2008 classes’, ACM, New York, NY, USA, pp. 39:1–39:356.
Salisbury, M.; Anderson, C.; Lischinski, D. & Salesin, D. H. (1996), Scale-dependent Reproduction of Pen-and-ink Illustrations, in ‘Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques’, ACM, New York, NY, USA, pp. 461–468.
Salisbury, M. P.; Anderson, S. E.; Barzel, R. & Salesin, D. H. (1994), Interactive Pen-and-ink Illustration, in ‘Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques’, ACM, New York, NY, USA, pp. 101–108.
Schlechtweg, S. (2007), ‘”NPR literature.” [Online]. Available: http://isgwww.cs.uni-magdeburg.de/~stefans/npr/ Accessed 17.03.2014’.
Setayesh, M.; Zhang, M. & Johnston, M. (2011), Detection of continuous, smooth and thin edges in noisy images using constrained particle swarm optimisation, in ‘Proceedings of the 13th annual conference on Genetic and evolutionary computation’, ACM, New York, NY, USA, pp. 45–52.
Shiffman, D. (2014), ‘”Flocking” [Online]. Available at: http://processing.org/examples/flocking.html, accessed 27.01.2014’.
Sykora, D.; Ben-Chen, M.; Cadk, M.; Whited, B. & Simmons, M. (2011), TexToons: practical texture mapping for hand-drawn cartoon animations, in ‘Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering’, ACM, New York, NY, USA, pp. 75–84.
Szeliski, R. (2010), Computer Vision: Algorithms and Applications, Springer http://szeliski.org/Book/.
Tresset, P. & Leymarie, F. F. (2005), Generative Portrait Sketching, in ‘Proceedings of the 11th International Conference on Virtual Systems and MultiMedia’, pp. 739–748.
Vanderhaeghe, D.; Vergne, R.; Barla, P. & Baxter, W. (2011), Dynamic stylized shading primitives, in ‘Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering’, ACM, New York, NY, USA, pp. 99–104.
Winnemöller, H. (2014), ‘NPR in the Wild [Online] Available at http://holgerweb.net/PhD/Research/papers/nprwild-winnemoeller.pdf Last accessed 20/03/2014’.
Winnemöller, H. (2011), XDoG: advanced image stylization with eXtended Difference-of-Gaussians, in ‘Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering’, ACM, New York, NY, USA, pp. 147–156.
Winnemöller, H.; Kyprianidis, J. E. & Olsen, S. C. (2012), ‘XDoG: An eXtended difference-of-Gaussians Compendium Including Advanced Image Stylization’, Comput. Graph. 36(6), 740–753.
Winnemöller, H.; Olsen, S. C. & Gooch, B. (2006), ‘Real-time video abstraction’, ACM Trans. Graph. 25(3), 1221–1226.
Zeng, K.; Zhao, M.; Xiong, C. & Zhu, S.-C. (2009), ‘From image parsing to painterly rendering’, ACM Trans. Graph. 29(1), 2:1–2:11.
Zhao, M. & Zhu, S.-C. (2011), Portrait painting using active templates, in ‘Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering’, ACM, New York, NY, USA, pp. 117–124.
Zhao, M. & Zhu, S.-C. (2011), Customizing painterly rendering styles using stroke processes, in ‘Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering’, ACM, New York, NY, USA, pp. 137–146.
Zhao, M. & Zhu, S.-C. (2010), Sisley the abstract painter, in ‘Proceedings of the 8th International Symposium on Non-Photorealistic Animation and Rendering’, ACM, New York, NY, USA, pp. 99–107.
ZHOU, P.; YE, W.; XIA, Y. & WANG, Q. (2011), ‘An Improved Canny Algorithm for Edge Detection’, Journal of Computational Information Systems 7(5).