1.Website

The Grid CMS

It chooses templates and content-presentation styles, and it retouches and crops photos — all by itself. Moreover, the system runs A/B tests to choose the most suitable pattern.

Wix Advanced Design Intelligence

Looks similar to The Grid’s semi-automated way of enabling non-professionals to create a website. Wix teaches the algorithm by feeding it many examples of high-quality modern websites. Moreover, it tries to make style suggestions relevant to the client’s industry.

Firedrop

The idea is similar to The Grid with the addition of a conversational UI assistant. You provide the content, then it helps you to create a layout and choose a visual style. Bookmark, Huula, and many other tools implement similar ideas.

pix2code

UIzard experimental tool generates HTML or native mobile code from a UI screenshot with over 77% of accuracy. Here's the next iteration of the idea by Emil Wallner.

uKit AI

It analyzes an existing website and rebuilds in on its own technology with a proposed new design. It's a good way for SMBs who are not designers to make their websites better. More about it.

Artificial Intelligence and the Future of Web Design

Fred O'Brien describes the current state of algorithm-driven website constructors. He interviewed many of their creators.

2.Page

Flipboard Duplo

An automated magazine layout system. A script parses an article. Then, depending on the article’s content (the number of paragraphs and words in each, the number of photos and their formats, the presence of inserts with quotes and tables, etc.), the script chooses the most suitable pattern to present this part of the article.

Vox.com

A home page generator using similar ideas. The algorithm finds every possible layout that is valid, combining different examples from a pattern library.

Next, each layout is examined and scored based on certain traits. Finally, the generator selects the “best” layout — basically, the one with the highest score.

DesignScape

An experiment by Adobe and University of Toronto. The tool automatically refines a design layout for you. It can also propose an entirely new composition. Similar ideas can be found in Sketchplore, MS PowerPoint, and Google Slides.

Airbnb: Sketching Interfaces

It analyzes rough hand-drawn sketches with machine learning and builds a screen using unified components. The fastest way from a rough idea to a working prototype. Uizard and Microsoft have a similar concepts, while TeleportHQ turns it into a code. A simpler Sketch plugin.

Visual Importance

It predicts how user's attention distributes on a screen or a graphic design composition, so designers can direct it to important areas. It couldn't replace a proper eye tracking study, but it's a good predictor for its results.

UI Bot

The best example of an algorithm-driven design tool applied to UIs by Janne Aukia. It generates stylistic variations of a dashboard and even tries layout changes.

3. Component

Rene by Jon Gold

An experimental tool Rene by Jon Gold, who worked at The Grid, is an example of this approach in action. Gold taught a computer to make meaningful typographic decisions (part 2). Gold thinks that it’s not far from how human designers are taught, so he broke this learning process into several steps:

  1. Analyze glyphs to understand similarities in typefaces.
  2. Formulate basic guidelines for combining typefaces.
  3. Identify the best examples of type combinations to understand trends.
  4. Create algorithms to observe how great designers work.

Interpolation by Florian Schulz

He shows how you can use the idea of interpolation to create many states of components.

Brandmark

Algorithm-Driven Design enthusiast Jack Qiao launched an all-in-one tool which lets you to design a logo, simple brand identity, and a UI kit in with that visual style in code. He describes how logo and font generator works. Check logo comparison and crunch tools too. Automagic Design does the same.

BillUI Sketch Plugin

Simon Takman used Jon Gold ideas to generate multiple variations of a UI component. It alters corner radius, color, border, and shadow.

Components AI

Another ex-member of The Grid team launched an experimental tool that generates design system tokens. See his other experiment.

1. Thumbnails / Posters / Mockups

Netflix

A script crops movie characters for posters, then applies a stylized and localized movie title, then runs automatic experiments on a subset of users. Real magic! A new version started to personalize a poster image for different users (i.e., to show a particular actor or just a mood).

Yandex Market (in Russian)

A promotional image generator for e-commerce product lists. A marketer fills a simple form with a title and an image, and then the generator proposes an endless number of variations, all of which conform to design guidelines.

Nutella Unica

The algorithm pulled from a database of dozens of patterns and colours to create seven million different versions of Nutella's graphic identity, which have been splashed across the front of jars in Italy.

Alibaba LuBan

One-click intelligent design image generation, intelligent layout, size expansion, color expansion, and other design services. Users can generate multiple sets of design solutions that meet the requirements in real time by simply inputting the desired style and size. More about it.

Bloma

A generative design tool from Creative.ai team. It allows you to create posters, ads, and other graphic design work. The tool explores, curates, and refines design variations for you.

2. Copywriting

Engadget

An editor has nurtured a robot apprentice to write simple news articles about new gadgets. Whew!

Assisted Writing

Samim Winiger tries to re-imagine word-processing software. It explores new forms of writing, that allow authors to shift their focus from creation to curation, and write more joyfully.

Tagliner

Russell Davies made an experimental project that generates corporate taglines. In another project Janelle Shane generated craft beer names.

MS Word Resume Assistant

The add-on analyzes LinkedIn to show relevant CV examples, identify top skills, customize a resume based on real job postings, and get additional help.

Alibaba AI Copywriting Tool

An AI-enabled Chinese language copywriting tool that it says passed the Turing test and can produce 20,000 lines of copy a second.

InspiroBot

A generator of cliched inspirational quotes.

3. Imagery: Photos, Icons, Illustrations, Patterns

DALL-E 2

The tool creates realistic photos and illustrations from a text description based on GPT-3. It started simple, but then became one of the hottest movements. There are several similar tools like Midjourney, Stable Diffusion, Disco Diffusion, etc..

Prisma

Neural network-based app that stylizes photos to look like works of famous artists. This one makes a classic portrait while Google Stadia does the same for games.

Google AutoDraw

An experimental projects turns sketches into icons. It can help non-designers to use quality icons in their mockups. Researches turned it other way around — algorithms makes human-like sketches.

Sketch Confetti

A plugin generates modern confetti patterns that fit into existing screen mockup.

Photorealistic Facial Expression Synthesis

Yuqian Zhou & Bertram Emil Shi generated various facial expressions from a single photo. It's a complex problem because we still need to identify a user in these states.

Microsoft AI Drawing Bot

This bot generates images from caption-like text descriptions. It can be everything from ordinary pastoral scenes, such as grazing livestock, to the absurd, such as a floating double-decker bus.

Guardian Headliner

An experiment with BERG design studio to highlight eyes in a photo to emphasize emotion.

Artisto

The app can process video through neural networks (even streaming video).

“Reverse Prisma”

Researchers from UC Berkeley converts impressionist paintings into a more realistic photo style.

Vincent

Cambridge Consultants made a tool for illustrators that transforms rough sketches into a painting from Van Gogh, Cézanne, or Picasso.

Google Storyboard

The mobile app transforms videos into single-page comic layouts. It automatically selects interesting video frames, lays them out, and applies one of six visual styles.

Google Maps

The product team added buildings and areas of interest even for smallest cities using satellite and street views photos. Their 3D models are so detailed that you can sometimes see the blades inside the rooftop fans. Looks like Apple does it manually.

Perception Engines

An algorithm by Tom White draws abstract illustrations of real world objects. It's trained on photos and the result is close to usable in real products. It's a part of Google Artists and Machine Learning initiative (read its blog).

Generating custom photo-realistic faces using AI

An experimental tool by Shaobo Guan generates realistic photos of people. You can alter gender, age, race, and some facial details. StyleGAN from Nvidia is one of many similar tools. There's even "Hot or Not"!

This Person Doesn't Exist Sketch Plugin

Stas Kulesh made a plugin that puts AI-generated faces into design mockups. It's a great application of a popular idea. Here's also a website (see similar websites for cats and rentals).

4. Basics: Typography, Color

Variable Fonts

Parametric typography based on the idea of interpolation from several key variables: weight, width, and optical size. In 2016 it became a part of OpenType format specification. Previously, it was only possible to use variable fonts on the web through hacks or via desktop tools like Robofont.

Fontjoy

A tool that helps you to pair fonts using font vectors. Here's another usage of this idea from Kevin Ho who built a Font Map.

Background-Aware Color

A script that changes text color according to the background color.

Yandex Launcher

This Android launcher uses an algorithm to automatically set up colors for app cards, based on app icons.

Huula Typesetter

Huula website constructor did several experiments with auto-suggesting font sizes and page colors. See also CSSToucan.

Adobe Fontphoria

Another Sensei experiment turns any letter image into a glyph, then creates a complete alphabet and font out of it. It can also apply the result to a physical object via augmented reality.

5. Animation

Microsoft Animation Autocomplete

An experimental tool for autocompleting illustrations and animations. Shadow Draw is a similar concept.

Photo Wake-Up

An experimental tool can animate a character from a photo. They can walk out, run, sit, or jump in 3D. See also an experiment from Samsung that makes photos talk.

1. Content

Anticipatory Design

It takes a broader view of UX personalization and anticipation of user wishes. We already have these types of things on our phones: Google Now and Siri automatically propose a way home from work using location history data However, the key factor here is trust. To execute anticipatory experiences, people have to give large companies permission to gather personal usage data in the

Airbnb Smart Pricing

The team learned how to answer the question, “What will the booked price of a listing be on any given day in the future?” so that its hosts could set competitive prices.

Giles Colborne on AI

Advice to designers about how to continue being useful in this new era and how to use various data sources to build and teach algorithms. The only element of classic UX design in Spotify’s Discover Weekly feature is the track list, whereas the distinctive work is done by a recommendation system that fills this design template with valuable music.

Persado

An algorithm that deploys individualized phrases based on what kinds of emotional pleas work best on you. They also experiment with UI.

2. Layout

Mutative Design

A well-though-out model of adaptive interfaces that considers many variables to fit particular users by Liam Spradlin. Here's another application of this idea by researchers from Aalto & Kochi Universities.

1. Branding & Identity Elements

Logojoy

A product to replace freelancers for a simple logo design. You choose favorite styles, pick a color and voila, Logojoy generates endless ideas. You can refine a particular logo, see an example of a corporate style based on it, and order a branding package with business cards, envelopes, etc. It’s the perfect example of an algorithm-driven design tool in the real world! Dawson Whitfield, the founder, described machine learning principles behind it. Logoshuffle and My Brand New Logo are similar tools.

Generative Branding: Oi

Wolff Olins presented a live identity for Brazilian telecom Oi, which reacts to sound. You just can’t create crazy stuff like this without some creative collaboration with algorithms.

2. Photo & Video Editing

Photoshop Content-Aware Crop

2016 release of Photoshop has a content-aware feature that intelligently fills in the gaps when you use the cropping tool to rotate an image or expand the canvas beyond the image’s original size.

Shutterstock Composition-aware Search

You can specify keywords and arrange them on a frame to find a photo like that.

Photoshop Scene Stitch

Photoshop added another content-aware feature — it replaces a whole part of a photo with a relevant piece from Adobe Stock collection. No need for intense retouching anymore. Another experiment is Project Cloak which replaces objects on videos. See more MAX 2017 announces based on Adobe Sensei platform (Puppetron and PhysicsPak are the best).

Perfect Mum

Happy Finish design studio used GAN's to generate an AI brand ambassador for the Dove Baby brand in the UK but training an AI to mimic the traits that UK media associates with mothers to show how artificial that persona is.

Fast Mask

Another Sensei experiment that selects and tracks an object in a video. I.e. you can put a text behind a dancer. See more MAX 2018 announces (Smooth Operator and Good Bones are the best).

AI Imaging Technique Reconstructs Photos with Realistic Results

Researchers from NVIDIA introduced a deep learning method that can edit images or reconstruct a corrupted image, one that has holes or is missing pixels.

GANPaint Studio

The tool draws with semantic brushes that produce or remove units such as trees, brick-texture, or domes.

3. From Sketch to Object

Stylit

An experimental tool that creates a 3D model out of sketch.

Nvidia GauGAN

The software will instantly turn a couple of lines into a gorgeous mountaintop sunset. This is MS Paint for the AI age. More about it.

4. Generative Design & Art

Generative Visual Manipulation on the Natural Image Manifold

It helps to refine fashion design. You can sketch changes to a bag or a shoe and see how it could look in a real product.

Randomatizm (in Russian)

An experimental website by Alexander Moskovskikh that generates suprematizm-like artworks.

Drawing Operations Unit: Generation 2

Sougwen Chung creates collaborative art with her robot. It learns from her style of drawing, turning her practice of art-making into a real-time duet.

Ganbreeder

A collaborative generative art tool where users remix each others images. You can trace history of each image.

5. Platforms

Adobe Sensei

A smart platform that uses Adobe’s deep expertise in AI and machine learning, and it will be the foundation for future algorithm-driven design features in Adobe’s consumer and enterprise products: semantic image segmentation, font recognition, and intelligent audience segmentation. Scott Prevost sees 3 ways to apply it to designers workflow.

1. Industrial Design & Architecture

Autodesk Dreamcatcher

A tool based on the idea of generative design:

1. An algorithm generates many variations of a design using predefined rules and patterns.
2. The results are filtered based on design quality and task requirements.
3. Designers choose the most interesting and adequate variations, polishing them if needed.

It made a lot of noise and prompted several publications from UX gurus. Autodesk built a new Toronto office using these ideas.

Parametric Design

Zaha Hadid Architects bureau uses this term to define their generative approach to architecture.

Alfa Romeo Pandion

Bertone automobile company made an Alfa Romeo concept car using algorithmic design. The concept, taken from the world of mathematics, indicates an organic alternative to traditional design and is the "propagation of random forms".

Who Is Winning the 3D Printing Battle in Footwear & Why?

A review of high-tech shoe initiatives by Nike, adidas, New Balance, and Under Armour.

The incredible inventions of intuitive AI

A terrific talk by Maurice Conti at TEDx about algorithms in industrial design, architecture, and wicked problem solving.

2. Entertainment: Games, Movies, Music, TV

No Man's Sky

Nearly all elements of the game are procedurally generated, including star systems, planets and their ecosystems, flora, fauna and their behavioural patterns, artificial structures, and alien factions and their spacecraft.

Cognitive Movie Trailer

IBM Watson helped 20th Century Fox to create en engaging movie trailer. Looks like they're using this experiment at scale now.

Is the future of music artificial?

Flow Machines computer scientists unveiled the first song to be composed by artificial intelligence, the Beatles-esque "Daddy’s Car". See also how Nao Tokui added background noise to Google Street View scenes.

Computational Video Editing

It automatically selects the most appropriate clip from one of the input takes, for each line of dialogue, based on a user-specified set of film-editing idioms. A final cut is a good draft for an editor.

Lyrebird

It allows you to create a digital voice that sounds like you with only one minute of audio.

Chinese news agency adds AI anchors to its broadcast team

They have the likeness of some of Xinhua's human anchors, but their voices, facial expressions and mouth movements are synthesized and animated using deep learning techniques.

Nvidia AI City

A driving simulator that allows you to pilot a car through a city, from its buildings to its streets to its cars, is being created in real time by AI.

3. Art

AI-Curated Exhibition

Tate Modern and Microsoft collaborated on an exhibition where a machine learning algorithm selected artworks from museum's collection. Philipp Shmitt did a similar experiment with a photo album.

AI will be the art movement of the 21st century

Rama Allen says that human/AI collaboration is an aesthetic dialogue similar to that employed with improvisational jazz. It's a great thinking on what modern art could be.

1. Machine Learning & AI for Designers

Machine Learning for Designers

O’Reilly published a great mini-book by Patrick Hebron with machine learning basics and design examples. He also has a great vision about new design tools.

A Visual Introduction to Machine Learning

A great visual overview of machine learning basics by Stephanie Yee and Tony Chu.

Experience Design in the Machine Learning Era

A terrific article by Fabien Girardin. He shows how designers can work together with big data analysts to benefit from machine learning.

Artificial intelligence and the future of design

Jon Bruner gives a good example: A genetic algorithm starts with a fundamental description of the desired outcome — say, an airline’s timetable that is optimized for fuel savings and passenger convenience.

Human-Centered Machine Learning

A fantastic overview of design process for products that use machine learning from Josh Lovejoy and Jess Holbrook. Here's a case study that applies these principles to Google Clips camera.

Google PAIR

People+AI research initiative. How might we make it easier for engineers to build and understand machine learning systems? How can AI aid and augment professionals in their jobs? Can design thinking open up new applications for AI?

Applications Of Machine Learning For Designers

Lassi Liikkanen shows 3 key applications: detection, prediction, and generation.

Designing the User Experience of Machine Learning Systems

Lots of interesting papers from Association for the Advancement of Artificial Intelligence Spring 2017 Symposium. Look at the one by Janin Koch about Collaborating with AI.

The Best Machine Learning Courses

Class Central analyzed online courses on machine learning and selected the best.

Machine Learning for Creativity and Design

This one-day workshop explores several issues in the domain of generative models for creativity and design. 32 papers were published.

Can Users Control and Understand a UI Driven by Machine Learning?

In a study of people interacting with systems built on machine-learning algorithms, users had weak mental models and difficulties making the UI do what they want.

Microsoft Guidelines for Human-AI Interaction (PDF)

These 18 guidelines can help you design AI systems and features that are more human-centered. How to use them in a creative process.

AI is Your New Design Material

A talk by Josh Clark on using machine-generated content, insight, and interaction as design material in your everyday work.

2. Ethics

There is no difference between computer art and human art

Oliver Roeder says that “computer art” isn’t any more provocative than “paint art” or “piano art.” The algorithmic software is written by humans, after all, using theories thought up by humans, using a computer built by humans, using specifications written by humans, using materials gathered by humans, in a company staffed by humans, using tools built by humans, and so on. Computer art is human art — a subset, rather than a distinction.Robert Hart looks for legal precedents.

Where machines could replace humans — and where they can’t (yet)

McKinsey analyzed 800 jobs to find how easily they can be automated. Lots of interesting insights. Here's a website to check your job.

Design Machines

Travis Gertz shows that many websites already look the same. It happened before algorithms even for professional design agencies. The article is incredibly insightful if you want to understand the reasons of this homogenisation.

AI and the future of design: Will machines take your job?

A good article series by Rob Girling from Artefact. He looks at skills that can be automated and tries to predict the future of design as s profession.

Automation of Design: History

Lukasz Lysakowski digs through a history of design automation from book printing to modern days.

The State Of Advanced Website Builders

Drew Thomas tries to find a niche for design agencies in the world of cheap websites built by advanced online builders.

In a few years, no investors are going to be looking for AI startups

Frank Chen thinks that investors will stop looking for AI-powered startups in exactly the same way they don’t look for database-inside or cloud-native or mobile-first startups anymore. All those things are just assumed. See an e-book about AI market.

In the AI Age, “Being Smart” Will Mean Something Completely Different

Ed Hess says that the new smart will be determined not by what or how you know but by the quality of your thinking, listening, relating, collaborating, and learning.

How to recognize exclusion in AI

Microsoft inclusive design team defined five biases for AI: dataset, association, automation, interaction, and confirmation.

AI is Killing Our Grasp on Reality

Sandra Upson writes about a new way to produce audio, video, or text that resembles the real world. It could lead to fake reviews and even events.

Awful AI

David Dao made a curated list to track current scary usages of AI — hoping to raise awareness to its misuses in society.

Adobe is using AI to catch Photoshopped images

The AI looks for three types of manipulation: cloning, splicing and removal. See also their new research and a checklist by Kyle McDonald.

Everyday Ethics of AI

IBM designers created a practical guide for designers & developers for building and using AI systems.

AI is bringing out the art world’s worst instincts

AI is like photography in the 19th century–struggling to be accepted as its own art form. Aaron Hertzmann discusses tricky situations in art world.

The Real Story Behind Microsoft’s Quietly Brilliant AI Design

The company studied personal assistants — human ones — to understand how to make a great machine assistant for PowerPoint Designer feature (it makes good slide design for users).

AI UX: 7 Principles of Designing Good AI Products

Dávid Pásztor aims to create useful, easy-to-understand products in order to bring clarity to this shady new world of machine learning. Most importantly, we want to use the power of AI to make people’s lives easier and more joyful.

Untold AI

Christopher Noessel analyzed sci-fi movies to understand how they portray AI. He published a comparison table.