List of contents
Constructing a UI ■ Preparing Assets and Content ■ Personalizing UX ■ Graphic Design ■ Other Disciplines ■ More to Read
Publishing tools such as Webflow, Readymag and Squarespace have already simplified the author’s work — countless high-quality templates will give the author a pretty design without having to pay for a designer. There is an opportunity to make these templates smarter, so that the barrier to entry gets even lower.
Generated with opensourse script
The Grid CMS
It chooses templates and content-presentation styles, and it retouches and crops photos — all by itself. Moreover, the system runs A/B tests to choose the most suitable pattern.
Wix Advanced Design Intelligence
Looks similar to The Grid’s semi-automated way of enabling non-professionals to create a website. Wix teaches the algorithm by feeding it many examples of high-quality modern websites. Moreover, it tries to make style suggestions relevant to the client’s industry.
An automated magazine layout system. A script parses an article. Then, depending on the article’s content (the number of paragraphs and words in each, the number of photos and their formats, the presence of inserts with quotes and tables, etc.), the script chooses the most suitable pattern to present this part of the article.
A home page generator using similar ideas. The algorithm finds every possible layout that is valid, combining different examples from a pattern library.
Next, each layout is examined and scored based on certain traits. Finally, the generator selects the “best” layout — basically, the one with the highest score.
Airbnb: Sketching Interfaces
It predicts how user's attention distributes on a screen or a graphic design composition, so designers can direct it to important areas. It couldn't replace a proper eye tracking study, but it's a good predictor for its results.
Rene by Jon Gold
An experimental tool Rene by Jon Gold, who worked at The Grid, is an example of this approach in action. Gold taught a computer to make meaningful typographic decisions (part 2). Gold thinks that it’s not far from how human designers are taught, so he broke this learning process into several steps:
Interpolation by Florian Schulz
He shows how you can use the idea of interpolation to create many states of components.
Algorithm-Driven Design enthusiast Jack Qiao launched an all-in-one tool which lets you to design a logo, simple brand identity, and a UI kit in with that visual style in code. He describes how logo and font generator works. Check logo comparison and crunch tools too. Automagic Design does the same.
BillUI Sketch Plugin
Simon Takman used Jon Gold ideas to generate multiple variations of a UI component. It alters corner radius, color, border, and shadow.
Creating cookie-cutter graphic assets in many variations is one of the most boring parts of a designer’s work. It takes so much time and is demotivating, when designers could be spending this time on more valuable product work.
Generated with opensourse script
A script crops movie characters for posters, then applies a stylized and localized movie title, then runs automatic experiments on a subset of users. Real magic! A new version started to personalize a poster image for different users (i.e., to show a particular actor or just a mood).
Yandex Market (in Russian)
A promotional image generator for e-commerce product lists. A marketer fills a simple form with a title and an image, and then the generator proposes an endless number of variations, all of which conform to design guidelines.
The algorithm pulled from a database of dozens of patterns and colours to create seven million different versions of Nutella's graphic identity, which have been splashed across the front of jars in Italy.
An editor has nurtured a robot apprentice to write simple news articles about new gadgets. Whew!
Samim Winiger tries to re-imagine word-processing software. It explores new forms of writing, that allow authors to shift their focus from creation to curation, and write more joyfully.
MS Word Resume Assistant
The add-on analyzes LinkedIn to show relevant CV examples, identify top skills, customize a resume based on real job postings, and get additional help.
Alibaba AI Copywriting Tool
An AI-enabled Chinese language copywriting tool that it says passed the Turing test and can produce 20,000 lines of copy a second.
Photorealistic Facial Expression Synthesis
Yuqian Zhou & Bertram Emil Shi generated various facial expressions from a single photo. It's a complex problem because we still need to identify a user in these states.
Microsoft AI Drawing Bot
This bot generates images from caption-like text descriptions. It can be everything from ordinary pastoral scenes, such as grazing livestock, to the absurd, such as a floating double-decker bus.
An experiment with BERG design studio to highlight eyes in a photo to emphasize emotion.
Researchers from UC Berkeley converts impressionist paintings into a more realistic photo style.
Cambridge Consultants made a tool for illustrators that transforms rough sketches into a painting from Van Gogh, Cézanne, or Picasso.
The mobile app transforms videos into single-page comic layouts. It automatically selects interesting video frames, lays them out, and applies one of six visual styles.
This Android launcher uses an algorithm to automatically set up colors for app cards, based on app icons.
Another Sensei experiment turns any letter image into a glyph, then creates a complete alphabet and font out of it. It can also apply the result to a physical object via augmented reality.
One way to get a clear and well-developed strategy is to personalize a product for a narrow audience segment or even specific users. We see it every day in Facebook newsfeeds, Google search results, Netflix and Spotify recommendations, and many other products. Besides the fact that it relieves the burden of filtering information from users, the users’ connection to the brand becomes more emotional when the product seems to care so much about them.
Generated with opensourse script
It takes a broader view of UX personalization and anticipation of user wishes. We already have these types of things on our phones: Google Now and Siri automatically propose a way home from work using location history data However, the key factor here is trust. To execute anticipatory experiences, people have to give large companies permission to gather personal usage data in the
Airbnb Smart Pricing
The team learned how to answer the question, “What will the booked price of a listing be on any given day in the future?” so that its hosts could set competitive prices.
Giles Colborne on AI
Advice to designers about how to continue being useful in this new era and how to use various data sources to build and teach algorithms. The only element of classic UX design in Spotify’s Discover Weekly feature is the track list, whereas the distinctive work is done by a recommendation system that fills this design template with valuable music.
There are great examples ready-made algorithm-driven design tools for classic graphic design: identity, typography, drawing, illustrations. They show that it's possible to apply similar ideas to create a UI.
Generated with opensourse script
A product to replace freelancers for a simple logo design. You choose favorite styles, pick a color and voila, Logojoy generates endless ideas. You can refine a particular logo, see an example of a corporate style based on it, and order a branding package with business cards, envelopes, etc. It’s the perfect example of an algorithm-driven design tool in the real world! Dawson Whitfield, the founder, described machine learning principles behind it. Logoshuffle and My Brand New Logo are similar tools.
Generative Branding: Oi
Wolff Olins presented a live identity for Brazilian telecom Oi, which reacts to sound. You just can’t create crazy stuff like this without some creative collaboration with algorithms.
Photoshop Content-Aware Crop
2016 release of Photoshop has a content-aware feature that intelligently fills in the gaps when you use the cropping tool to rotate an image or expand the canvas beyond the image’s original size.
Shutterstock Composition-aware Search
You can specify keywords and arrange them on a frame to find a photo like that.
Photoshop Scene Stitch
Photoshop added another content-aware feature — it replaces a whole part of a photo with a relevant piece from Adobe Stock collection. No need for intense retouching anymore. Another experiment is Project Cloak which replaces objects on videos. See more MAX 2017 announces based on Adobe Sensei platform (Puppetron and PhysicsPak are the best).
Happy Finish design studio used GAN's to generate an AI brand ambassador for the Dove Baby brand in the UK but training an AI to mimic the traits that UK media associates with mothers to show how artificial that persona is.
AI Imaging Technique Reconstructs Photos with Realistic Results
Researchers from NVIDIA introduced a deep learning method that can edit images or reconstruct a corrupted image, one that has holes or is missing pixels.
Generative Visual Manipulation on the Natural Image Manifold
It helps to refine fashion design. You can sketch changes to a bag or a shoe and see how it could look in a real product.
Randomatizm (in Russian)
An experimental website by Alexander Moskovskikh that generates suprematizm-like artworks.
Drawing Operations Unit: Generation 2
Sougwen Chung creates collaborative art with her robot. It learns from her style of drawing, turning her practice of art-making into a real-time duet.
A smart platform that uses Adobe’s deep expertise in AI and machine learning, and it will be the foundation for future algorithm-driven design features in Adobe’s consumer and enterprise products: semantic image segmentation, font recognition, and intelligent audience segmentation. Scott Prevost sees 3 ways to apply it to designers workflow.
There a lot of examples based on the idea of generative design, which has been used in performances, industrial design, fashion, architecture, music, and games for many years now. I'll highlight some of them, but you better visit websites like Creative AI to see more.
Generated with opensourse script
A tool based on the idea of generative design:
1. An algorithm generates many variations of a design using predefined rules and patterns.
2. The results are filtered based on design quality and task requirements.
3. Designers choose the most interesting and adequate variations, polishing them if needed.
Zaha Hadid Architects bureau uses this term to define their generative approach to architecture.
Alfa Romeo Pandion
Bertone automobile company made an Alfa Romeo concept car using algorithmic design. The concept, taken from the world of mathematics, indicates an organic alternative to traditional design and is the "propagation of random forms".
Who Is Winning the 3D Printing Battle in Footwear & Why?
A review of high-tech shoe initiatives by Nike, adidas, New Balance, and Under Armour.
No Man's Sky
Nearly all elements of the game are procedurally generated, including star systems, planets and their ecosystems, flora, fauna and their behavioural patterns, artificial structures, and alien factions and their spacecraft.
Is the future of music artificial?
Flow Machines computer scientists unveiled the first song to be composed by artificial intelligence, the Beatles-esque "Daddy’s Car". See also how Nao Tokui added background noise to Google Street View scenes.
Computational Video Editing
It automatically selects the most appropriate clip from one of the input takes, for each line of dialogue, based on a user-specified set of film-editing idioms. A final cut is a good draft for an editor.
Chinese news agency adds AI anchors to its broadcast team
They have the likeness of some of Xinhua's human anchors, but their voices, facial expressions and mouth movements are synthesized and animated using deep learning techniques.
Tate Modern and Microsoft collaborated on an exhibition where a machine learning algorithm selected artworks from museum's collection. Philipp Shmitt did a similar experiment with a photo album.
AI will be the art movement of the 21st century
Rama Allen says that human/AI collaboration is an aesthetic dialogue similar to that employed with improvisational jazz. It's a great thinking on what modern art could be.
Several years ago, the hottest discussion in the design community was "should designers code?". Now things became even more complex. There are several starting points for you, including my article on Smashing Magazine (all these links are in it).
Generated with opensourse script
A Visual Introduction to Machine Learning
A great visual overview of machine learning basics by Stephanie Yee and Tony Chu.
Experience Design in the Machine Learning Era
A terrific article by Fabien Girardin. He shows how designers can work together with big data analysts to benefit from machine learning.
Artificial intelligence and the future of design
Jon Bruner gives a good example: A genetic algorithm starts with a fundamental description of the desired outcome — say, an airline’s timetable that is optimized for fuel savings and passenger convenience.
Human-Centered Machine Learning
A fantastic overview of design process for products that use machine learning from Josh Lovejoy and Jess Holbrook. Here's a case study that applies these principles to Google Clips camera.
People+AI research initiative. How might we make it easier for engineers to build and understand machine learning systems? How can AI aid and augment professionals in their jobs? Can design thinking open up new applications for AI?
Applications Of Machine Learning For Designers
Lassi Liikkanen shows 3 key applications: detection, prediction, and generation.
Designing the User Experience of Machine Learning Systems
Lots of interesting papers from Association for the Advancement of Artificial Intelligence Spring 2017 Symposium. Look at the one by Janin Koch about Collaborating with AI.
The Best Machine Learning Courses
Class Central analyzed online courses on machine learning and selected the best.
Machine Learning for Creativity and Design
This one-day workshop explores several issues in the domain of generative models for creativity and design. 32 papers were published.
Can Users Control and Understand a UI Driven by Machine Learning?
In a study of people interacting with systems built on machine-learning algorithms, users had weak mental models and difficulties making the UI do what they want.
Microsoft Guidelines for Human-AI Interaction (PDF)
These 18 guidelines can help you design AI systems and features that are more human-centered. How to use them in a creative process.
There is no difference between computer art and human art
Oliver Roeder says that “computer art” isn’t any more provocative than “paint art” or “piano art.” The algorithmic software is written by humans, after all, using theories thought up by humans, using a computer built by humans, using specifications written by humans, using materials gathered by humans, in a company staffed by humans, using tools built by humans, and so on. Computer art is human art — a subset, rather than a distinction.Robert Hart looks for legal precedents.
Where machines could replace humans — and where they can’t (yet)
McKinsey analyzed 800 jobs to find how easily they can be automated. Lots of interesting insights. Here's a website to check your job.
Travis Gertz shows that many websites already look the same. It happened before algorithms even for professional design agencies. The article is incredibly insightful if you want to understand the reasons of this homogenisation.
AI and the future of design: Will machines take your job?
A good article series by Rob Girling from Artefact. He looks at skills that can be automated and tries to predict the future of design as s profession.
Automation of Design: History
Lukasz Lysakowski digs through a history of design automation from book printing to modern days.
The State Of Advanced Website Builders
Drew Thomas tries to find a niche for design agencies in the world of cheap websites built by advanced online builders.
In a few years, no investors are going to be looking for AI startups
Frank Chen thinks that investors will stop looking for AI-powered startups in exactly the same way they don’t look for database-inside or cloud-native or mobile-first startups anymore. All those things are just assumed. See an e-book about AI market.
In the AI Age, “Being Smart” Will Mean Something Completely Different
Ed Hess says that the new smart will be determined not by what or how you know but by the quality of your thinking, listening, relating, collaborating, and learning.
How to recognize exclusion in AI
Microsoft inclusive design team defined five biases for AI: dataset, association, automation, interaction, and confirmation.
AI is Killing Our Grasp on Reality
Sandra Upson writes about a new way to produce audio, video, or text that resembles the real world. It could lead to fake reviews and even events.
David Dao made a curated list to track current scary usages of AI — hoping to raise awareness to its misuses in society.
Everyday Ethics of AI
IBM designers created a practical guide for designers & developers for building and using AI systems.
AI is bringing out the art world’s worst instincts
AI is like photography in the 19th century–struggling to be accepted as its own art form. Aaron Hertzmann discusses tricky situations in art world.
The Real Story Behind Microsoft’s Quietly Brilliant AI Design
The company studied personal assistants — human ones — to understand how to make a great machine assistant for PowerPoint Designer feature (it makes good slide design for users).
AI UX: 7 Principles of Designing Good AI Products
Dávid Pásztor aims to create useful, easy-to-understand products in order to bring clarity to this shady new world of machine learning. Most importantly, we want to use the power of AI to make people’s lives easier and more joyful.