Completing the AI Puzzle: AIs Working Together to Conquer Design


20 December 2023 | Issue #28

Have you heard about COLE? It's a groundbreaking tool that could significantly alter the graphic design landscape.

Named after Henry Cole, the creator of the first graphical Christmas card, COLE allows users to input a design idea and have an AI generate not only the image but also the accompanying text.

Developed by a team from Microsoft Research Asia and Peking University, COLE combines various AI models, including Meta’s Llama2-13B and GPT-4V, with the Skia graphics renderer. This unique combination addresses the complexity of graphic design and the scarcity of training data in the field, particularly for .svg files.

COLE stands out for its ability to generate crisp, organized graphic designs that integrate visuals with stylized text, a task that has been challenging for most AI art generators.

What sets COLE apart is its production of images with distinct editable blocks for texts and objects, allowing users to modify elements within the COLE framework itself.

This feature enables users to make changes directly, without needing to export to other programs like Adobe Photoshop or InDesign. COLE's editable text and visual elements offer a new level of flexibility and user control in AI-generated designs.

For designers and marketers just starting with AI, COLE represents a significant advancement in AI-assisted design tools. While it's not a fully there, COLE's capabilities suggest a future where high-quality designs can be generated with minimal effort, integrating human expertise when necessary.

This development could democratize graphic design, enabling those without formal training to create professional-level designs. However, COLE is currently more of a framework than a product and is not yet publicly available, though a demo is expected soon on their Github project webpage.

To learn more about COLE and its potential impact on graphic design, read more on VentureBeat. It's not fully baked, but generative AI being able to produce imagery and text that is editable is right around the corner.

NEWS AT THE INTERSECTION OF MARKETING, DESIGN, & AI

😕 Design fail: Adobe and Figma call off their merger as antitrust scrutiny intensifies

In a surprising turn of events, Adobe and Figma have decided to call off their $20 billion merger. This decision comes as a response to increasing antitrust scrutiny from regulators in the U.K. and EU, marking a significant moment in the tech industry's ongoing battles with regulatory bodies.

  • The merger's cancellation was influenced by concerns from the U.K.’s Competition and Markets Authority and the European Commission, who feared the deal would harm the digital design sector.
  • As a result of this decision, Adobe is set to pay Figma a hefty $1 billion breakup fee, while both companies express disappointment but readiness to move forward independently.

My two cents: I think this is good for the design industry. Adobe already controls so much of the design software space. It obviously saw Figma as a serious competitor and tried to squash it. Competition is a good thing. It forces companies to continue to up their respective games. The U.K. and E.U. regulators did us all a big favor (unless you were an investor in, or an employee of Figma.

Without competition, we'd still be using QuarkXPress. Fun fact, Quark tried to buy Adobe years ago (Yikes!). We all benefitted from the deal not going through.

Keep reading

😻 Adobe just revealed the "functional and joyful" future of its software design

Adobe's unveiling of Spectrum 2, the second generation of its design language, is quite the buzz in the design community. Set to launch in 2024, Spectrum 2 represents a significant overhaul of the user interface across Adobe's Creative Cloud suite, aiming to make the user experience feel more like 'home'.

  • Spectrum 2 is inspired by Adobe Express and focuses on enhancing every design element, including iconography, typography, and color, to create a more expressive and approachable experience.
  • Key features of this update include dynamic contrast and brightness, more accessible colors, and an attention hierarchy, blending the bubbly style of Adobe Express with Adobe's more utilitarian design.

Check it out!

👩🏾‍🎨 Imagen 2 on Vertex AI is now generally available

Google Cloud has just announced a major upgrade with Imagen 2 on Vertex AI, now available for customers. It's a big leap in image-generation capabilities, offering a range of features that make creating high-quality, photorealistic images from text prompts easier and more intuitive.

  • Imagen 2 boasts improved image quality and versatility, including text rendering in multiple languages, logo generation, and visual question answering capabilities.
  • The platform also emphasizes safety and responsible AI use, integrating features like digital watermarking and comprehensive safety filters to align with Google’s Responsible AI principles.
  • h/t to Brian Piper

I haven't figured out how to use it yet, but the images on the announcement are the best I've seen from any genAI system to date.

Keep reading

🔦 Dark Mode vs. Light Mode – Breakdown by Age and Agenda

A couple of weeks ago I surveyed people on LinkedIn and Threads to get a better understanding of what people like to use, and who prefers to use which mode.

Some results were surprising. Others were in line with what I was expecting.

  • Surprising nobody, people under the age of 40 strongly favored dark mode. The results for people over the age of 40 wasn't what I was expecting
  • Gender didn't play much of a part in the breakdown of who prefers light mode or dark mode

Keep reading

NEW RESOURCES FOR YOU

Is your department trying to figure out where to start with integrating AI?

Find yourself not getting the traction you want with your AI initiatives?

Why not have me talk with your team about what I'm seeing in the industry? We all know that third-party sources can help move internal initiatives along.

Let's brainstorm!

Have you seen the Figma keyboard?

How cool is this!?! Your favorite Figma shortcuts with the click of a button. Personally, I use a lot of hotkeys, so this would require me to learn a new system, but I could see it speeding up some processes.

As the year winds down, I want to thank you for reading this newsletter. If your inbox is anything like mine, it probably looks like my tween's bedroom – a constant mess. But I appreciate you taking the time to read this and respond directly or in the comments. It's that type of motivation that keeps this going. 🙏🏻

HOW CAN I HELP YOU?

If you want to learn more about what's available, here are some links:

Thanks for reading!

-Jim

Let's chat about your career growth

14 Grapevine Road, Merrimack, NH 03054
Unsubscribe · Preferences

Marketing by Design – Intentional strategy for creative marketers in the age of AI

AI is redefining the marketing landscape. Stay ahead with this weekly newsletter on trends & how to prepare your career for an AI future.

Read more from Marketing by Design – Intentional strategy for creative marketers in the age of AI
the AI hype cycle

28 September 2025 | Issue #111 In this issue: The AI Hype Cycle, What it Really Means Canva in the Workplace Survey (part 3) Your Visuals Are Either Making You Money, or Costing You Are You Marketing to a Buyer, or a Buying Center? Looking to Print Some Merch? I've Got a Guy How Saturated Colors Impact Consumer Behavior—And Waste Apple working on MCP support to enable agentic AI on Mac, iPhone, and iPad I have many appearances in the next few weeks! Design Quote of the Week Midjourney Prompt:...

People waiting in line for a club (your content)

21 September 2025 | Issue #110 In this issue: Google's Monthly "Demand Gen Drops": Why Continuous Updates Beat Big Announcements Canva in the Workplace Survey (part 2) The State of Visual Communications Report Video is Invisible to AI Don't Treat AI Rollouts Like Any other IT Project Burn the Playbook Design Quote of the Week Midjourney prompt: a line of people are waiting to get into a nightclub. The camera is at street level. A vibrant, high-contrast illustration using flat vector-style...

PowerPoint vs. Canva

14 September 2025 | Issue #109 In this issue: PowerPoint vs. Canva: Should You Make the Switch? Canva in the Workplace Survey MIT AI Survey: Beyond the Hot Takes The Ultimate Guide to Website Color Schemes Kit Hikes Prices, Creators Revolt Where AI Gets Its Facts [Infographic] How AI Changes Your Customers Design Quote of the Week Midjourney prompt: two boxers are fighting it out. The camera is at eye level. A vibrant, high-contrast illustration using flat vector-style shading with neon and...