Topic: Taking Control 4.0: ControlNet x ComfyUI in Architecture
Date: June 1st – 2nd, 2024
Time: 12:00 – 16:00 GMT
Format: Online on Zoom
Duration: 2 Sessions (10 Hours)
Registration Deadline: May 31st, 2024
Total Seats: 50 seats
Difficulty: Intermediate
Language: English
Certificate: Yes
General Registration: 90 EUR
Fee For Digital Members: 77 EUR (15% discount available only for Digital Members)
Organized By: PAACADEMY
Tutor: Carlos Bañón
Recordings: Recordings will be available for all participants afterward indefinitely.

The workshop is available in a bundle with a discount including two other workshops.
For more details: visit the ‘Artificial Intelligence Bundle III.’

Introduction

Taking Control 4.0: ControlNet x ComfyUI in Architecture

This workshop focuses on providing technical expertise and cultivating creative thinking by utilizing AI platforms like Midjourney, Stable Diffusion, and Rhinoceros3D. These tools significantly redefined workflows in spatial and product design. Midjourney, specifically its v6 alpha version’s features like image prompt-based style guidance, can help expand architectural concepts. Meanwhile, Stable Diffusion, especially versions 1.5, XL, and XL-Turbo, in conjunction with ControlNet and ComfyUI, allows precise manipulation of geometry, materiality, and atmosphere. Since these models have been established in the field, the workshop concentrates on practical implementation and understanding their relevance in architecture. Participants will learn merging the expansive conceptual capabilities of Midjourney with detailed control offered by Stable Diffusion and ControlNet. This combination aims to maximize the potential and optimize these tools for diverse design objectives. The workshop is designed to empower architects and designers with the skills to navigate these advanced technologies, leading to innovative and controlled design outputs.

The Scope of the Workshop:

Introduction and Overview:

Introduce Midjourney v6’s Alpha new features and Stable Diffusion.

Provide an overview of their impact on architectural design workflows.

Understand the significance of integrating these tools to produce 3D Models.

Stable Diffusion x ControlNet for Conceptualization, Materiality, and Atmosphere Control:

Explore Design Possibilities with Stable Diffusion 1.5 and XL x ControlNet.

Develop bespoke workflows for controlling geometry and materiality in Architectural Designs.

Engage in hands-on exercises to cultivate skills in materiality and atmosphere manipulation.

Exploration of newest SD Models:

Investigate SDXL and real-time prompting with SDXL Turbo.

Examine Diffusion Models and Animation techniques.

Recap of key learnings from the workshop, highlighting opportunities for further exploration and skill development.

Objectives

The workshop aims to introduce participants to Midjourney v6’s Alpha new features and Stable Diffusion, emphasizing their impact on architectural design workflows. Through hands-on exercises, attendees will understand the significance of integrating Stable Diffusion x ControlNet tools for enhanced materiality and atmosphere control in 3D architectural models. Bespoke workflows utilizing Stable Diffusion 1.5 and XL x ControlNet will be developed to enable precise geometry and material manipulation. Participants will gain proficiency in materiality and atmosphere manipulation through practical exercises. Additionally, the workshop will explore the capabilities of the newest Stable Diffusion models, including SDXL and real-time prompting with SDXL Turbo, as well as diffusion models and animation techniques. Finally, a recap of key learnings from the workshop, opportunities for further exploration, and skill development in architectural design workflows will be provided.

Program:

Day 1: Setting Foundations

Diffusion Images Fundamentals and Midjourney Alpha (2.5h)

•    Introduction: The Spectrum of AI-Driven Design Workflows using Midjourney and Stable Diffusion – Maximizing the Strengths of Each Platform

•    Lecture: Midjourney: “Inverted Design: Final Renders as Starting Points in Architecture”

•    Tutorials: Prompting strategies to Generate Industry-Ready Architectural Images with Midjourney v6 —Style Creation, Workflows with /blend, Vary Regions, and /remix

Stable Diffusion Fundamentals in ComfyUI (2.5h)

•    Lecture: “More Than Words: Introduction to Stable Diffusion and ControlNet”

•    Tutorial: Setting up Stable Diffusion in ComfyUI – Interface, Introduction, Models, and Initial Experiments

•    Tutorial: Workflow creation for Text2Image and Img2Img with ControlNet

Day 2: Control and Use Cases (5h)

Stable Diffusion x ComfyUI Workflows (2.5h)

•    Workflows with ControlNet  in Architectural Design. Application and use Cases.

•    Adding detail : Upscaling and Inpainting.

•    Fundamentals of ConfyUI with SDXL and SDXL Turbo models.

Introduction to Animation with Stable Diffusion (2.5h)

•    Creating animations from still frames.

•    Examples of AnimateDiff

Software:

• Midjourney: Standard membership recommended. (No prior experience needed. Subscription required)
• Stable Diffusion and ControlNet 
• Rhinoceros3D (basic notion of 3D modelling is recommended)
• Photoshop Beta (elemental notions) 

Instructor:

Carlos Bañón

Carlos Bañón is a pioneering architect and professor integrating AI, computational thinking, and digital fabrication into architectural design. Renowned for his resource-efficient, computationally-driven methodologies, he has reshaped urban landscapes and the built environment over twenty years through his practice, Subarquitectura. As a tenured faculty member at SUTD, he established the Architectural Intelligence Research Lab (AirLab) in 2015. His acclaimed work, showcased in two editions of the Venice Biennale, garnered prestigious awards like the Singapore President’s Design Award and a Nomination for the Mies Van Der Rohe Award. An influential figure in architectural education, he held visiting professor positions at leading institutions such as MIT, EPFL, and KEA, inspiring the next generations with innovative, tech-centric designs.

Important Notes:

• The “Taking Control 4.0: ControlNet x ComfyUI in Architecture” Studio workshop by PAACADEMY will start on Saturday, 1st June 2024, at 12:00 (GMT).
• Total sessions: 2 Sessions
• The teaching duration per session will be 5 hours.
• Students will have time for a break between teaching hours.
• Each session and the entire studio will be recorded, and videos will be available for participants just a day after the class for unlimited time.
• PAACADEMY will provide a certificate of attendance.
• The studio has limited seats. Tickets are non-transferable & non-refundable. Please read carefully before you register.

Topic: Taking Control 4.0: ControlNet x ComfyUI in Architecture
Date: June 1st – 2nd, 2024
Time: 12:00 – 16:00 GMT
Format: Online on Zoom
Duration: 2 Sessions (10 Hours)
Registration Deadline: May 31st, 2024
Total Seats: 50 seats
Difficulty: Intermediate
Language: English
Certificate: Yes
General Registration: 90 EUR
Fee For Digital Members: 77 EUR (15% discount available only for Digital Members)
Organized By: PAACADEMY
Tutor: Carlos Bañón
Recordings: Recordings will be available for all participants afterward indefinitely.