Jose Luis Perez Hermo was actively participating in the Taking Control: Midjourney x ControlNet workshop, led by Carlos Banon, helping him push the boundaries regarding the visualization process. From then onwards, he has been trying to experiment with varied AI tools, from conceptualization to the detailed execution stages.
Instead of starting from scratch, Jose adopted a different approach to this project, Pencil 2 Pixels. While the workshop’s scope extends beyond mere text-to-image creation, he tried to visualize from diverse architectural sketches. According to Jose, the project aims to be accurate with the drawings and go a step further by leading the process with AI.
Guiding Stable Diffusion toward a clear image style was a challenging task. Initially, Jose worked on visualizing the basic geometry until he landed on a style that resonated with both the architect and the essence of the project. At this project stage, careful image curation is crucial to prevent the AI from taking excessive liberties that could produce overly artificial visuals. The next step involved establishing visual narrative coherence. This required iteration; he started with masterplans, remembering that revisiting earlier visuals would be imperative as Jose progressed. The most challenging part was steering the software to keep a holistic approach. The aim was to ensure consistency across all project images, even with varying architects or styles.
As a computational designer, the AI realm is not a new concept for Jose. These tools were beneficial throughout the design process, from topology optimization to energy analysis. However, text-2-image software opens up new horizons because it allows us to explore- hundreds of concepts for our projects within a short time. During this PAACADEMY workshop, Carlos Barnon provided tools for a precise understanding of prompt engineering. Some helpful advice was to tackle one ControlNet Unit at a time for in-depth development, to enhance the software’s comprehension. This approach was essential to provide an accurate level of consistency in the visuals.
Jose relied on using Dall-E 2 for quite a long time. However, he came across Adobe Firefly, which offered him the opportunity to test it as a Beta user, and the experience was fantastic. When Firefly/Photoshop fell short of my expectations, Jose found using ControlNet directly for the necessary image corrections beneficial.
A pivotal aspect is the ability to produce precise images without project modeling. Moreover, AI tools offer a level of realism that’s challenging to achieve with traditional software. Additionally, they present a unique approach to decision-making in the early stages of the project, providing a wide range of solutions for one project. Finally, choosing Stable Diffusion over MidJourney ensures high accuracy without extensive iteration time.
This project embodies a holistic approach to leveraging SD’s potential through different architectural styles. Sometimes, it can be demanding, where architects must adapt the software to align with their unique styles. That entails embracing SD as a co-worker and driving the project’s evolution step-by-step. This collaborative approach facilitates conceptualizing the project and generating feasible architectural ideas.
With that in mind, it is important to keep using these incredible tools, from conceptual stages to construction and detailing, because that process also provides valuable insights for the whole community, enriching further advancements in this field.
*The text was provided by Jose Luis Perez Hermo and reviewed by PA Editorial Team.
