 Software development is risky, but 25 years ago, building a program was like gambling at a casino. In 1996, 31% of U.S. development projects failed entirely. 53% were over budget, schedule, or missing functionality, and only 16% met initial expectations. The problem was in the way IT projects were planned. In the 1990s, software development usually looked like this. First, the team of user representatives gathered requirements, development was scheduled and budgeted, then thousands of pages of documentation was handed off to a tech team to begin design and development. Eventually, the system was integrated into existing processes and tested. This was called the waterfall model, as steps were discreet and strictly followed each other. Today, the drawbacks of this approach seem obvious. Planning and documentation could take months. But what if you've made a mistake and the software solves non-existent problems? This would then be revealed only at the end of the cycle, and estimating new features that need deep research was essentially guesswork. An additional headache became evident in enterprises and complex projects. How to translate business requirements to technicians. Project managers and analysts that worked on analysis stages spoke a language completely different from the one engineers spoke. Programmers like solving tech puzzles, not business problems. And this made the gap between planning and coding even deeper. There was a need for someone who'd take the technology leadership, have a high level view on the problem, and suggest a solution expressed in a language accessible to technicians. In 1999, engineers from Rational Software, led by Philipp Kruchin, suggested building software in short iterations, re-evaluating assumptions and results at the end of each development phase. This technique was called the Rational Unified Process. And this partly solved the first problem related to long planning and a feedback cycle. However, today most development teams use other iterative and agile methods like Scrum, Lean, and Kanban. But Rational, by bridging the gaps between requirements and technology, helped address the second problem, communication difference. Later, this practice was dubbed Solution Architecture, and the role of the person leading it, Solution Architect. The term architecture was borrowed from the construction industry to highlight the complexity of problems. These were enterprise systems after all. The term also depicts a vantage point. Architects oversee the big picture without diving into low-level technical details. Today, we know three main roles related to architecture. Enterprise, Solution, and Software Architects. First, there were enterprise architects and software architects. Solution Architects weren't initially recognized either in enterprise architecture frameworks like TOGAF or in software development ones like Rational. But sometime in the mid-2000s, the role emerged as a middle ground between a wide enterprise perspective and a narrow tech perspective. Ultimately, the roles differ in how high their vantage points are. Enterprise architects consider the big picture and oversee the entire corporate tech ecosystem from the business perspective. Solution Architects work with specific products and define how they answer the business questions with technology. Software Architects specify the structure and behavior of a system described by Solution Architecture from a technical perspective only. Any software development starts with gathering requirements from a diverse group of people, stakeholders, user experience specialists, or even end users. Business analysts are in charge. They document requirements in user stories, short descriptions of product behavior from a customer perspective. These are functional requirements. There are also some non-functional ones, the general qualities of software, its speed, maintainability, security, and some others. Besides requirements, any project has its own constraints, a budget, manpower, time, licensing, and risks. A business analyst provides a Solution Architect with all these inputs. The architect is responsible for converting them into a high-level technical guide. But there's an additional level of complexity. Usually, a product never exists alone. It must fit into the current enterprise architecture other systems a company has been using before. For instance, if you use an old legacy monster, your shiny new admin panel must be able to tame it and communicate with it. So Solution Architect considers existing enterprise architecture to make sure that a new product fits well in the existing ecosystem. If you look at the Amazon Web Services Certification Exam Guide for Solution Architects, you'll get the idea of the problem domains that this person faces. Designing resilient architectures, defining performant architectures, specifying secure architectures, and so on. Too vague, right? Okay, for example, an architect building an AWS-based system may need to decide which Amazon cloud service to use and how if the client's salespeople upload their sales figures daily. They need a durable storage solution for these documents that also protects against users accidentally deleting important documents. The selection of specific technologies isn't limited to cloud services only. An architect decides technology stack, databases, architectural patterns, standards, and more. But where's the architecture? What is that exactly? Construction architects have concepts and plans. Solution architects have diagrams. Now remember rational software. In 1995, they suggested Unified Modeling Language, or UML. UML is a language for visualizing how software works. This is Hello World in Java programming language, and this is Hello World in UML. UML suggested three main building blocks. Things, boxes, circles, and other shapes to show functional objects. Relationships, lines and arrows to connect objects and explain how they interact, and diagrams, combinations of these to capture the big picture. Using this simple logic, you can describe very complex systems with modules, services, databases, flows, or even movies. Here's a recent Netflix, Bandersnatch. In 1997, Object Management Group standardized UML as a general purpose modeling language. It also became ISO Standard in 2005. Now the language is widely used to describe architectures. UML isn't the only way to describe architectures. With the growth of cloud services, their providers also suggest their individual visualization methods. And that's how business needs are first translated into user stories and then into the format that engineers can work with. The ability to win the hearts and minds of our customers while explaining abstract technical concepts as they relate to business value is a must. And this is a quote from the job posting for a solution architect in one of the tech companies. Solution architects do lots of talking. Diagrams look static, but making them reiterating and tweaking entails a lot of communication with different parties. Stakeholders and project managers to capture the business problem and pitch a solution. Business analysts to work over requirements. Enterprise architects to fit a solution into the corporate ecosystem. Engineering team and software architects to break down tech details. Many people, besides that one guy that's always at the coffee machine. But who's qualified for this kind of job? Usually solution architects have engineering backgrounds and a pedigree of complex projects. Framing intricate requirements into an architecture takes top-to-bottom understanding of a product from the client side through languages, operating systems, and virtual machines to an infrastructure. Most likely, a solution architect would understand a domain. There are architects who know the ins and outs of financial systems like healthcare software or travel. You name it. They may also have tech domains. Cloud providers like Amazon Web Services and Microsoft Azure offer architect certifications to demonstrate their proficiency with these ecosystems. So look for that if you plan to hire one. And obviously you want the soft skills that keep all that communication humming. But does it work? In 2009, experts from Camp Gemini and the University of Amsterdam surveyed people from 49 software projects to understand the business value of solution architecture as a practice. They found that the use of solution architecture helps decrease budget overrun by about 19%. It improves customer satisfaction and finds a better technical fit for project results. This doesn't mean, however, that all software projects need solution architects. If you build landing pages, integrate small modules, or make minor iterative improvements, most likely you won't need dedicated solution architecture. As one of the building blocks of enterprise planning, solution architecture remains in the realm of complex projects.