Energy consumption by buildings has increased to the point that it has overtaken the industrial and transportation sectors (Perez-Lombard et al., 2008). This research seeks to develop Intelligent Adaptive Building Systems as a means of offsetting energy consumption, as well as improving numerous building performance metrics for all stakeholders (Table 1). To achieve this, several existing technologies are married to form a contextually aware agent based network consisting of many semi-autonomous components. Through this research, two prototypes have been developed. The first served largely as a learning tool, setting the foundation for subsequent versions by necessitating lessons in physical computing and computer programming. A second generation prototype was developed which furthered insight into these lessons, and led to discoveries related to the potential of actuators and sensors, device networking, data mining, and agent based networks. Details about the first two prototypes, their successes, and failures will be presented. With these lessons in hand, it is now necessary to develop a third generation of prototypes to: further the understanding of adaptive facade capabilities and feasibility, intelligent computer behavior development, building performance metrics, and human interfacing methods. By developing several, rather than one 3rd generation prototype, the ability to draw comparisons between technologies and components will be vastly improved. This paper will focus on what form these prototypes should take, and what can be learned from them.