Increasing numbers of software development organisations are using agile methodologies, due to their perceived benefits when compared with more traditional software development methods. Managing the use of such methods within multiple team environments can be challenging. In this paper, we present the results of a study into the usefulness of software metrics within a multiple team agile software development, and their usefulness in aiding such a development when presented within a dashboard. Based on Van de Ven's principles of Engaged Scholarship and Hevner's framework for Design Science in IS, we undertook an iterative prototype development and evaluation study. The evaluation was undertaken with agile practitioners at one Danish software development organisation. The analysis of our evaluation sessions yielded fourteen findings, each of which related to the effectiveness of the dashboards and metrics contained within the prototype. We discussed these findings in relation to existing literature on metrics, dashboards and agile software development, identifying key metrics and design considerations for dashboards in multi-team agile development. We also contribute the artifact instantiation resulting from our design process, namely our final prototype. Finally, suggestions for possible future work in further development and evaluation of the prototype are presented.