Collective Evaluation of Design Driven Doctoral Framework
Intensive Study Programmes and Joint Staff Training

The CA2RE+ course is developed through 6 biannual LEARNING TEACHING TRAINING events: international/intercultural INTENSIVE STUDY PROGRAMMES - ISPs for doctoral candidates, guided by experienced evaluators from partners and invited experts. The DDDr work-in-progress is evaluated through presentations, performances, exhibitions and critical discussions, following the iterative CA2RE+ project steps: OBSERVATION, SHARING, COMPARISON, REFLECTION, REFORMULATION and RECOMMENDATION. The events are organized in Ghent, Trondheim, Milano, Hamburg, Ljubljana and Delft. Each host is responsible for one of the project steps. Each event is offered to 27 DDDr candidates (24 from abroad, 3 from the host) and 18 experienced evaluators (16 / abroad, 2 / host). Each event starts with the DDDr exhibition and the keynotes on the DDDr local tradition and relevant project step. Each candidate presents/performs his DDDr work-in-progress (30 min) and discusses with the evaluation panel (30 min). A reporter (partner member) prepares the findings for the event discussions and for the project development.

To introduce new experts with low evaluation experience into the process and enable them equally contributing to the project intellectual outputs, a JOINT STAFF TRAINING (JST) is offered to 18 individuals (16 from abroad, 2 from the host), at each ISP occasion. Some of the participants are new to DDDr, but have some expertise in doctoral evaluation; others familiar with DDDr but less experienced in doctoral evaluation. The knowledge from one group is shared with the other, so that they don’t need an external ‘teacher’. The link with the JSP is provided by the experienced evaluator from the JSP group. The participants join the ISP keynote and learn through the ISP evaluation.

Each day is wrapped-up by an evaluation plenary, where the participants of ISPs/JSTs discuss their evaluation positions.. Each event is finalized with the discussion workshop of all the participants. This is to maximize the synergies between the ISP/JST groups

The CA2RE+ events are organized together with the CA2RE Conferences.

CA2RE+GHENT
PROJECT STEP: OBSERVATION
The PhD presentations to review panels at the CA2RE+GHENT event is an observation in its own right of the following circles of observation as intense processes of interaction and presentation.
 
This interacting and communicating operates within an integrated set of concentric circles of observation.
1.The first circle of observation, the inner one, is occupied by the PhD candidate, who performs research actions and observes his/her research actions.
2.The second circle of observation consists of the panel members, who observe the actions and observations of the PhD candidate at their home institutions, and by discussing these, also observe/calibrate their own evaluation.
3.The third circle of observation consists of the panel members (academia) at the doctoral presentations, performed during the CA2RE+ events. These panel members observe the candidate’s actions and observations, and contribute to the observations of the panel that is present at the PhD candidate’s presentations.
4.The fourth circle of observation consists of the evaluators who witness the candidate’s doctoral presentations, who observe the candidate’s actions and observations, and the panel’s actions and observations, and hence contribute to the calibration of the doctoral process through ongoing discussions at the formal and informal moments of the CA2RE events.
5.The fifth circle of observation consists of reporters, who observe the aforementioned four circles, and who contribute to the transmission of the observations ongoing in the previous circles of observation, doing so both inwards (loops of feedback into the different circles of observation) and outwards, i.e. transferring new knowledge to our target groups (see: FOLLOW-UP section).
Due to the integrated nature of these circles of observation an integrated system of calibration and validation is established between all the stakeholders (circles) of the observation system. This is key to come to a validation principle wherein knowledge production is understood, accepted and transmitted.
 
Additional to the installing of these circles of observation, it is important (1) to clearly circumscribe and apply the role of each circle of observation in this system as explained above by clearly communicating their roles at the outset of the event, (2) to develop ways of activating the interplay between all the circles of observation in order to (3) make sure that each circle of observation within this system knows the role of the other circles of observation, engages with them empathically and thus calibrates the observations within academic rigor.
 
The CA2RE+GHENT event makes these 5 circles of observation explicit, install and test them in order to evaluate them at the end of the event. By doing so the CA2RE+GHENT event aims at shaping the format for the subsequent CA2RE events.

GHENT RESEARCH CULTURE
The GHENT event is coloured by the research focuses on the relations between the drawing and the space, and on radical materiality, where the key CA2RE+ persons are active.

CA2RE+TRONDHEIM
PROJECT STEP: SHARING
At the TRONDHEIM ISP and JST event SHARING in spring 2020, all participants together will make the name of the event, its program. Invited and participating PhD scholars, ca2re+ staff, invited guests and other partners will, through their participation, learn and experience. They will will develop the circles on sharing from the circles of observations, developed in GHENT:  their activities, methods and approaches and having the possibility to reflect on it. This sharing will be based on previous activities and fostered through works, following local research traditions. Also guest lectures, an exhibition of the works and the discussed feedbacks to the PhD scholars presentation will be the basis for these reflections. Moreover this sharing will happen on different levels. Internal, in-between the participants, in-between the respective PhD community and internally at all participating institutions. Through the “open” presentation and exhibition, the event will also facilitate external sharing with other scientific fields and visitors.
(One way could be to show/ present research in different ways to communicate with the respective visitors in their preferred way).

TRONDHEIM RESEARCH CULTURE
One of the local particularities of activities and research at the faculty for architecture and design relates to the faculty’s position at the university structure, in between a mix of almost all scientific and technological departments and its methods and approaches. The faculty for architecture is also host for three educations and competences in the field of design; Architecture, design and art. All of these, not only have their own research program, but these programs are open for students from other fields as well. There are for example architects enrolled in the program for artistic development. This interchange easies new ways of seeing things and mutually exchange methods, they also foster cooperation in-between staff from different fields. These, accompanied by visitors from other international programs at the faculty, will together create diverse input to the activities and be the foundation and tools for reflection on/for sharing. The event activities will, not only enable diverse learning, through the e.g. different approaches, but also arrange for it.

CA2RE+MILANO
PROJECT STEP: COMPARISON
During ISPs and JSTs, CA2RE+’s staff, invited guests and newcomers will develop a comparative analysis of the local research traditions, presented and discussed in the presentations, exhibition, keynote lectures, and previous events. From a phase of disciplinary opening, the focus will narrow by comparing design strategies and tactics applied to highlight common approaches and methodological recursions. The outcomes will then be deepened during the following event.

MILANO RESEARCH CULTURE
The PhD Programme in Architectural, Urban, and Interior Design of Politecnico di Milano has always pursued a line of research, which is focused on the relation between theoretical and operational practice in architectural and urban design, analyzed through the comparison and integration of two different protocols of investigation. The first concerns theoretical research on design paradigms, whereas the second considers design as the driver and/or the result of a research program to be pursued in response to a problematic assumption. According to this methodological procedure, during the event in Milano, CA2RE+’s staff and invited guests will ask the presenters to meet new problematic domains, by individuating specific links between their own theoretical, methodological and operational design tools.

CA2RE+HAMBURG
PROJECT STEP: REFLECTION
Building on the themes of the previous events – OBSERVATION, SHARING and COMPARISON – the HAMBURG event will focus on REFLECTION. It will crystallize the observed strengths and weaknesses of design-driven research strategies, supervision and training. It will evaluate the current practice in connection, exchange and cooperation with other research disciplines. Thus, it is aiming to identify areas of future improvements and common developments. It will therefore contribute to the evaluation of the state of the art and prepare the basis for the subsequent project phase that is formulating and reformulating a FRAMEWORK for DDDr.

HAMBURG RESEARCH CULTURE
HAMBURG has a tradition in artistic-scientific research in the study program Metropolitan Culture and has a newly formed Architecture Research Initiative (ARI). While in the doctorates in Metropolitan Culture scientific writing is the dominant part of an artistic-scientific PhD project, the ARI is emphasizing the non-verbal, non-discursive knowledge production in architecture through buildings, objects, drawings and other non-verbal media as well as on the particular case as a design-driven research tool. These two local research communities will help to observe, compare and reflect differences and similarities within the various research traditions of the invited CA2RE+ community. Local PhD supervisors from the different communities will be invited to participate in the activities as observers and panel members. Local research traditions will be presented and discussed in the exhibition and keynote lectures.

CA2RE+LJUBLJANA
PROJECT STEP: REFORMULATION
The project step REFORMULATION builds on OBSERVATION, SHARING, COMPARISON and REFLECTION of DDDr cases and their evaluation situations. It represents the first step in building the DDDr FRAMEWORK. The step of reformulation brings a refreshed idea of the doctoral evaluation training as an event as well as the translation of the DDDr STRATEGIES and EVALUATION processes to related disciplines, from which DDDr learns and integrates their knowledge from, but not necessarily translates the integrative knowledge back. This step redefines the experiential DDDr knowledge explication through performances and discussions with the widest possible audience, that is close and far enough to identify the results as relevant for their own research. This step identifies the outer limits of distance (from familiarity), where the DDDr can still be identified as relevant. The degree of relevance is also identified in relation to the different modes of distance (exotic enough to be interesting, generic enough to be applicable, unique enough to be triggering….)  in relation to the relevance of the DDDr.

LJUBLJANA RESEARCH CULTURE
LJUBLJANA can express its research tradition through this project step with its sensitivity to delicate  and even fragile places of our contemporary architectural and urban environments. The architectural culture in Slovenia reflects the small scale hybrid landscapes of settlements with a very high level of vulnerability of places, due to both natural and cultural spatial dynamics. The architectural and design research culture is thus hybrid and inclusive, open and flexible to a wide variety of DDDr research approaches. LJUBLJANA can also build on the experience as the organizer of the second in the CA2RE conference series in Autumn 2017. If that event was oriented to the supradisciplinary field or the arts and architecture, the CA2RE+ in Autumn 2021 looks to the wider context of humanities and social sciences. It takes the advantage of the established research ties between the Faculty of Architecture, the Academy of Fine Arts and Design, the Faculty of Arts and the Faculty of Social Sciences and brings environmental psychologists, philosophers, anthropologists, urban sociologists, geographers, experts in cultural studies, experts in human resource management, and other related experts into the discussion.

CA2RE+DELFT
PROJECT STEP: RECOMMENDATION
As the final to the CA2RE+ series under the themes of OBSERVATION and SHARING (STRATEGIES), COMPARISON and REFLECTION (EXPERIENCES), REFORMULATION and RECOMMENDATION (FRAMEWORK), the event for RECOMMENDATION in 2022 will provide a platform where both the learners and educators contribute to chartering future recommendations for DDDr. To combine the accumulated experience and knowledge in the previous events, the emphasis on the doctoral candidates experience and views within the DDDr programmes will play a key role both in the formulation and validation of the future recommendations within the project’s third phase, namely the FRAMEWORK.

DELFT RESEARCH CULTURE
As one of the largest architecture faculties in Europe, DELFT has a specific focus on design-oriented research. Combining the experience of many practitioners involved not only in education but also tied to the culture of scientific inquiry, the research programme regards the architectural project as the junction where a complex combination of cultural, social, functional, economic and ecological factors is articulated as a concrete spatial proposal. In this respect, the multi-disciplinary character of the education community at DELFT with diverse fields of expertise will provide an extensive platform to address the design-driven doctoral research entailing different types of outputs. The event will consist of keynotes, panels, workshops and round-table discussions. The exchange between the local PhD researchers and DDDr researchers’ experience combined with the evaluators’/supervisors’ will form the pivotal axis of the event. The panels will be complemented with round-table discussions, and case-specific learning/supervision presentations to help draw the guidelines for the final panel/workshop which the program leaders/participants conclude with the Charter of Recommendations for DDDr within and beyond EU.