• Keine Ergebnisse gefunden

4.4 Evaluation of the concept of thinXels

4.4.2 Experiment results

use the presented principle independently for twenty-eight minutes to create new ideas without any further instructions from the facilitator. During this phase, the groupware technology provides the possibility to jump freely between the presented process steps of the mental principle Jumping. The facilitation script of this experiment is defined as follows:

Phase 1: Exercise the mental principle jumping Step 01 Which attributes (problem, people, and process) do

you associate with a citizens advice bureau?

02 Minutes Step 02 Which institution has the same attribute? 02 Minutes Step 03 Which service idea is offered by this institution? 02 Minutes Step 04 Which new service idea can be adapted to the

citi-zens advice bureau?

02 Minutes

Phase 2: Apply the mental principle jumping Step 05 Use this creativity technique in the presented way,

to create new service ideas for a citizens advice bu-reau.

28 Minutes

The thesis assumes that this complex facilitation script can lead to a loss of attention by the participants for the intended collaboration process. This could have a negative effect on the efficiently execution of the intended collaboration process.

ExperimentE-1:contributionsresultingfromtheprocesssteps01,05and09 GroupG-1GroupG-2GroupG-3 ParticipantP-01P-02P-03P-04P-05P-06P-07P-08P-09MSD focusprocess0806170405050404107,004,27 focusproblem1203100404040405086,003,20 focusperson1305160411020304178,335,92 ExperimentE-2:contributionsresultingfromtheprocessstep01 GroupG-4GroupG-5GroupG-6 ParticipantP-10P-11P-12P-12P-14P-15P-16P-17P-18MSD focusprocess0804070720230001058,337,97 focusproblem0303100407030907065,782,68 focusperson0201010208010202022,332,18 ExperimentE-3:contributionsresultingfromtheprocessstep01 GroupG-7GroupG-8GroupG-9 ParticipantP-19P-20P-21P-22P-23P-24P-25P-26P-27MSD focusprocess0201020307050604013,442,19 focusproblem0403030206020403033,001,73 focusperson0002000201020202001,220,97 Table4.2:ExperimentE-1,E-2andE-3:contributionsgeneratedforthethreefociprocess,problemandperson

ExperimentE-1:serviceideasresultingfromtheprocesssteps04,08and12 GroupG-1GroupG-2GroupG-3 ParticipantP-01P-02P-03P-04P-05P-06P-07P-08P-09MSD focusprocess0603050404040101084,002,24 focusproblem0606050607090102095,672,74 focusperson0704030302040502084,222,11 ExperimentE-2:serviceideasresultingfromtheprocessstep04 GroupG-4GroupG-5GroupG-6 ParticipantP-10P-11P-12P-12P-14P-15P-16P-17P-18MSD focusprocess0501070406080200023,892,80 focusproblem1204040002010504074,333,57 focusperson0100000609100002003,114,11 ExperimentE-3:serviceideasresultingfromtheprocessstep04 GroupG-7GroupG-8GroupG-9 ParticipantP-19P-20P-21P-22P-23P-24P-25P-26P-27MSD focusprocess11242519263707030617,5611,45 focusproblem0002020001021703053,565,27 focusperson0205030201061007004,003,24 Table4.3:ExperimentE-1,E-2andE-3:serviceideasgeneratedforthethreefociprocess,problemandperson

ExperimentE-1:timeintervalbetweentwocontributions GroupG-1GroupG-2GroupG-3 ParticipantP-01P-02P-03P-04P-05P-06P-07P-08P-09MSD mean(M)00:1900:2600:1700:4400:2900:3600:4400:4400:1800:3100:12 standarddeviation(SD)00:1600:3500:1900:3800:3000:3500:4000:3800:12 ExperimentE-2:timeintervalbetweentwocontributions GroupG-4GroupG-5GroupG-6 ParticipantP-10P-11P-12P-12P-14P-15P-16P-17P-18MSD mean(M)00:3000:4500:3200:2900:1200:2600:3600:4000:3600:3200:09 standarddeviation(SD)00:2300:4700:2100:2700:1100:2100:3200:3600:28 ExperimentE-3:timeintervalbetweentwocontributions GroupG-7GroupG-8GroupG-9 ParticipantP-19P-20P-21P-22P-23P-24P-25P-26P-27MSD mean(M)00:3400:2600:5100:5000:2600:2600:2500:3200:5200:3600:12 standarddeviation(SD)00:5900:2400:3601:0600:2800:2100:2100:2000:44 Table4.4:ExperimentE-1,E-2andE-3:resultingtimeintervalbetweentwoconcepts

No communication between the group participants was detected during the experiment E-1. The evaluation of the questionnaire shows that the participants understood the facilitator instruction (M: 1.33 SD: 0.5), and always knew what they were supposed to do (M: 1.44, SD: 0.72). In summary, 192 contributions were generated, which describe problems, persons and processes of the citizens advice bureau. The participants used analogies from each of the three foci to create 125 new service ideas for the citizens advice bureau (Group G-1: 45 ideas, Group G-2: 43 ideas and Group G-3: 37 ideas).

The mean for the time interval between two concepts was 31 seconds for all partici-pants.

During experiment E-2, a process oriented communication between the participants was detected in one of the three groups. Similar to experiment E-1, the participants indicated that they understood the facilitator instruction (M: 1.67 SD: 1.0) and always knew what they were supposed to do (M: 1.78 SD: 0.83). They generated 148 con-tributions that describe problems, persons and processes of the citizens advice bureau.

An analysis of the generated contributions shows a preference of the participants for the foci process and problem. As a result, only three participants used analogies from all of the three foci to generate new service ideas. In summary, the groups generated 102 new service ideas for the citizens advice bureau (Group G-4: 34 ideas, Group G-5:

46 ideas and Group G-6: 22 ideas). The mean for the time interval between two con-tributions was 32 seconds for all participants.

Figure 4.2: Experiment E-3: The activities of the participants in group G-7 (x = time, y = process steps)

During the Experiment E-3, private communication between the participants was de-tected in two of the three groups. The evaluation of the questionnaire shows that the participants understood the facilitator instruction (M: 1.33 SD: 0.5), and always knew what they should do (M: 1.56 SD: 0.53). However, after the training some participants

did not followed the indented collaboration process. Figure 4.2 illustrates this effect for the activities of the participants in group G-7. With the beginning of the second part of the experiment (time stamp 00:08), participant P-21 only used the process step 4 to create new service ideas instead of using the intented mental principle Jumping.

A detail analysis shows that the participant used the generated service ideas in step 4 as stimuli for the generation of new ideas, similar to the classical idea generation tech-nique Brainstorming [Osborn, 1963]. During the whole experiment, 72 concepts were generated that describe problems, persons and processes of the citizens advice bureau.

However, some participants who followed the intended collaboration process did not create concepts for all of the three foci and showed a preference for the focus process.

As a results, 226 service ideas were created (group G-7: 74 ideas, group G-8: 94 ideas and group G-9: 58 ideas). The mean for the time interval between two concepts was for all participants 36 seconds.

The results of the experiments E-1, E-2 and E-3 provide indications to reject the null hypothesis. According to the hypothesis H-1, the thesis assumes that the time inter-val between two concepts will be short during a high attention period to the process.

The analysis shows that no significant difference exists between experiment E-1 and E-2 (E-1: M: 31 seconds, SD: 12 seconds; E-2: M: 32 seconds, SD: 09 seconds), which use atomic or abstract instruction elements to guide the collaboration process.

During experiment E-3 the time gap increases with the decrease of the facilitators in-fluence (E-3: M: 36 seconds, SD: 12 seconds). Some participants misunderstood the intended collaboration process and used a more generic process like the idea gener-ation technique Brainstorming to generate new service ideas. However, they stated that they understood the facilitator instruction and did always knew what they should do. Furthermore, experiment E-3 was the only experiment were private communica-tion between the participants was detected. In conclusion, the research results show no statistically significant to prove the hypothesis H-1, but provide some indications that atomic instruction elements keep the participants more focused on the intended collab-oration process.

The result of the created concepts shows that experiment E-1 (192 concepts) generated much more concepts for the development of new service ideas than experiment E-2 (148 concepts) and E-3 (72 concepts). On the other hand, experiment E-3 (226 service ideas) created more service ideas than the experiments E-1 (125 service ideas) and E-2 (102 service ideas). However, a closer analysis of the service ideas shows that most of the ideas of experiment E-3 are extended versions of other ideas, which were created by the participant themselves. Only experiment E-1 created a well balanced distribution of concepts and service ideas for the provided foci. This result provides some support for the hypothesis H-2 which assumes that a thinXel-based collaboration process is more efficient in executing the intended collaboration process.