There will be a proper blog comming soon, honest.
For starters, here's a map of who has taken the quiz so far. (as of Thursday)
This one shows the aggregate confidences assigned to the questions (the red bars) next to the marked responses (the blue bars)
It is interesting to see how they differ on a few questions, but also how well correlated they are too in general. I was expecting to see a more pronounced difference. The other interesting thing seems to be that a few questions are coming up with ≤ 25% answers correct, which would imply that there is a general feeling that the right answer is something other than the one we think it is. If this continues to be the case when there are a few more responses then we'll need to find out why.
There isn't really enough data here to draw anything really conclusive from this graph, but it hints that there might be somethign going on.
It shows the number of questions answered correctly plotted against how much the respondant thought they knew about that subject.
There could well be a lot of factors affecting this, 'a fair bit' is the middle option, and people tend to pick the middle one. It could also be that our questions aren't alligned with the 'facts' that an architect expects to need to know, and therefore if my questions had alligned better with the traditional body of knowledge then there might have been a better correlation (upward slope from left to right).
This graph shows the age distribution of all those who have responded. It stops at 60 at the moment, this isn't because I'm ageist, but just because the oldest person to take the quiz is 56, and if I ran it to 100 for Oscar Niemeyer then there'd just be too much white space. (If Oscar wants to do the quiz, then I'd be more than happy to re-code the site to accomodate him.)
Here's the breakdown of the role and field of people who have responded so far. Unsurprisingly the majority of people who have responded are students and assistants, not surprising given that we soft-launched this site by sending links to our friends. It'll be a much more useful study if we can get a much bigger proportion of associates, directors and owners, so if you know any, then give them a nudge.
There are plenty more graphs coming up when my sanity and enthusiasm for graphs allows!
Finally, if you’ve done the quiz, and you feel bad for not getting too many right, don’t! The average score is currently about 45%, so you probably did better than you think.
