We are in the midst of conducting a usability test of Search which is our front-end to Summa. The test is a straight forward usability test where 8 users are invited to try out the system and along the way they are provided with different tasks to ensure that they get around most corners of the site. While the users try it out (one at a time) and solve tasks they are observed and we log as much data as we can both by taking notes under each test and looking through session based log data afterwards. As we are the makers of the system we have hired an external company to prepare and conduct the test to ensure a high degree of impartial results.
It is always useful to “lay it on the line” and let others have a look at your work and tell you what you can do better and what works. We are looking forward to receiving the final report.