{"id":1011,"date":"2012-02-03T17:49:06","date_gmt":"2012-02-03T16:49:06","guid":{"rendered":"http:\/\/blog.soton.ac.uk\/depositmo\/?p=1011"},"modified":"2012-02-03T17:49:06","modified_gmt":"2012-02-03T16:49:06","slug":"user-testing-results-4-what-users-said","status":"publish","type":"post","link":"https:\/\/blog.soton.ac.uk\/depositmo\/2012\/02\/03\/user-testing-results-4-what-users-said\/","title":{"rendered":"User testing results 4: what users said"},"content":{"rendered":"

\"\"<\/a>We are about to complete the results of the user tests of the novel and original repository deposit tools developed in the DepositMO project.<\/p>\n

Based on the tests we have a number of ways to analyse the results.\u00a0Previously we considered what the timings and task completion<\/a> tell us about the usability of the deposit tools, and what users did<\/a>, based on the observer notes and an assessment of the repository records they created. Here we discover what they thought of the tools they were testing, prompted by a series of questions in the user’s\u00a0test documentation and placed to be answered immediately at the conclusion of the practical part of the test.<\/p>\n

We present just the summary results and selected extracts from this user feedback, so we do not have another over-extended post. If you wish to see the unexpurgated comments, here is the original report of the full test results<\/a> (pdf).<\/p>\n

Summary results<\/h2>\n

1 Would these tools encourage you to deposit more of your own content in a repository?<\/em><\/p>\n

Yes (8) No (5)<\/p>\n

2 Would these tools encourage you to deposit types of content that you have not previously deposited in a repository? Which type?<\/em><\/p>\n

Yes 5 (inc. images, multiple presentations\/teaching resources, computing files) No (6) ? (2)<\/p>\n

3 Which of the two new deposit tools (in Word, and in the file manager) used here are you likely to use if it was generally available? <\/em><\/p>\n

Word (7), File manager (1), both (3), neither (1), repository (1)<\/p>\n

6 Or are you more likely to continue to use the standard repository deposit interface?<\/em><\/p>\n

Yes (6), No (0), ? (4), N\/A (3)<\/p>\n

These summary results suggest that on balance use of these tools might encourage more deposit, just, most clearly in the case of the Word tool, but it won\u2019t be so easy to wean users off the standard repository deposit interface on the basis of these tools.<\/p>\n

Selected extracts from fully transcribed results<\/h2>\n

Here are some extracts to provide a flavour of the user comments. These are not intended to be fully representative, for which please refer to summary results above and the full test results document.<\/p>\n

1 Would these tools encourage you to deposit more of your own content in a repository?<\/em><\/p>\n

User2 (EdShare) Yes For me the Word<\/strong> tool. The MO (file manager<\/strong>) deposit was initially exciting but the difficulty of differentiating between many files was frustrating as filenames were not carried over. The updating via Word<\/strong> for single files and also the addition of new items via MO leading to either loss or overwriting of previous metadata is v. frustrating.<\/p>\n

User 3\/1 (Library) The Word<\/strong> deposit seems very simple, provided it\u2019s easy to get the DepositMO add-in. I would like to know if I need to construct my Word<\/strong> docs in a particular way. Image deposit (file manager<\/strong>) seemed complicated and a bit confusing \u2013 not sure I\u2019d use this.<\/p>\n

User 5\/1 (Kultivate) If uploading\u00a0Word<\/strong> files would definitely use the DepositMO tool. Not sure\u00a0about other content.<\/p>\n

2 Would these tools encourage you to deposit types of content that you have not previously deposited in a repository? Which type?<\/em><\/p>\n

User 1\/1 (EdShare) No. Folder <\/strong>deposit confusing<\/p>\n

User 1\/2 (EdShare) No. Word<\/strong> integration confusing<\/p>\n

User 3\/2 (Library) In theory \u2013 yes \u2013 but possibly only Word<\/strong> as that was easiest!<\/p>\n

User 5\/2 (Kultivate) I think yes for PDFs (and Word<\/strong> docs) \u2013 of course the images still seem to require more work\/metadata<\/p>\n

3 Which of the two new deposit tools (in Word, and in the file manager) used here are you likely to use if it was generally available? <\/em><\/p>\n

User 1 (EdShare) File manager<\/strong>. Word version confusing in version control, settings and location of files<\/p>\n

User 6\/1 (Archaeology) The Word<\/strong> one is nicer and a good idea, but all are confusing<\/p>\n

User 7\/2 (Archaeology) Word<\/strong> was very useful for text. The file manager<\/strong> was good for images but possibly required a bit more prior knowledge.<\/p>\n

4 How would you improve either of the tools?<\/em><\/p>\n

User 1\/2 (EdShare) Make actions of file manager<\/strong> clearer (what is being updated and where)<\/p>\n

User 2 (EdShare) More metadata extracted from original file e.g. title from name, creator from owner (if available) and also type (Word<\/strong> added-both showed as HTML files)<\/p>\n

User 3\/1 (Library) Word<\/strong> \u2013 I wouldn\u2019t require user to add\/edit URL; Image \u2013 I think this needs to be made more user friendly<\/p>\n

User 3\/2 (Library) Metadata requirement (i.e. having to add title in HTML) in file manager<\/strong> prob off-putting to some.<\/p>\n

5 Are there features of the new deposit tools that would deter you from using them for repository deposit?<\/em><\/p>\n

User 2 (EdShare) Overwriting metadata which had been hand-edited when updating or adding additional files is a real turn-off.<\/p>\n

User 3\/1 (Library) Image deposit is too complicated. I wouldn\u2019t remember the URL needed for Word<\/strong> deposit<\/p>\n

User 3\/2 (Library) I have nothing to compare this with, but I did find too many windows open caused a degree of confusion<\/p>\n

User 5\/1 (Kultivate) With uploading images etc \u2026 I think the time taken in standard way is about the same, due to adding metadata. I think the \u2018watch folders<\/strong>\u2019 idea is brilliant but needs to be developed further.<\/p>\n

User 6\/2 (Archaeology) The fact that each file\u2019s metadata had to be in its own folder with that file -> hard to deposit large directories of files.<\/p>\n

6 Or are you more likely to continue to use the standard repository deposit interface?<\/em><\/p>\n

User 1\/2 (EdShare) Yes. Better\/clearer control. Less ambiguous.<\/p>\n

User 2 (EdShare) Would like to be able to use the new deposit tools more as the traditional, although v. good for library geeks like me, is long-winded for the normal academic.<\/p>\n

User 6\/1 (Archaeology) I think yes because it is proven to be efficient<\/p>\n

Any other comments?<\/em><\/p>\n

User 5\/2 (Kultivate) Really helpful for documents \u2013 I can see that for repository managers and even self-depositors this could be helpful, saving quite a bit of time.<\/p>\n

User 6\/1 (Archaeology) Good ideas but they are not easy enough to use. They seem slow and frustrating.<\/p>\n

Once again, we thank our users for engaging fully with these tests, for the time and effort they gave to participate, for their rigour and objectivity. As we saw earlier in the live audience demonstrators<\/a>, it’s when you put software tools in front of users that they come to life.<\/p>\n

Our test users were:\u00a0I. Atkins,\u00a0Joy Caisley,\u00a0Grant Cox,\u00a0David Davies,\u00a0Helena Dmetriou,\u00a0Harry Gibbs,\u00a0Nick Graffy,\u00a0Marie-Therese Gramstadt,\u00a0Matthew Harrison,\u00a0Alisa Miller,\u00a0John O’Hagan,\u00a0Isobel Stark and\u00a0Adam Warren.<\/p>\n

I must also thank the organisers of the user test teams, who doubled as test observers to report on individual tests. Our observers were: Penny Copeland,\u00a0Debra Morris and\u00a0Kate Walker.<\/p>\n

This completes the recorded results from the DepositMO user testing. In the remaining posts, as the project ends we will seek to draw some lessons and conclusions from the tests and from the project overall. These will be our interpretations of the results. If you have a view on these results and what they might tell us about the deposit tools developed by the project, or on the prospects and needs for future repository deposit tools, please leave a comment.<\/p>\n","protected":false},"excerpt":{"rendered":"

We are about to complete the results of the user tests of the novel and original repository deposit tools developed in the DepositMO project. Based on the tests we have a number of ways to analyse the results.\u00a0Previously we considered what the timings and task completion tell us about the usability of the deposit tools, […]<\/p>\n","protected":false},"author":25,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[332,334,143,15641,15648,341],"class_list":["post-1011","post","type-post","status-publish","format-standard","hentry","category-uncategorized","tag-depositmo","tag-inf11","tag-jisc","tag-user-testing","tag-user-testing-results","tag-users"],"_links":{"self":[{"href":"https:\/\/blog.soton.ac.uk\/depositmo\/wp-json\/wp\/v2\/posts\/1011","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.soton.ac.uk\/depositmo\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.soton.ac.uk\/depositmo\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/depositmo\/wp-json\/wp\/v2\/users\/25"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/depositmo\/wp-json\/wp\/v2\/comments?post=1011"}],"version-history":[{"count":24,"href":"https:\/\/blog.soton.ac.uk\/depositmo\/wp-json\/wp\/v2\/posts\/1011\/revisions"}],"predecessor-version":[{"id":1115,"href":"https:\/\/blog.soton.ac.uk\/depositmo\/wp-json\/wp\/v2\/posts\/1011\/revisions\/1115"}],"wp:attachment":[{"href":"https:\/\/blog.soton.ac.uk\/depositmo\/wp-json\/wp\/v2\/media?parent=1011"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/depositmo\/wp-json\/wp\/v2\/categories?post=1011"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/depositmo\/wp-json\/wp\/v2\/tags?post=1011"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}