Here we are building a template, or checklist, to help team members document their experiences using a technology, assess its potential fit and usefulness for the project, and capture early insights about what works, what doesn’t, and why. Please add questions and prompts that seem valuable.
Checklist template
Initial Impressions
Functionality Assessment
Which key features did you test? List them and provide brief comments on each.
E.g. Create account. Log on with an existing account. Create a post. Reply to / comment on others' posts. Like or vote on others' posts or comments. Moderate content or submissions. Upload images. View images. Search for content, users or communities. Interact with users or communities on other instances. Change password.
[Repeat as required]
Expected Features
User Experience
What aspects of the user experience did you find particularly good?
How intuitive is it to navigate and use?
Did you encounter anything confusing when using the system?
Comments on how easy the system is to learn?
Anything that might confuse users who are not tech savvy?
Potential Benefits
What are the top 3 benefits you see for this technology as a digital public square?
Item
Item
Item
How do you envisage individuals in Merri-bek might make good use of this technology?
How do you envisage Merri-bek groups might make good use of this technology?
Can you envisage any further innovative uses of this particular technology?
In what ways do you think this technology is a good fit for our project?
Challenges and concerns
What are the top 3 challenges or concerns you have about this technology?
Item
Item
Item
Are there any potential roadblocks to implementation you foresee?
Can you envisage potential undesirable uses of this particular technology?
Do you have any concerns about long-term viability or scalability relating to this technology specifically?
Is additional configuration critical for this particular technology to be useful or useable?
Privacy and Data Handling
Do you have concerns about privacy or security?
How does the technology handle data storage and management?
How easy was it to backup and restore data (if applicable)?
Comparisons
Have you used similar technologies before? Which? How does this one compare?
On a scale of 1-10, how likely would you be to recommend adopting this technology?
What are your main reasons for this recommendation?
Configuration and Flexibility
If relevant
What features did you use related to configuration or customisation?
Comments on configuration and customisation:
Did you encounter limitations or challenges relating to configuration and customisation?
Documentation, Support and Maintenance
If relevant
Comments on documentation and support available?
Comments on the technology's likely future development (e.g. size of dev team, how long the project has been in development, current version, active development and enhancement pipelines, responsiveness to bug reports.)