I wrote the interview script, arranged and led 9 interviews with Soho Works members, and used Dovetail to qualitatively code the recordings into themes to uncover insights.
Once we had a working prototype, I conducted usability testing on key flows to ensure members could complete key tasks without any major issues.
I used Monzo’s Behavioural Analysis Matrix as a framework for evaluating our flows. This allowed us to focus on whether users were able to successfully complete the flow rather than the subjective feedback that can come out of usability testing.
I recruited 5 Soho Works members to conduct usability testing with and handled all research operations to enable the testing.
Overall, 80% of members were able to complete all flows successfully, which helped raise our confidence that there weren’t any serious blockers in the user flows that we had tested.
Participant 2 was the only participant that was unable to complete the full set of tasks:
They struggled to get through onboarding as they couldn’t figure out how to create a company page (the button looked like a tag).
They were unable to edit their profile as they didn’t recognise the edit icon.
It was decided by the product team that the usability issues participant 2 experienced would be monitored and updates would be made if more users struggled with the same issues.
Usability testing results
What was most interesting about the usability testing for me was actually the attitudinal feedback from members. While Monzo’s Behavioural Analysis Matrix is supposed to focus on people’s behaviours and not their opinions, there were attitudinal insights that emerged from the testing which were worth capturing and discussing.
Insight 1: Swiping to connect feels like dating
During the onboarding flow, users are shown other member profiles and are invited to connect with others by swiping. 5/5 members said the interaction pattern felt intense and unexpected, they did not anticipate a dating app interface on a professional networking app. They also wanted more information on the card to justify connecting with someone.
Insight 2: Networking is very personal, people prefer doing this in private, not on a forum
In light of the feedback that emerged from the usability testing, the product team and CEO prioritised the changes to be actioned before the release of the app.
Changes included:
Adding a ‘Direct message’ button on posts so users can network in private
Adding more information to the cards on the connections swiper
Ability to edit and delete comments
Removing ‘Show all’ button on posts so users can see all replies at once
Ability to tag other members in comments
Ability to filter events by location
The white-label app has launched successfully with Soho Works and is being used by over 40 clients, including Apple Made for Business, Dazed, Frieze and 180 Studios to host their communities.
App metrics:
87% of members invited to join go on to sign up
72% of members remain active, outperforming LinkedIn’s monthly activity of 35%
46% of active members engage with other members monthly
The app also won two Lovie awards in the General-Work & Productivity category.