development

Harmony Data Discovery

Please select all the ways you would like to hear from Harmony project:

Harmony Data Discovery

New Feature in Development: Enhancing Harmony with User-Centred Discovery

At Harmony, we’re working on a new feature aimed at making data discovery and exploration - through the use of meta-data - even more efficient and intuitive To ensure this feature addresses real needs, we’re conducting co-design sessions with researchers, data-managers and other users, allowing us to develop a tool that solves real-life user requirements.

The Co-Design Approach: Co-design allows us to build this feature with direct input from those who will use it most. Through these sessions, users and stakeholders participate in shaping the tool, providing detailed feedback, identifying challenges, and contributing their own insights. This process is collaborative by design, creating a feedback loop that helps us address pain points in data discovery and visualisation while ensuring usability.

What problem does Harmony Discovery solve? Researchers can struggle to find datasets and often need something specific, such as a longitudinal study measuring anxiety and household income. Existing repositories don’t always go into the details of which variables have been captured, and finding variables can be a difficult process with a basic keyword search. Harmony Discovery indexes studies, datasets, and variables using the same cutting-edge vector representation used in our harmonisation tool, so that a search for “anxiety” will return studies with the question items “I feel anxious”, “I often feel worried”, and even items in other languages. This is made possible with the latest developments in AI and large language models (LLMs), which allow us to index and retrieve items based on semantic content rather than just matching words.

Key Goals for the New Feature: While the feature is still evolving, our main objective is to understand how researchers search and discover research data and how Harmony can support the decision making process especially when trying to compare meta-data of large or complex datasets. From early feedback, we’ve noted specific needs for adaptability and efficiency in data discovery and comparison, and we’re integrating these priorities into the design of the tool.

Get Involved: If you’re a researcher or data manager interested in participating in our co-design workshops, we’d love to hear from you! Get in touch with us via email, you can also sign up to our Discord server and newsletter and follow us on LinkedIn to stay connected with the latest updates and community discussions.

Harmony is an open source tool for social science research.

Related Posts

Help Design Harmony - UX Design Challenge

Help Design Harmony - UX Design Challenge

Help us design the next phase of Harmony and win up to £300 in vouchers! Search and Results UX/UI Challenge Harmony is a platform for researchers to help them discover and compare complex meta-data across different academic studies. The project is a collaboration between University College London (UCL), The University of Ulster, and Fast Data Science and has been funded by the Economic and Social Research Council (ESRC) and by Wellcome as part of the Wellcome Data Prize in Mental Health.

Winners of the Doxa AI Matching Challenge

Winners of the Doxa AI Matching Challenge

It’s all over! The Matching Challenge is now officially closed. Thank you to everyone who took part. The wait is over! We have now closed the Matching Challenge which was hosted on DOXA AI. Over the course of the competition we saw a total of 26 participants with 14 finalists making it onto the scoreboard. The final days were tense with many participants improving on their scores, submitting different methods and swapping places at the top of the scoreboard.

Signup to our newsletter

The latest news on data harmonisation project.

Please select all the ways you would like to hear from Harmony project:

You can unsubscribe at any time by clicking the link in the footer of our emails. For information about our privacy practices, please visit our website. We use Mailchimp as our marketing platform. By clicking below to subscribe, you acknowledge that your information will be transferred to Mailchimp for processing. Learn more about Mailchimp's privacy practices.