development

Pydata on 2 July

Please select all the ways you would like to hear from Harmony project:

Pydata on 2 July

Harmony at PyData London - 86th Meetup

Update: you can download the slides from the presentation here

Topic: NLP and generative models for psychology research

Thomas Wood will present our work on Harmony, harmonydata.ac.uk, which is a free online tool that uses generative AI and LLMs to help psychologists analyse datasets. It uses Python, Pandas and HuggingFace Sentence Transformers to find similarities between questionnaires.

  • Psychologists and social scientists often have to match items in different questionnaires, such as “I often feel anxious” and “Feeling nervous, anxious or afraid”.

  • This is called harmonisation.

  • Harmonisation is a time consuming and subjective process.

  • Going through long PDFs of questionnaires and putting the questions into Excel is no fun.

  • We’ve been working on an open source Python library and free web tool called Harmony which uses natural language processing and generative AI models to help researchers harmonise questionnaire items, even in different languages.

  • https://pypi.org/project/harmonydata/

  • https://github.com/harmonydata/harmony

Register for Pydata event

Sign up on Meetup

📅 Date: 2 July 2024

🕘 Time: 7pm

🏢 Where: EC4R 3AD

Related Posts

Data Harmonisation in Education

Data Harmonisation in Education

Data Harmonisation in Education: Overview The term ‘harmonisation’ has often been used in different contexts – for example, to describe similar phenomena, such as collaboration, coherence, alignment, integration, partnership, etc. However, we might argue that these concepts might do nothing more than indicate the extent and scale of integration among different entities when it comes to regional cooperation. Now, the underlying degree of interaction between all the players involved can run a lot deeper and tighter when we transition from collaboration, partnership, and cooperation to integration, community, harmonisation, and interdependence.

How To Find Matching and Common Items in Questionnaires and Surveys

How To Find Matching and Common Items in Questionnaires and Surveys

When researchers take on the task of analysing data from surveys and questionnaires, they often encounter a significant obstacle: finding matching or common items across different sources. This challenge is due to the many different ways questions are asked or formatted. This makes it tough to compare and merge data effectively. According to Forbes, researchers spend up to 80% of their time just getting data ready for analysis, and a big part of that time goes into harmonising data.

Signup to our newsletter

The latest news on data harmonisation project.

Please select all the ways you would like to hear from Harmony project:

You can unsubscribe at any time by clicking the link in the footer of our emails. For information about our privacy practices, please visit our website. We use Mailchimp as our marketing platform. By clicking below to subscribe, you acknowledge that your information will be transferred to Mailchimp for processing. Learn more about Mailchimp's privacy practices.