AI Tool for Linguistic & Psychometric Assessment of Soft Skills from Meeting Recordings

Local Chapter Hyderabad, India Chapter

Coordinated byIndia ,

Status: Completed

Project Duration: 28 Feb 2023 - 02 Apr 2023

Open Source resources available from this project

Project background.

We live in the knowledge economy and skills are your card. Some estimates state that 50% of the jobs will be affected due to automation by 2030. Non-routine cognitive skills, often described as “soft skills”, have been increasing in importance since the first industrial revolution. Soft skills have the potential to provide the only long-term competitive advantage in the job market of the future, and open up equal opportunities to culturally-diverse remote employees. At the same time, soft skills are the hardest to learn due to their abstract nature and context-dependency. The traditional coaching platforms are unscalable by design. Online learning marketplaces and MOOCs provide content that does not stick. Self-improvement apps add up to daily distractions and fail to maintain engagement.

Edtech Startup is a tech-enabled skill development tool for companies, aimed to help engineers get skills, like self-confidence, self-awareness, empathy, communication, influencing, taking ownership, with the use of technology. Edtech is going to connect all the learning tools & knowledge sources by automatically fetching user’s content, recommendations and insights into the Edtech learning pipeline. Then, it will help users act on them in the context of their life through a customizable mix of tools e.g., spaced-out notifications, self-reflection, community Q&As, speed-dating with peers. To put it in more context, we provide one source of truth around soft skills with a repository of resources, definitions and recipes on achieving goals.

The problem.

Omdena Hyderabad Local Chapter is working on a product that can evaluate meeting recordings and provide quantitative, personalised feedback on soft skills of each participant along with recommendations to develop their skills throughout their professional journey.

A model for assessing communication skills from audio files and a framework for extracting byte sized recommendations for various soft skills from online forums have been built as part of past local chapter challenges.

In order to get a holistic perspective of a person’s ability, it is important to consider the other essential soft skills such as interpersonal skills, leadership skills, adaptability, collaboration, empathy, adaptability, critical thinking, conflict resolution, and time management. 

Assessment of the aforementioned soft skills from meeting recordings requires inputs from experts in domains such as linguistics and psychology in order to identify the different qualifying features that can be extracted from audio signals, mapped to appropriate soft skills and fed to the machine learning pipeline built in past challenges.

Project goals.

- Linguists, Soft Skill / Voice Trainers interested in building ML models for their domain areas. - Psychologists / Counsellors interested in building ML models for their domain areas. - Researchers interested in quantifying soft skills from audio signals.The deliverables from the challenge:- Audio-based linguistic and psychometric features for evaluation of soft skills. - Integrated soft skill assessment pipeline and recommendation pipeline.

Project plan.

  • Week 1

    Data Collection

  • Week 2

    Data Pre-processing & EDA

  • Week 3

    NLP model building/ Pre-training

  • Week 4

    Model Deployment / MVP

Learning outcomes.

– Audio Signal Processing & Feature Extraction.
– Natural Language Processing.
– Machine Learning Techniques, Model Deployment.

Share project on: