Detailed description of project

The safewithCARMEN project introduces an innovative, AI-powered platform designed to monitor and enhance workplace safety, preventing accidents with precision and real-time intervention. By integrating advanced technologies like biometric sensors, Artificial Intelligence (AI), Large Language Models (LLMs), and Augmented Reality (AR), safewithCARMEN monitors the correct use of Personal Protective Equipment (PPE) and the real-time health status of workers. The system leverages data from smart wearables and environmental sensors to create a holistic view of worker well-being and identify high-risk situations. A key differentiator of safewithCARMEN is its context-aware alert system, which triggers alarms only when non-compliance with PPE occurs during high-risk tasks, minimizing false positives. The project contributes to a safer work environment by providing actionable insights for proactive risk mitigation, ensuring compliance, and supporting the physical and mental well-being of workers in hazardous industries.

Type and scope of work provided

• Development of an integrated digital platform combining AI, biometric sensors, LLMs, and AR.

• Real-time collection and analysis of biometric data from smart wearables (e.g., heart rate, body temperature).

• Design of predictive models for automated recognition of worker activity and emotional state to assess risk levels.

• Integration of Large Language Models (LLMs) for hands-free, voice-activated communication between workers and the system.

• Deployment of an Augmented Reality (AR) application on smart glasses for real-time monitoring and alerts for supervisors.

• Implementation of privacy-preserving techniques, including Federated Learning, to protect sensitive worker data.

safewithCARMEN empowers organizations with a proactive safety management tool, bridging real-time data collection with predictive insights to enhance worker safety, ensure regulatory compliance, foster a culture of prevention, and in the same time improve the performance of the workers. Its scalable architecture allows for application across various high-risk sectors, making it a powerful tool for occupational health and safety.

 Project Website : https://safewithcarmen.dotsoft.gr/

Co‐financed by the European Union and Greek national funds through the Program COMPETITIVENESS  under the call RESEARCH –INNOVATE (project code: ΕΚΠΑΡ03-0041465)