The Memoria-Mea project aims to develop a PIM (Personal Information Management) system for managing multimedia content. It focuses on supporting a person in organizing and retrieving information across the whole collection of multimedia documents he/she has accessed and collected during daily life activities.
The system will support the user in searching, browsing and visualizing “multimedia memories” (e.g. pictures, videos, audio file, text file, etc.) according to his/her preferences, context, etc. thanks to the use of personalized information indexing and classification techniques based on a semantic model.
Whereas current multimedia search engines are designed for very large applications and large user community, the novelty of Memoria-Mea project is to support the individual memory, i.e. personal environments and data, by extending existing information retrieval and visualization techniques with cross-modal data mining and ontological models, based on user behavior and needs.
The goal of Memoria-Mea is to investigate towards a personal memory organizer. Memoria-Mea will support an individual person in organizing and retrieving all the multimedia information accessed during his/her daily life. It will automatically log, store, classify and index multimedia memories and further support searching and browsing according to user preferences, context, etc.
Whereas current multimedia search engines are designed for very large applications and large user community, the novelty of Memoria-Mea project is to support the individual memory, i.e. personal environments and data, by extending existing information retrieval and visualization techniques with cross-modal data mining, based on user behavior.
The Memoria-Mea project will be split into the following major research challenges:
Our goal, which is truly innovative, is to combine these three research approaches to enrich and simplify user experience for searching and browsing through personal multimedia data, daily collected across various devices. The proof of concept of the project will be driven by two major use case scenarios (traveller use case and member-of-a-parliament use case), defined in the first project phase, which will be fully integrated in a final demonstrator.
Several demonstrators have been developed within the framework of the project (refer to the images tab to access the figures):
1 - A mobile application for face detection (Fig. a);
2 - An application offering multiple visualizations for different kind of media (e.g. text file, images, etc.) allowing users to easily browse and retrieve information (Fig. b);
3 - An ontology-based annotation system (Fig. c);
4 - A datamining application to automatically cluster data (Fig. d). Demos are available on the http://www.memoria-mea.ch/Pages/Demos.aspx
Human Computer Interaction (HCI) is the study of interaction between people (users) and computers. A basic goal of HCI is to improve the interaction between users and computers by making computers more user-friendly and receptive to the user's needs. Specifically, a long term goal of HCI is to design systems that minimize the barrier between the human's cognitive model of what they want to accomplish and the computer's understanding of the user's task.
Information management is the handling of information acquired by one or many disparate sources in a way that optimizes access by all who have a share in that information or a right to that information. It refers to the acquisition, organization, control, dissemination and use of information.
User-Centered Design (UCD) is a design philosophy and a process in which the needs, wants, and limitations of the end user of an interface or document are given extensive attention at each stage of the design process. User-centered design can be characterized as a multi-stage problem solving process that not only requires designers to analyze and foresee how users are likely to use an interface, but to test the validity of their assumptions with regards to user behaviour in real world tests with actual users. Such testing is necessary as it is often very difficult for the designers of an interface to understand intuitively what a first-time user of their design experiences, and what each user's learning curve may look like.
Expected outcomes for Memoria-Mea project are: