Branislav Popović, Ph.D.
Projects
Projects (International)

"ELOQUENCE: Multilingual and Cross-Cultural Interactions for Context-Aware, and Bias-Controlled Dialogue Systems for Safety-Critical Applications", Grant agreement ID 101135916

Financier: HORIZON-CL4-2023-HUMAN-01-CNECT
Duration: January 1, 2024 - December 31, 2026

Project coordinator: Telefonica Investigacion y Desarrollo SA, Madrid, Spain (16 partners)

Summary: ELOQUENCE is focused on the research and development of innovative technologies for collaborative voice/chat bots. ELOQUENCE’s key objective is to better comprehend those unstructured dialogues and translate them into explainable, safe, knowledge-grounded, trustworthy and bias-controlled language models. We envision to develop a technology capable of learning by its own, by adapting from a very data-limited corpora to efficiently support most of the EU languages; from a sustainable computational framework to efficient and green-power architectures, which, in essence, may serve as a guidance for all European citizens whilst being respectful and showing the best of our European values, specifically supporting safety-critical applications by involving humans-in-the-loop.

"MARVEL: Multimodal Extreme Scale Data Analytics for Smart Cities Environments", Grant agreement ID 957337

Financier: H2020-EU.2.1.1.
Duration: January 1, 2021 - December 31, 2023

Project coordinator: Foundation for Research and Technology Hellas (17 partners)

Summary: MARVEL delivers a disruptive Edge-to-Fog-to-Cloud ubiquitous computing framework that enables multi-modal perception and intelligence for audio-visual scene recognition and event detection in a smart city environment. MARVEL aims to collect, analyse and data mine multi-modal audio-visual data streams of a Smart City and help decision makers to improve the quality of life and services to the citizens without violating ethical and privacy limits in an AI-responsible manner.

"MEDICTA: Development of Systems for Dictation of Medical Findings in Bosnian/Croatian/Serbian including Latin Expressions", Grant agreement no. 825003

Financier: Horizon 2020, DIH-HERO Technology Transfer Experiment Call 2020
Duration: 2021 - 2022

Project coordinator: AlfaNum, Novi Sad, Serbia

Project partners:

Summary: The project is aimed at the development of systems for automatic recognition of dictated medical findings and their conversion into textual form in Bosnian/Croatian/Serbian, including Latin expressions, in order to increase the productivity of medical practitioners and the quality of service offered to patients.

"SENVIBE: Strengthening Educational Capacities by Building Competences and Cooperation in the Field of Noise and Vibration Engineering", no. 598241-EPP-1-2018-1-RS-EPPKA2-CBHE-JP

Financier: ERASMUS+
Duration: November 15, 2018 - November 14, 2022

Project partners:

Summary: In line with the Erasmus+ programme priorities and the needs identified in Serbia with regards to ongoing EU integration strategies and harmonization, this project aims to modernize the existing curricula and to develop new educational programmes in the fields of noise and vibration engineering, environmental protection and occupational safety. Moreover, the project aims at establishing a central hub for strategic networking and cooperation among the key stakeholders in the field: academia, industry and local and national authorities.

"DANSPLAT: A Platform for the Applications of Speech Technologies on Smartphones for the Languages of the Danube Region", id Е! 9944

Financier: EUREKA
Duration: January 1, 2016 - January 1, 2019

Project partners:

Summary: The project will give rise to a synergy and the exchange of experience, resources and knowledge between partners, in order to develop a platform for a range of useful applications of speech technologies on mobile devices, using different operating systems, adaptable to the needs of different types of users, from different languages, to the persons with complex communication needs.

"SP2: SCOPES Project on Speech Prosody", SNSF no. IZ73Z0_152495

Financiers: Swiss National Science Foundation (SNFS), Swiss Agency for Development and Cooperation (SDC)
Duration: April 1, 2014 - March 31, 2016

Project partners:

Summary: The four partners aim to collaborate on the subject of speech prosody and advance the extraction, processing, modeling and transfer of prosody for a large portfolio of European languages: French, German, Italian, English, Hungarian, Serbian, Croatian, Bosnian, Montenegrin and Macedonian. Through the intertwined four research plans, synergies are foreseen to emerge that will build a foundation for submitting strong joint proposals for EU funding.

"S-VERIFY: Advanced Speaker Verification", id Е! 8719

Financier: EUREKA
Duration: January 1, 2014 - September 1, 2016

Project partners:

Summary: The S-VERIFY project will research and develop innovative biometric speaker verification technologies and products with advanced session variability compensation capabilities.

Projects (Serbia)

"AI-SPEAK: Multimodal Multilingual Human-Machine Speech Communication", Grant No. 7449, SFRS

Financier: Science Fund of the Republic of Serbia
Duration: January 1, 2024 - December 31, 2026

Summary: The project focuses on the development of advanced machine learning algorithms in the field of human-machine audio-visual speech communication. The research will rely on two multilingual audio-visual speech corpora that will be developed within the project (one recorded in controlled conditions and the other based on videos collected from the Internet), and it will be based on state-of-the-art methods in artificial intelligence, including deep learning feature extraction, as well as temporal modelling by recurrent neural networks or temporal convolutional networks. The multilinguality of the developed models refers to the fact that they will be able to combine training data in multiple languages and to recognize and synthesize speech in any of them. The models will be evaluated through implementation of audio-visual speech recognition and synthesis into two existing speech technology products for Serbian, but will be applicable to any language.

"S-ADAPT: Speaker/Style Adaptation for Digital Voice Assistants Based on Image Processing Methods", Grant No. 6524560, SFRS

Financier: Science Fund of the Republic of Serbia
Duration: September 1, 2020 - February 28, 2023

Project partners:

Summary: The project will investigate methods used in deep-learning based image processing and apply them to speech in order to increase the functionality of digital voice assistants, which rely on the technologies of automatic speech recognition (ASR) and text-to-speech synthesis (TTS). The project will specifically aim at achieving full flexibility of the only existing digital voice assistant application in Serbian, which, in terms of ASR, refers to the ability of the application to adapt to voices of different speakers, speaking styles and recording conditions (microphone, ambience noise), while in terms of TTS it refers to the possibility of producing synthetic speech in an arbitrary voice and in an arbitrary speaking style. To this aim, the project will exploit cutting-edge image style transfer methods based on domain adaptation, which are known for their modest requirements for style-specific data, and thus are efficient in real-life scenarios.

"Innovative Scientific and Artistic Research from the Faculty of Technical Sciences Activity Domain", MESTD No. 451-03-68/2020-14/200156

Financier: Ministry of Education, Science and Technological Development, Republic of Serbia
Duration: January 2020 - Present

Summary: According to the Contract on the Implementation and Financing of the Scientific-Research Work of the Scientific-Research Organizations in 2020, filed on the FTS under the number: 01-209 / 21-1, January 28, 2020, concluded between the Faculty of Technical Sciences and the Ministry of Education, Science and Technological Development of the Republic Of Serbia. The project includes a program of basic research, integrated and interdisciplinary research and a research program in the field of technological development.

"Development of Dialogue Systems for Serbian and Other South Slavic Languages", id TR32035

Financier: Ministry of Education, Science and Technological Development, Republic of Serbia
Duration: January 2011 - December 2019

Project partners:

Summary: Dialogue systems represent computer systems whose primary purpose is to communicate with the user in a way that is as close to natural human communication as possible. A dialogue system can combine text, speech and other communication elements both at its input and its output. There are huge possibilities for their application, out of which some of the most important provide information, issuing commands, assistive systems, as well as applications in education, health services and many more. Dialogue systems rely heavily on so-called speech and language technologies, and that is the leverage of the project team for the development of these systems.

"Automatic Speech Recognition System for Dictating Medical Findings", Contract no. 404.3-399/19

Client: Pension and Disability Insurance Fund, Belgrade, Serbia
Supplier: AlfaNum, Novi Sad, Srbija
Duration: August 2019 - December 2020

Summary: Implementation and verification of the automatic speech recognition system for dictating medical findings in the manufacturing and development environment, training of key users for proper use of the system.

"Central Audio-Library of the University of Novi Sad (CABUNS)", PSNTR No. 114-451-2570/2016-02

Financier: Provincial Secretariat for Science and Technological Development, Autonomous Province of Vojvodina, Republic of Serbia
Duration: May 2016 - March 2020

Project partners:

Summary: The aim of this project is to create an innovative audio-library, aimed for the students and teachers of the University of Novi Sad and other universities in the region.

"Audio Library for the Disabled (ABOSI)", PSNTR No. 114-451-2210/2011-04

Financier: Provincial Secretariat for Science and Technological Development, Autonomous Province of Vojvodina, Republic of Serbia
Duration: 2011 - 2015 (engaged May 2015 - December 2015)

Name of institution:

Summary: The development of speech technologies, intelligent and expressive dialogue systems for personal computers, mobile phones and tablets.

"Human-Machine Speech Communication", id TR11001

Financier: Ministry of Education and Science, Republic of Serbia
Duration: 2008 - 2010 (engaged October 2009 - December 2010)

Project partners:

Summary: The process of speech communication between humans and machines is based on automatic speech recognition (ASR) and text-to-speech (TTS) systems. Activities on this project were directed towards a deeper analysis of all problems in this kind of communication in both directions (from human to machine and vice versa), analysis of mathematical models and applied algorithms.

Branislav Popović ©