Text to Speech Integration Instructions

Sun, Yijia

Wen, Yili

Wilson, Victoria

Yang, Ellen

Zhou, Zelo

The Choir:

Example: 40 people show up to a performance. Using the SADISS app on their phones, they register via 4 different QR-codes. With 10 audience members having scanned each one of the 4 QR-codes, we have just created four sub-groups (or voices) of 10 members each.

Using headphones, the audience turned (co-)performers listen to pitches to sing/hum and (via text-to-speech synthesis) spoken instructions to follow. This potentially enables us to have the group of people sing 4-part harmonies and/or perform different actions while doing so.

In 'choir' mode for each SADISS voice an individual QR code is created:

https://user-images.githubusercontent.com/110396146/261796757-fd518b48-57f4-45c9-a19e-624a8360d84f.png

‘choir’ mode establishes stable relationships between partial & TTS voice and individual client (determined by QR scanned):

https://user-images.githubusercontent.com/110396146/261796740-fb630d10-92ba-4ef7-a835-23580ca84628.png

While SADISS builds on one central approach, that is bundling of smartphones into orchestras by distributing different partials and text-to-speech items to be synthesized, quite a lot of different use cases ranging from music to theatre and public intervetion can be imagined.

Tracks

Tracks contain the information necessary for audio and and Text-To-Speech synthesis. To create a new track you will have to upload a .txt file containing the partials to be synthesised by the clients as well as the .SRT-files for the Text-To-Speech synthesis. It is possible for a track to contain only partial- or TTS-information.

Performances

A SADISS performance is a collection of tracks, which can be can be started, stopped or looped from within it. The SADISS clients are linked to a specific performance via the QR-code(s) scanned at the venue.

Audio synthesis can use the following waveforms: sine, square, saw, triangle

How to create and edit partial files for audio synthesis: Sound system instructions

How to create SRT files: Text To Speech Instructions

In choir mode, you will have to upload partial- and SRT-files for each voice individually. For choir tracks containing more than one language, for each voice a seperate SRT file for each language will be required.

SADISS tracks are arranged in performances.

QR-Codes

SADISS uses information encoded in QR-Codes to link a client's app to a specific performance. The QR codes to be scanned using the SADISS client apps are to be generated from within the 'performance' page of the performance interface.

SADISS QR-Codes contain information on:

More on the generation of QR-Codes within SADISS.