Use aac for voice messages

[marcoambrosini]

• for some reason the mimetype of the message is application/octet-stream instead of audio/mpeg thus it doesn't display properly in the messageslist
• Test on iOS devices

Signed-off-by: Marco Ambrosini [email protected]

[PVince81]

as far I understand, if the type is audio/mpeg then the extension must be .m4a because then it's a mp4 container with only aac audio in it

if we want to use the ".aac" extension instead, the mimetype would be "audio/aac"

[nickvergessen]

This trick is used by both the ios and the android app. But might be it doesn't work with browsers creating such files.

[danxuliu]

The AudioPreview is shown only when the mimetype of the file starts with audio, so either the extension needs to be .m4a or .aac needs to be added to the server mimetype mappings.

[danxuliu]

Oops... I did not refresh before writing; it is the same written below 🤷

[PVince81]

from what I see we don't have the ".aac" extension mapped in the global mime type file.
however, we do have ".m4a" there, so maybe switching to that one will work: https://github.com/nextcloud/server/blob/stable22/resources/config/mimetypemapping.dist.json#L97

but in the mapping file it maps to "audio/mp4" which is yet another string

[nickvergessen]

We don't need to change anything in there server. Android and iOS mobile apps send this files already and they work pretty fine on all devices

[marcoambrosini]

Thanks for the help, works now :)

[nickvergessen]

Now it's not marked as a voice message anymore roll eyes

[nickvergessen]

Also since m4a is not an audio file format, safari doesn't allow playing it in the audio tag.

[nickvergessen]

So, we need to specify the mimeType on the MediaRecorder.

The following works in Safari on iPad, but this works no where else nor does anything else work on Safari:

this.mediaRecorder = new MediaRecorder(this.audioStream, {
					audioBitsPerSecond: 128000,
					videoBitsPerSecond: 0,
					mimeType: 'video/mp4; codecs="mp4a.40.2"',
				})

[nickvergessen]

Safari recoring issue is fixed in #5902

But the files recorded with this PR here still don't play

[nickvergessen]

Hardcore alternate solution

With !MediaRecorder.isTypeSupported('video/mp4; codecs="mp4a.40.2"') we can know if we can produce valid mp3s or not.
When we can (safari) we do as now.

If we can not:

1. We upload to a new other endpoint
2. The endpoint uses local ffmpeg (admin given on the server) and transforms it to mp3, if ffmpeg is not there we show a warning in the admin settings and there is nothing we can do.
3. Puts the mp3 into the Talk/ folder and returns with the path
4. UI continues with the confirmation dialog (on cancel we send a delete somewhere)