# Realtime audio processing using Dynamic

Can I make real time audio processing with Mathematica in the same way I can do with images using Dynamic[CurrentImage[]]. I know that is possible to use SystemDialogInput["RecordSound"] function, but you can't make real time dynamics on it. For example, I would like create one notebook that could make an alert when sound's beyond some level. It's possible?

-
I don't think so... Let's pray ;) – Rojo Oct 26 '12 at 0:27
On Linux this is not possible. I add my prayers :) – image_doctor Oct 26 '12 at 11:14
In my case I use a Mac. It's strange that it's so easy to do it with a cam, but not with a microphone. – Murta Oct 26 '12 at 11:29
Also see here for interacting with chuck. – Szabolcs Mar 19 '15 at 21:57
The best I have seen for real time work with MMA was this: a live stream of Conrad Wolfram doing face recognition to block it in real time. twitter.com/conradwolfram/status/573416811728904192 . Since he did it live on stage in front of an audience I would have though some audio processing would be possible providing the bandwidth was low enough. I should note that the frame rate and resolution were typical webcam quality - ie low. – Gordon Coale Mar 20 '15 at 9:41

Generally, Mathematica is just not good at real-time anything. It was not designed for this. Audio processing has very strict requirements on latency. The delay between input and output must be tiny, on the order of milliseconds, otherwise the delay will be noticeable.

Mathematica is simply not meant for this and doesn't have precise timing facilities. I'm fairly confident that the practical answer to this is no, it's not possible.

For non-real time audio processing or things like algorithmic music, I see many uses. But it's not a tool for real-time work.

-
Thank you very much! I'm aware of the latency, but this is not really an issue. I would use it to create something like "soundscapes". So, it's not very important that the timing is very accurate. More important is a vast variety of possibilities to manipulate sound in order to create new and interesting approaches in performing. But based on you answer, I assume that it's still no the best software to do something like this. Thanks... – Philipp Mar 19 '15 at 22:08
@Philipp There are many interesting possibilities for uses in music, just not when it must be real-time ... it might be possible to hack something together for simple uses, but I wouldn't feel comfortable with it ... I definitely wouldn't trust it enough to use during a live performance with an audience. Well, at least not without very very extensively testing it first. – Szabolcs Mar 19 '15 at 22:38
@Szabolcs I would like to close and merge this as a duplicate of (13656) to keep all relevant answers in one place. That question could be edited to be more general of necessary. Do you agree? – Mr.Wizard Mar 29 '15 at 15:12
@Mr.Wizard Yes, I agree. – Szabolcs Apr 10 '15 at 17:07

Advise if this is best relegated to comment status.

There are server-based real-time analytics of life science experiments using the Wolfram Language provided by these guys http://emeraldcloudlab.com.

Note the Mathematica 9 logo in their materials, indicates webMathematica rather than a private Wolfram Cloud.

I'll agree that real-time acoustic analysis may be difficult in Mma at present. There are very interesting ~10fps image processing examples I'm aware of but can't provide details of, other than this is a friendly upper limit to aim for.

Disclaimer: no connections to emeraldcloud.com

-