Inquiry about Real-time Audio Capture Functionality

[zfchai]

Requirement Description

I need to implement a real-time audio capture feature for audio data acquisition in a video surveillance system.

Specific Questions

1. Function Implementation: Can the default OwnAudioSharp implementation be used to accomplish real-time audio capture functionality?

2. Cross-platform Support: Does this library support cross-platform deployment (Windows, Linux, macOS)?

3. Dependency Documentation: Is there detailed documentation about third-party libraries required for each platform?

Use Case

• Real-time audio data capture
• Synchronized processing with video streams
• Real-time transmission and analysis of audio data

Expected Response

I hope to receive guidance on implementing this functionality, as well as notes and dependency configuration instructions for cross-platform deployment.

Thanks!

[ModernMube]

OwnAudio - FAQ and Answers

Hi zfchai!

Sorry for only answering your questions now.

Short answers to the questions:

1. Real-time Recording

OwnAudio can record in real time by default, and the data coming from the input can be saved to a file. Look at the Microphone code in the examples folder, which saves the input to a specified file when the recording is finished.

2. Platform Independence

The package installed from Nuget can be used without dependencies on systems (Linux, MacOS, Windows). If you want to use other types of audio files besides (mp3, wav, flac), you will need ffmpeg. Also, if you want to use ASIO under Windows, you will also need portaudio. If you don't need ASIO and flac, wav, mp3 formats are enough, then you don't need any external dependencies. The basic Ownaudiosharp is cross platform.

NuGet\Install-Package OwnAudioSharp

3. External Dependencies

External dependencies are only needed if you want to use ffmpeg and portaudio.
For example, in Windows, the following files are needed in a folder. You need to specify the folder access for the files during initialization:

• avcodec-60.dll
• avdevice-60.dll
• avfilter-9.dll
• avformat-60.dll
• avutil-58.dll
• postproc-57.dll
• swresample-4.dll
• swscale-7.dll
• libportaudio.dll

Initialize:

OwnAudio.Initialize(@"c:\ffmpeg\bin")

4. Video Synchronization

You can use the real-time tempo of the audio source to synchronize it to the video.
See the PitchTempo example code.

5. Real-time Audio Processing

For processing real-time audio data, use the CustomSampleProcessor of the source.
See the FXUsage example code.

manager["InputTrack"].CustomSampleProcessor = new YourProcessor() { IsEnabled = true };

public class YourProcessor : SampleProcessorBase
{
    public override void Process(Span<float> sample)
    {
       // Here you can process continuously arriving float type audio data.
    }
   
    public override void Reset()
    {
        // Reset internal state if needed
    }
}

I hope I was able to help!

regards
ModernMube