主頁 > 後端開發 > Android 音頻降噪 webrtc 去回聲

Android 音頻降噪 webrtc 去回聲

2020-11-16 07:27:54 後端開發

Android 音頻降噪 webrtc 去回聲

  • 集成AECM模塊
  • 集成NS模塊
  • 需要原始碼請留言

集成AECM模塊

1.通過 webrtc官網下載需要模塊\modules\audio_processing\aecm
2.新建eclipse工程,新建jni檔案夾將webrtc aecm模塊拷貝到jni檔案夾下
在這里插入圖片描述

3.撰寫本地介面

package com.wrtcmy.webrtc.aecm;

/**
 * This class supports the acoustic echo cancellation for mobile edition. Please <b>bug me</b> if you find any bugs in
 * this toolkit.<br>
 * <br>
 * <b>[Notice]</b><br>
 * 1. there are 5 more native interface that I'm not trying to provide in this MobileAEC toolkit.<br>
 * But I think I should mention it out as a list below, for secondary development if necessary: <br>
 * <ul>
 * <li>WebRtc_Word32 WebRtcAecm_get_config(void *, AecmConfig *);</li>
 * <li>WebRtc_Word32 WebRtcAecm_InitEchoPath(void* , const void* , size_t);</li>
 * <li>WebRtc_Word32 WebRtcAecm_GetEchoPath(void* , void* , size_t);</li>
 * <li>size_t WebRtcAecm_echo_path_size_bytes();</li>
 * <li>WebRtc_Word32 WebRtcAecm_get_error_code(void *);</li>
 * </ul>
 * 2. if you are working on an android platform, put the shared library "libwebrtc_aecm.so"<br>
 * into path "/your project/libs/armeabi/", if the dir does not exist, you should create it, otherwise you<br>
 * will get a "unsatisfied link error" at run time.<br>
 * 3. you should always call <b>close()</b> method <b>manually</b> when all things are finished.<br>
 * <br>
 * <b>[Usage]</b> <br>
 * <ul>
 * 1. You create a MobileAEC object first(set the parameters to constructor or null are both Ok, if null are set, then
 * we will use default values instead).<br>
 * 2. change the aggressiveness or sampling frequency of the AECM instance if necessary.<br>
 * 3. call <b>prepare()</b> method to make the AECM instance prepared. <br>
 * 4. then call "farendBuffer" to set far-end signal to AECM instance. <br>
 * 5. now you call "echoCancellation()" to deal with the acoustic echo things.<br>
 * The order of step 1,2,3,4 and 5 is significant, when all settings are done or you changed previous<br>
 * settings, <b>DO NOT</b> forget to call prepare() method, otherwise your new settings will be ignored by AECM
 * instance. <br>
 * 6. finally you should call <b>close()</b> method <b>manually</b> when all things are done, after that, the AECM
 * instance is no longer available until next <b>prepare()</b> is called.<br>
 * </ul>
 * 
 * @version 0.1 2013-3-8
 * 
 */
public class AECM {
    static {
        System.loadLibrary("webrtc_aecm"); // to load the libwebrtc_aecm.so library.
    }

    // /
    // PUBLIC CONSTANTS

    /**
     * constant unable mode for Aecm configuration settings.
     */
    public static final short AECM_UNABLE = 0;

    /**
     * constant enable mode for Aecm configuration settings.
     */
    public static final short AECM_ENABLE = 1;

    // /
    // PUBLIC NESTED CLASSES

    /**
     * For security reason, this class supports constant sampling frequency values in
     * {@link SamplingFrequency#FS_8000Hz FS_8000Hz}, {@link SamplingFrequency#FS_16000Hz FS_16000Hz}
     */
    public static final class SamplingFrequency {
        public long getFS() {
            return mSamplingFrequency;
        }

        /**
         * This constant represents sampling frequency in 8000Hz
         */
        public static final SamplingFrequency FS_8000Hz  = new SamplingFrequency(
                                                                 8000);

        /**
         * This constant represents sampling frequency in 16000Hz
         */
        public static final SamplingFrequency FS_16000Hz = new SamplingFrequency(
                                                                 16000);

        private final long                    mSamplingFrequency;

        private SamplingFrequency(long fs) {
            this.mSamplingFrequency = fs;
        }
    }

    /**
     * For security reason, this class supports constant aggressiveness of the AECM instance in
     * {@link AggressiveMode#MILD MILD}, {@link AggressiveMode#MEDIUM MEDIUM}, {@link AggressiveMode#HIGH HIGH},
     * {@link AggressiveMode#AGGRESSIVE AGGRESSIVE}, {@link AggressiveMode#MOST_AGGRESSIVE MOST_AGGRESSIVE}.
     */
    public static final class AggressiveMode {
        public int getMode() {
            return mMode;
        }

        /**
         * This constant represents the aggressiveness of the AECM instance in MILD_MODE
         */
        public static final AggressiveMode MILD            = new AggressiveMode(
                                                                   0);

        /**
         * This constant represents the aggressiveness of the AECM instance in MEDIUM_MODE
         */
        public static final AggressiveMode MEDIUM          = new AggressiveMode(
                                                                   1);

        /**
         * This constant represents the aggressiveness of the AECM instance in HIGH_MODE
         */
        public static final AggressiveMode HIGH            = new AggressiveMode(
                                                                   2);

        /**
         * This constant represents the aggressiveness of the AECM instance in AGGRESSIVE_MODE
         */
        public static final AggressiveMode AGGRESSIVE      = new AggressiveMode(
                                                                   3);

        /**
         * This constant represents the aggressiveness of the AECM instance in MOST_AGGRESSIVE_MODE
         */
        public static final AggressiveMode MOST_AGGRESSIVE = new AggressiveMode(
                                                                   4);

        private final int                  mMode;

        private AggressiveMode(int mode) {
            mMode = mode;
        }
    }

    // /
    // PRIVATE MEMBERS

    private int               mAecmHandler = -1;   // the handler of AECM instance.
    private AecmConfig        mAecmConfig  = null; // the configurations of AECM instance.
    private SamplingFrequency mSampFreq    = null; // sampling frequency of input speech data.
    private boolean           mIsInit      = false; // whether the AECM instance is initialized or not.

    // /
    // CONSTRUCTOR

    /**
     * To generate a new AECM instance, whether you set the sampling frequency of each parameter or not are both ok.
     * 
     * @param sampFreqOfData
     *            - sampling frequency of input audio data. if null, then {@link SamplingFrequency#FS_16000Hz
     *            FS_16000Hz} is set.
     */
    public AECM(SamplingFrequency sampFreqOfData) {
        setSampFreq(sampFreqOfData);
        mAecmConfig = new AecmConfig();

        // create new AECM instance but without initialize. Init things are in prepare() method instead.
        mAecmHandler = nativeCreateAecmInstance();
    }

    // /
    // PUBLIC METHODS

    /**
     * set the sampling rate of speech data.
     * 
     * @param fs
     *            - sampling frequency of speech data, if null then {@link SamplingFrequency#FS_16000Hz FS_16000Hz} is
     *            set.
     */
    public void setSampFreq(SamplingFrequency fs) {
        if (fs == null)
            mSampFreq = SamplingFrequency.FS_16000Hz;
        else
            mSampFreq = fs;
    }

    /**
     * set the far-end signal of AECM instance.
     * 
     * @param farendBuf
     * @param numOfSamples
     * @return the {@link AECM MobileAEC} object itself.
     * @throws Exception
     *             - if farendBuffer() is called on an unprepared AECM instance or you pass an invalid parameter.<br>
     */
    public AECM farendBuffer(short[] farendBuf, int numOfSamples)
            throws Exception {
        // check if AECM instance is not initialized.
        if (!mIsInit) {
            // TODO(billhoo) - create a custom exception instead of using java.lang.Exception
            throw new Exception(
                    "setFarendBuffer() called on an unprepared AECM instance.");
        }

        if (nativeBufferFarend(mAecmHandler, farendBuf, numOfSamples) == -1)
            // TODO(billhoo) - create a custom exception instead of using java.lang.Exception
            throw new Exception(
                    "setFarendBuffer() failed due to invalid arguments.");

        return this;
    }

    /**
     * core process of AECM instance, must called on a prepared AECM instance. we only support 80 or 160 sample blocks
     * of data.
     * 
     * @param nearendNoisy
     *            - In buffer containing one frame of reference nearend+echo signal. If noise reduction is active,
     *            provide the noisy signal here.
     * @param nearendClean
     *            - In buffer containing one frame of nearend+echo signal. If noise reduction is active, provide the
     *            clean signal here. Otherwise pass a NULL pointer.
     * @param out
     *            - Out buffer, one frame of processed nearend.
     * @param numOfSamples
     *            - Number of samples in nearend buffer
     * @param delay
     *            - Delay estimate for sound card and system buffers <br>
     *            delay = (t_render - t_analyze) + (t_process - t_capture)<br>
     *            where<br>
     *            - t_analyze is the time a frame is passed to farendBuffer() and t_render is the time the first sample
     *            of the same frame is rendered by the audio hardware.<br>
     *            - t_capture is the time the first sample of a frame is captured by the audio hardware and t_process is
     *            the time the same frame is passed to echoCancellation().
     * 
     * @throws Exception
     *             - if echoCancellation() is called on an unprepared AECM instance or you pass an invalid parameter.<br>
     */
    public void echoCancellation(short[] nearendNoisy, short[] nearendClean,
            short[] out, short numOfSamples, short delay) throws Exception {
        // check if AECM instance is not initialized.
        if (!mIsInit) {
            // TODO(billhoo) - create a custom exception instead of using java.lang.Exception
            throw new Exception(
                    "echoCancelling() called on an unprepared AECM instance.");
        }

        if (nativeAecmProcess(mAecmHandler, nearendNoisy, nearendClean, out,
                numOfSamples, delay) == -1)
            // TODO(billhoo) - create a custom exception instead of using java.lang.Exception
            throw new Exception(
                    "echoCancellation() failed due to invalid arguments.");
    }

    /**
     * Set the aggressiveness mode of AECM instance, more higher the mode is, more aggressive the instance will be.
     * 
     * @param mode
     * @return the {@link AECM MobileAEC} object itself.
     * @throws NullPointerException
     *             - if mode is null.
     */
    public AECM setAecmMode(AggressiveMode mode)
            throws NullPointerException {
        // check the mode argument.
        if (mode == null)
            throw new NullPointerException(
                    "setAecMode() failed due to null argument.");

        mAecmConfig.mAecmMode = (short) mode.getMode();
        return this;
    }

    /**
     * When finished the pre-works or any settings are changed, call this to make AECM instance prepared. Otherwise your
     * new settings will be ignored by the AECM instance.
     * 
     * @return the {@link AECM MobileAEC} object itself.
     */
    public AECM prepare() {
        if (mIsInit) {
            close();
            mAecmHandler = nativeCreateAecmInstance();
        }

        mInitAecmInstance((int) mSampFreq.getFS());
        mIsInit = true;

        // set AecConfig to native side.
        nativeSetConfig(mAecmHandler, mAecmConfig);
        return this;
    }

    /**
     * Release the resources in AECM instance and the AECM instance is no longer available until next <b>prepare()</b>
     * is called.<br>
     * You should <b>always</b> call this <b>manually</b> when all things are done.
     */
    public void close() {
        if (mIsInit) {
            nativeFreeAecmInstance(mAecmHandler);
            mAecmHandler = -1;
            mIsInit = false;
        }
    }

    // 
    // PROTECTED METHODS

    @Override
    protected void finalize() throws Throwable {
        super.finalize();
        // TODO(billhoo) need a safety one.
        if (mIsInit) {
            close();
        }
    }

    // 
    // PRIVATE METHODS

    /**
     * initialize the AECM instance
     * 
     * @param SampFreq
     */
    private void mInitAecmInstance(int SampFreq) {
        if (!mIsInit) {
            nativeInitializeAecmInstance(mAecmHandler, SampFreq);

            // initialize configurations of AECM instance.
            mAecmConfig = new AecmConfig();

            // set default configuration of AECM instance
            nativeSetConfig(mAecmHandler, mAecmConfig);

            mIsInit = true;
        }
    }

    // 
    // PRIVATE NESTED CLASSES

    /**
     * Acoustic Echo Cancellation for Mobile Configuration class, holds the config Info. of AECM instance.<br>
     * [NOTE] <b>DO NOT</b> modify the name of members, or you must change the native code to match your modifying.
     * Otherwise the native code could not find pre-binding members name.<br>
     * 
     */
    @SuppressWarnings("unused")
    public class AecmConfig {
        private short mAecmMode = (short) AggressiveMode.AGGRESSIVE.getMode(); // default AggressiveMode.AGGRESSIVE
        private short mCngMode  = AECM_ENABLE;                                // AECM_UNABLE, AECM_ENABLE (default)
    }

    // ///
    // PRIVATE NATIVE INTERFACES

    /**
     * Allocates the memory needed by the AECM. The memory needs to be initialized separately using the
     * nativeInitializeAecmInstance() method.
     * 
     * @return -1: error<br>
     *         other values: created AECM instance handler.
     * 
     */
    private static native int nativeCreateAecmInstance();

    /**
     * Release the memory allocated by nativeCreateAecmInstance().
     * 
     * @param aecmHandler
     *            - handler of the AECM instance created by nativeCreateAecmInstance()
     * @return 0: OK<br>
     *         -1: error
     */
    private static native int nativeFreeAecmInstance(int aecmHandler);

    /**
     * Initializes an AECM instance.
     * 
     * @param aecmHandler
     *            - Handler of AECM instance
     * @param samplingFrequency
     *            - Sampling frequency of data
     * @return: 0: OK<br>
     *          -1: error
     */
    private static native int nativeInitializeAecmInstance(int aecmHandler,
            int samplingFrequency);

    /**
     * Inserts an 80 or 160 sample block of data into the farend buffer.
     * 
     * @param aecmHandler
     *            - Handler to the AECM instance
     * @param farend
     *            - In buffer containing one frame of farend signal for L band
     * @param nrOfSamples
     *            - Number of samples in farend buffer
     * @return: 0: OK<br>
     *          -1: error
     */
    private static native int nativeBufferFarend(int aecmHandler,
            short[] farend, int nrOfSamples);

    /**
     * Runs the AECM on an 80 or 160 sample blocks of data.
     * 
     * @param aecmHandler
     *            - Handler to the AECM handler
     * @param nearendNoisy
     *            - In buffer containing one frame of reference nearend+echo signal. If noise reduction is active,
     *            provide the noisy signal here.
     * @param nearendClean
     *            - In buffer containing one frame of nearend+echo signal. If noise reduction is active, provide the
     *            clean signal here.Otherwise pass a NULL pointer.
     * @param out
     *            - Out buffer, one frame of processed nearend.
     * @param nrOfSamples
     *            - Number of samples in nearend buffer
     * @param msInSndCardBuf
     *            - Delay estimate for sound card and system buffers <br>
     * @return: 0: OK<br>
     *          -1: error
     */
    private static native int nativeAecmProcess(int aecmHandler,
            short[] nearendNoisy, short[] nearendClean, short[] out,
            short nrOfSamples, short msInSndCardBuf);

    /**
     * Enables the user to set certain parameters on-the-fly.
     * 
     * @param aecmHandler
     *            - Handler to the AECM instance
     * @param aecmConfig
     *            - the new configuration of AECM instance to set.
     * 
     * @return 0: OK<br>
     *         -1: error
     */
    private static native int nativeSetConfig(int aecmHandler,
            AecmConfig aecmConfig);
}

4.在jni檔案夾下新建Android.mk與Application.mk并在對應模塊下新建Android.mk
Android.mk

include $(call all-subdir-makefiles)

Application.mk

LOCAL_PATH:= $(call my-dir)
include $(CLEAR_VARS)
APP_PROJECT_PATH := $(call my-dir)/../
APP_STL := gnustl_static

APP_BUILD_SCRIPT:=$(call my-dir)/Android.mk
APP_PLATFORM := android-22
APP_ABI := armeabi-v7a,armeabi
APP_CFLAGS:=-DDISABLE_NEON 

aecm\Android.mk

LOCAL_PATH := $(call my-dir)

include $(CLEAR_VARS)

LOCAL_MODULE := webrtc_aecm
LOCAL_CFLAGS += -DWEBRTC_POSIX
LOCAL_SRC_FILES	:= \
				randomization_functions.c \
				spl_sqrt_floor.c \
				division_operations.c \
				vector_scaling_operations.c \
				downsample_fast.c \
				cross_correlation.c \
				spl_init.c \
				min_max_operations.c \
				complex_fft.c \
				complex_bit_reverse.c \
				real_fft.c \
				delay_estimator.c \
				delay_estimator_wrapper.c \
				ring_buffer.c \
				aecm_core.c \
				echo_control_mobile.c \
				com_wrtcmy_webrtc_aecm_AECM.c
				#aecm_wrapper.c
				
LOCAL_LDLIBS :=-llog

include $(BUILD_SHARED_LIBRARY)

5.編譯生成頭檔案可參考: Android原始碼下編譯apk、jar與jni ndk-build
6.通過c檔案實作

/* DO NOT EDIT THIS FILE - it is machine generated */
#include <jni.h>
#include <stdlib.h> // for NULL
#include <assert.h>
#include <echo_control_mobile.h>
#include "com_wrtcmy_webrtc_aecm_AECM.h"
/* Header for class com_wrtcmy_webrtc_aecm_AECM */

/*
 * Class:     com_wrtcmy_webrtc_aecm_AECM
 * Method:    nativeCreateAecmInstance
 * Signature: ()I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_aecm_AECM_nativeCreateAecmInstance
  (JNIEnv *env,jclass jclazz) {
		void *aecmInstHandler = NULL;
		if (WebRtcAecm_Create(&aecmInstHandler) == -1)
			return -1;
		else
			return ((int) aecmInstHandler); //returns the pointer which points to created AECM instance to JAVA layer.
	}


/*
 * Class:     com_wrtcmy_webrtc_aecm_AECM
 * Method:    nativeFreeAecmInstance
 * Signature: (I)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_aecm_AECM_nativeFreeAecmInstance
  (JNIEnv *env, jclass jclazz, jint aecmHandler) {
	void *aecmInst = (void *) aecmHandler;
	if (aecmInst == NULL)
		return -1;
	int ret = WebRtcAecm_Free(aecmInst);
	aecmInst = NULL;
	return ret;
}


/*
 * Class:     com_wrtcmy_webrtc_aecm_AECM
 * Method:    nativeInitializeAecmInstance
 * Signature: (II)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_aecm_AECM_nativeInitializeAecmInstance
  (JNIEnv *env, jclass jclazz, jint aecmHandler, jint sampFreq) {
	void *aecmInst = (void *) aecmHandler;
	if (aecmInst == NULL)
		return -1;
	return WebRtcAecm_Init(aecmInst, sampFreq);
}

/*
 * Class:     com_wrtcmy_webrtc_aecm_AECM
 * Method:    nativeBufferFarend
 * Signature: (I[SI)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_aecm_AECM_nativeBufferFarend
  (JNIEnv *env, jclass jclazz, jint aecmHandler, jshortArray farend,
			jint nrOfSamples) {
		void *aecmInst = (void *) aecmHandler;
		if (aecmInst == NULL)
			return -1;

		int ret = -1;
		if (farend != NULL) {
			short *arrFarend = (*env)->GetShortArrayElements(env, farend, NULL);
			ret = WebRtcAecm_BufferFarend(aecmInst, arrFarend, nrOfSamples);

			//TODO(billhoo) should use JNI_ABORT instead of 0 in 4th param.
			//I think there is no need to copy this array back to Java layer.
			(*env)->ReleaseShortArrayElements(env, farend, arrFarend, 0);
		}
		return ret;
	}
/*
 * Class:     com_wrtcmy_webrtc_aecm_AECM
 * Method:    nativeAecmProcess
 * Signature: (I[S[S[SSS)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_aecm_AECM_nativeAecmProcess
  (JNIEnv *env, jclass jclazz, jint aecmHandler,
			const jshortArray nearendNoisy, const jshortArray nearendClean,
			jshortArray out, jshort nrOfSamples, jshort msInSndCardBuf) {

		int16_t *arrNearendNoisy = NULL;
		int16_t *arrNearendClean = NULL;
		int16_t *arrOut = NULL;

		void *aecmInst = (void *) aecmHandler;
		if (aecmInst == NULL)
			return -1;

		int ret = -1;

		//nearendNoisy and out must not be NULL, otherwise process can not be run, return -1 for error.
		if (nearendNoisy == NULL || out == NULL)
			return ret;

		//get data from java side.
		arrNearendNoisy = (*env)->GetShortArrayElements(env, nearendNoisy, NULL);
		arrOut = (*env)->GetShortArrayElements(env, out, NULL);

		if (nearendClean != NULL)
			arrNearendClean = (*env)->GetShortArrayElements(env, nearendClean,
					NULL);

		ret = WebRtcAecm_Process(aecmInst, arrNearendNoisy, arrNearendClean, arrOut,
				nrOfSamples, msInSndCardBuf);

		//release and send the changes back to java side.
		(*env)->ReleaseShortArrayElements(env, nearendNoisy, arrNearendNoisy, 0);
		(*env)->ReleaseShortArrayElements(env, out, arrOut, 0);

		if (nearendClean != NULL)
			(*env)->ReleaseShortArrayElements(env, nearendClean, arrNearendClean,
					0);

		return ret;
	}

/*
 * Class:     com_wrtcmy_webrtc_aecm_AECM
 * Method:    nativeSetConfig
 * Signature: (ILcom/wrtcmy/webrtc/aecm/AECM/AecmConfig;)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_aecm_AECM_nativeSetConfig
  (JNIEnv *env, jclass jclazz, jint aecmHandler, jobject aecmConfig) {

	void * aecmInst = (void *) aecmHandler;
	if (aecmInst == NULL)
		return -1;

	//get reference of AecmConfig class  from java side.
	jclass JavaAecmConfig = (*env)->GetObjectClass(env, aecmConfig);

	//assertion that class not be NULL
	//TODO(billhoo) should use Exception handler to handle this situation instead of assertion.
	assert(JavaAecmConfig != NULL);

	//get configuration field IDs from java side.
	jfieldID mAecmModeID = (*env)->GetFieldID(env, JavaAecmConfig, "mAecmMode",
			"S");
	jfieldID mCngModeID = (*env)->GetFieldID(env, JavaAecmConfig, "mCngMode",
			"S");

	//if any ID is NULL, return -1 for error.
	if (mAecmModeID == NULL || mCngModeID == NULL){
	    LOGD("$$$$$$$$$$nativeSetConfig->(mAecmModeID == NULL || mCngModeID == NULL)");
		return -1;
	}
	//get values of fields
	short echoMode = (*env)->GetShortField(env, aecmConfig, mAecmModeID);
	short cngMode = (*env)->GetShortField(env, aecmConfig, mCngModeID);

	//set new configuration to AECM instance.
	AecmConfig config;
	config.echoMode = echoMode;
	config.cngMode = cngMode;

    LOGD("$$$$$$$$$$WebRtcAecm_set_config");
	return WebRtcAecm_set_config(aecmInst, config);
}

7.編譯so庫可參考: Android原始碼下編譯apk、jar與jni ndk-build可在專案\libs\查看生成檔案

集成NS模塊

流程嚴格按照AECM模塊只列出不同地方

  1. 原始碼檔案在\modules\audio_processing\ns
  2. 撰寫本地介面
package com.wrtcmy.webrtc.ns;

import android.util.Log;

public class NS {

   private static final String TAG = "$$$NS$$$";
   
   static {
   	try {
   		// 加載降噪庫
   		System.loadLibrary("webrtc_ns");
   	} catch (UnsatisfiedLinkError e) {
   		e.printStackTrace();
   	}

   }

   private int mFrequency;
   private int mMode;

   // -----------------------------------------NS
   // 定點數運算----------------------------------------------//
   private int nsInstance = -1;
   private boolean isNsInit = false;

   /**
    * 創建ns實體
    * 
    * @return 成功時回傳ns實體,失敗回傳-1
    */
   public native int nsCreate();

   /**
    * 初始化ns
    * 
    * @param frequency
    *            采樣率
    */
   public native int nsInit(int nsInstance, int frequency);

   /**
    * 設定降噪策略 等級越高,效果越明顯
    * 
    * @param mode
    *            0: Mild, 1: Medium , 2: Aggressive
    */
   public native int nsSetPolicy(int nsInstance, int mode);

   /**
    * 核心處理方法 sample_H與outData_H 我不是很懂,希望有明白的可以指點下
    * 
    * @param sample
    *            低頻段音頻資料-輸入
    * @param sample_H
    *            高頻段音頻資料-輸入(demo中傳的是null)
    * @param outData
    *            低頻段音頻資料-輸出
    * @param outData_H
    *            高頻段音頻資料-輸出(demo中傳的是null)
    */
   public native int nsProcess(int nsInstance, short[] sample,
   		short[] sample_H, short[] outData, short[] outData_H);

   /**
    * 銷毀實體
    */
   public native int nsFree(int nsInstance);

   public NS useNs() {
   	nsInstance = nsCreate();
   	Log.d(TAG, "nsInstance = " + nsInstance);
   	return this;
   }

   public NS setNsConfig(int frequency, int mode) {
   	this.mFrequency = frequency;
   	this.mMode = mode;
   	return this;
   }

   public NS prepareNs() {
   	if (isNsInit) {
   		closeNs();
   		nsInstance = nsCreate();
   	}
   	int initStatus = nsInit(nsInstance, mFrequency);
   	Log.e(TAG, "nsInitStatus = " + initStatus);
   	isNsInit = true;
   	int setStatus = nsSetPolicy(nsInstance, mMode);
   	Log.e(TAG, "nsSetStatus = " + setStatus);
   	return this;
   }

   public int nsProcess(short[] sample, short[] sample_H, short[] outData,
   		short[] outData_H) {
   	return nsProcess(nsInstance, sample, sample_H, outData, outData_H);
   }

   public void closeNs() {
   	if (isNsInit) {
   		nsFree(nsInstance);
   		nsInstance = -1;
   		isNsInit = false;
   	}
   }

   // -------------------------------------------NSX
   // 浮點數運算------------------------------------------//

   private int nsxInstance = -1;
   private boolean isNsxInit = false;

   public native int nsxCreate();

   public native int nsxInit(int nsxInstance, int frequency);

   public native int nsxSetPolicy(int nsxInstance, int mode);

   public native int nsxProcess(int nsxInstance, short[] sample,
   		short[] sample_H, short[] outData, short[] outData_H);

   public native int nsxFree(int nsxInstance);

   public NS useNsx() {
   	nsxInstance = nsxCreate();
   	Log.d(TAG, "nsxInstance = " + nsxInstance);
   	return this;
   }

   public NS setNsxConfig(int frequency, int mode) {
   	this.mFrequency = frequency;
   	this.mMode = mode;
   	return this;
   }

   public NS prepareNsx() {
   	if (isNsxInit) {
   		closeNsx();
   		nsxInstance = nsxCreate();
   	}
   	int initStatus = nsxInit(nsxInstance, mFrequency);
   	Log.e(TAG, "nsxInitStatus = " + initStatus);
   	isNsxInit = true;
   	int setStatus = nsxSetPolicy(nsxInstance, mMode);
   	Log.e(TAG, "nsxSetStatus = " + setStatus);
   	return this;
   }

   public int nsxProcess(short[] sample, short[] sample_H, short[] outData,
   		short[] outData_H) {
   	return nsxProcess(nsxInstance, sample, sample_H, outData, outData_H);
   }

   public void closeNsx() {
   	if (isNsxInit) {
   		nsxFree(nsxInstance);
   		nsxInstance = -1;
   		isNsxInit = false;
   	}
   }

}

  1. ns\Android.mk
LOCAL_PATH := $(call my-dir)
include $(CLEAR_VARS)

LOCAL_MODULE := webrtc_ns
LOCAL_CFLAGS += -DWEBRTC_POSIX

LOCAL_SRC_FILES := $(wildcard $(LOCAL_PATH)/*.c)


LOCAL_LDLIBS :=-llog

include $(BUILD_SHARED_LIBRARY)

  1. 通過c檔案實作
/* DO NOT EDIT THIS FILE - it is machine generated */
#include <jni.h>
/* Header for class com_wrtcmy_webrtc_ns_NS */

#include <stdlib.h> // for NULL
#include "noise_suppression_x.h"
#include "noise_suppression.h"
#include "com_wrtcmy_webrtc_ns_NS.h"

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsCreate
 * Signature: ()I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsCreate
	(JNIEnv *env, jobject obj){

    NsHandle* handle = NULL;
    WebRtcNs_Create(&handle);

    LOGD("$$$$$$$$$$WebRtcNs_Create");
    return (int)handle;
}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsInit
 * Signature: (II)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsInit
	(JNIEnv *env, jobject obj, jint nsHandler, jint frequency){
    NsHandle *handler = (NsHandle *) nsHandler;
    if (handler == NULL){
        return -3;
    }
    return WebRtcNs_Init(handler,frequency);
}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsSetPolicy
 * Signature: (II)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsSetPolicy
	(JNIEnv *env, jobject obj, jint nsHandler, jint mode){

    NsHandle *handle = (NsHandle *) nsHandler;

    if (handle == NULL){
        return -3;
    }
    return WebRtcNs_set_policy(handle,mode);

}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsProcess
 * Signature: (I[S[S[S[S)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsProcess
	(JNIEnv *env, jobject obj, jint nsHandler, jshortArray sample,
			jshortArray sample_H, jshortArray out,jshortArray out_H){
    NsHandle *handle = (NsHandle *) nsHandler;
    if(handle == NULL){
        return -3;
    }
   short* spframe = NULL;
   short* outframe = NULL;
   short* spframe_H = NULL;
   short* outframe_H = NULL;

   int ret = -1;
   spframe = (*env)->GetShortArrayElements(env,sample, NULL);
   outframe = (*env)->GetShortArrayElements(env,out, NULL);
   if(sample_H != NULL){
       spframe_H = (*env)->GetShortArrayElements(env,sample_H, NULL);
   }
   if(out_H != NULL){
       outframe_H = (*env)->GetShortArrayElements(env,out_H, NULL);
   }

   ret = WebRtcNs_Process(handle,spframe,spframe_H,outframe,outframe_H);

   (*env)->ReleaseShortArrayElements(env,sample, spframe, 0);
   (*env)->ReleaseShortArrayElements(env,out, outframe, 0);

   if(sample_H != NULL){
       (*env)->ReleaseShortArrayElements(env,sample_H, spframe_H, 0);
   }
   if(out_H != NULL){
       (*env)->ReleaseShortArrayElements(env,out_H, outframe_H, 0);
   }

   return ret;

}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsFree
 * Signature: (I)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsFree
	(JNIEnv *env, jobject obj, jint nsHandler){
    NsHandle *handle = (NsHandle *) nsHandler;
    if(handle == NULL){
        return -3;
    }

    return WebRtcNs_Free(handle);

}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsxCreate
 * Signature: ()I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsxCreate
	(JNIEnv *env, jobject obj){

    NsHandle* handle = NULL;
    WebRtcNsx_Create(&handle);

    return (int)handle;

}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsxInit
 * Signature: (II)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsxInit
	(JNIEnv *env, jobject obj, jint nsxHandler, jint frequency ){
   NsHandle *handler = (NsHandle *) nsxHandler;
   if (handler == NULL){
       return -3;
   }
   return WebRtcNsx_Init(handler,frequency);

}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsxSetPolicy
 * Signature: (II)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsxSetPolicy
	(JNIEnv *env, jobject obj, jint nsxHandler, jint mode){
    NsHandle *handle = (NsHandle *) nsxHandler;

    if (handle == NULL){
        return -3;
    }
    return WebRtcNsx_set_policy(handle,mode);
}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsxProcess
 * Signature: (I[S[S[S[S)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsxProcess
	(JNIEnv *env, jobject obj, jint nsxHandler, jshortArray sample,
			jshortArray sample_H, jshortArray out,jshortArray out_H){
    NsHandle *handle = (NsHandle *) nsxHandler;
    if(handle == NULL){
        return -3;
    }
    short* spframe = NULL;
    short* outframe = NULL;
    short* spframe_H = NULL;
    short* outframe_H = NULL;

    int ret = -1;
    spframe = (*env)->GetShortArrayElements(env,sample, NULL);
    outframe = (*env)->GetShortArrayElements(env,out, NULL);
    if(sample_H != NULL){
        spframe_H = (*env)->GetShortArrayElements(env,sample_H, NULL);
    }
    if(out_H != NULL){
        outframe_H = (*env)->GetShortArrayElements(env,out_H, NULL);
    }

    ret = WebRtcNsx_Process(handle,spframe,spframe_H,outframe,outframe_H);

    (*env)->ReleaseShortArrayElements(env,sample, spframe, 0);
    (*env)->ReleaseShortArrayElements(env,out, outframe, 0);

    if(sample_H != NULL){
        (*env)->ReleaseShortArrayElements(env,sample_H, spframe_H, 0);
    }
    if(out_H != NULL){
        (*env)->ReleaseShortArrayElements(env,out_H, outframe_H, 0);
    }

    return ret;
}


/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsxFree
 * Signature: (I)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsxFree
	(JNIEnv *env, jobject obj, jint nsxHandler){
    NsHandle *handle = (NsHandle *) nsxHandler;
    if(handle == NULL){
        return -3;
    }

    return WebRtcNsx_Free(handle);
}

需要原始碼請留言

轉載請註明出處,本文鏈接:https://www.uj5u.com/houduan/219202.html

標籤:python

上一篇:【Android】利用HelloChart繪制曲線

下一篇:Android 救援模式(Rescue Mode)原理剖析

標籤雲
其他(157675) Python(38076) JavaScript(25376) Java(17977) C(15215) 區塊鏈(8255) C#(7972) AI(7469) 爪哇(7425) MySQL(7132) html(6777) 基礎類(6313) sql(6102) 熊猫(6058) PHP(5869) 数组(5741) R(5409) Linux(5327) 反应(5209) 腳本語言(PerlPython)(5129) 非技術區(4971) Android(4554) 数据框(4311) css(4259) 节点.js(4032) C語言(3288) json(3245) 列表(3129) 扑(3119) C++語言(3117) 安卓(2998) 打字稿(2995) VBA(2789) Java相關(2746) 疑難問題(2699) 细绳(2522) 單片機工控(2479) iOS(2429) ASP.NET(2402) MongoDB(2323) 麻木的(2285) 正则表达式(2254) 字典(2211) 循环(2198) 迅速(2185) 擅长(2169) 镖(2155) 功能(1967) .NET技术(1958) Web開發(1951) python-3.x(1918) HtmlCss(1915) 弹簧靴(1913) C++(1909) xml(1889) PostgreSQL(1872) .NETCore(1853) 谷歌表格(1846) Unity3D(1843) for循环(1842)

熱門瀏覽
  • 【C++】Microsoft C++、C 和匯編程式檔案

    ......

    uj5u.com 2020-09-10 00:57:23 more
  • 例外宣告

    相比于斷言適用于排除邏輯上不可能存在的狀態,例外通常是用于邏輯上可能發生的錯誤。 例外宣告 Item 1:當函式不可能拋出例外或不能接受拋出例外時,使用noexcept 理由 如果不打算拋出例外的話,程式就會認為無法處理這種錯誤,并且應當盡早終止,如此可以有效地阻止例外的傳播與擴散。 示例 //不可 ......

    uj5u.com 2020-09-10 00:57:27 more
  • Codeforces 1400E Clear the Multiset(貪心 + 分治)

    鏈接:https://codeforces.com/problemset/problem/1400/E 來源:Codeforces 思路:給你一個陣列,現在你可以進行兩種操作,操作1:將一段沒有 0 的區間進行減一的操作,操作2:將 i 位置上的元素歸零。最終問:將這個陣列的全部元素歸零后操作的最少 ......

    uj5u.com 2020-09-10 00:57:30 more
  • UVA11610 【Reverse Prime】

    本人看到此題沒有翻譯,就附帶了一個自己的翻譯版本 思考 這一題,它的第一個要求是找出所有 $7$ 位反向質數及其質因數的個數。 我們應該需要質數篩篩選1~$10^{7}$的所有數,這里就不慢慢介紹了。但是,重讀題,我們突然發現反向質數都是 $7$ 位,而將它反過來后的數字卻是 $6$ 位數,這就說明 ......

    uj5u.com 2020-09-10 00:57:36 more
  • 統計區間素數數量

    1 #pragma GCC optimize(2) 2 #include <bits/stdc++.h> 3 using namespace std; 4 bool isprime[1000000010]; 5 vector<int> prime; 6 inline int getlist(int ......

    uj5u.com 2020-09-10 00:57:47 more
  • C/C++編程筆記:C++中的 const 變數詳解,教你正確認識const用法

    1、C中的const 1、區域const變數存放在堆疊區中,會分配記憶體(也就是說可以通過地址間接修改變數的值)。測驗代碼如下: 運行結果: 2、全域const變數存放在只讀資料段(不能通過地址修改,會發生寫入錯誤), 默認為外部聯編,可以給其他源檔案使用(需要用extern關鍵字修飾) 運行結果: ......

    uj5u.com 2020-09-10 00:58:04 more
  • 【C++犯錯記錄】VS2019 MFC添加資源不懂如何修改資源宏ID

    1. 首先在資源視圖中,添加資源 2. 點擊新添加的資源,復制自動生成的ID 3. 在解決方案資源管理器中找到Resource.h檔案,編輯,使用整個專案搜索和替換的方式快速替換 宏宣告 4. Ctrl+Shift+F 全域搜索,點擊查找全部,然后逐個替換 5. 為什么使用搜索替換而不使用屬性視窗直 ......

    uj5u.com 2020-09-10 00:59:11 more
  • 【C++犯錯記錄】VS2019 MFC不懂的批量添加資源

    1. 打開資源頭檔案Resource.h,在其中預先定義好宏 ID(不清楚其實ID值應該設定多少,可以先新建一個相同的資源項,再在這個資源的ID值的基礎上遞增即可) 2. 在資源視圖中選中專案資源,按F7編輯資源檔案,按 ID 型別 相對路徑的形式添加 資源。(別忘了先把檔案拷貝到專案中的res檔案 ......

    uj5u.com 2020-09-10 01:00:19 more
  • C/C++編程筆記:關于C++的參考型別,專供新手入門使用

    今天要講的是C++中我最喜歡的一個用法——參考,也叫別名。 參考就是給一個變數名取一個變數名,方便我們間接地使用這個變數。我們可以給一個變數創建N個參考,這N + 1個變數共享了同一塊記憶體區域。(參考型別的變數會占用記憶體空間,占用的記憶體空間的大小和指標型別的大小是相同的。雖然參考是一個物件的別名,但 ......

    uj5u.com 2020-09-10 01:00:22 more
  • 【C/C++編程筆記】從頭開始學習C ++:初學者完整指南

    眾所周知,C ++的學習曲線陡峭,但是花時間學習這種語言將為您的職業帶來奇跡,并使您與其他開發人員區分開。您會更輕松地學習新語言,形成真正的解決問題的技能,并在編程的基礎上打下堅實的基礎。 C ++將幫助您養成良好的編程習慣(即清晰一致的編碼風格,在撰寫代碼時注釋代碼,并限制類內部的可見性),并且由 ......

    uj5u.com 2020-09-10 01:00:41 more
最新发布
  • Rust中的智能指標:Box<T> Rc<T> Arc<T> Cell<T> RefCell<T> Weak

    Rust中的智能指標是什么 智能指標(smart pointers)是一類資料結構,是擁有資料所有權和額外功能的指標。是指標的進一步發展 指標(pointer)是一個包含記憶體地址的變數的通用概念。這個地址參考,或 ” 指向”(points at)一些其 他資料 。參考以 & 符號為標志并借用了他們所 ......

    uj5u.com 2023-04-20 07:24:10 more
  • Java的值傳遞和參考傳遞

    值傳遞不會改變本身,參考傳遞(如果傳遞的值需要實體化到堆里)如果發生修改了會改變本身。 1.基本資料型別都是值傳遞 package com.example.basic; public class Test { public static void main(String[] args) { int ......

    uj5u.com 2023-04-20 07:24:04 more
  • [2]SpinalHDL教程——Scala簡單入門

    第一個 Scala 程式 shell里面輸入 $ scala scala> 1 + 1 res0: Int = 2 scala> println("Hello World!") Hello World! 檔案形式 object HelloWorld { /* 這是我的第一個 Scala 程式 * 以 ......

    uj5u.com 2023-04-20 07:23:58 more
  • 理解函式指標和回呼函式

    理解 函式指標 指向函式的指標。比如: 理解函式指標的偽代碼 void (*p)(int type, char *data); // 定義一個函式指標p void func(int type, char *data); // 宣告一個函式func p = func; // 將指標p指向函式func ......

    uj5u.com 2023-04-20 07:23:52 more
  • Django筆記二十五之資料庫函式之日期函式

    本文首發于公眾號:Hunter后端 原文鏈接:Django筆記二十五之資料庫函式之日期函式 日期函式主要介紹兩個大類,Extract() 和 Trunc() Extract() 函式作用是提取日期,比如我們可以提取一個日期欄位的年份,月份,日等資料 Trunc() 的作用則是截取,比如 2022-0 ......

    uj5u.com 2023-04-20 07:23:45 more
  • 一天吃透JVM面試八股文

    什么是JVM? JVM,全稱Java Virtual Machine(Java虛擬機),是通過在實際的計算機上仿真模擬各種計算機功能來實作的。由一套位元組碼指令集、一組暫存器、一個堆疊、一個垃圾回收堆和一個存盤方法域等組成。JVM屏蔽了與作業系統平臺相關的資訊,使得Java程式只需要生成在Java虛擬機 ......

    uj5u.com 2023-04-20 07:23:31 more
  • 使用Java接入小程式訂閱訊息!

    更新完微信服務號的模板訊息之后,我又趕緊把微信小程式的訂閱訊息給實作了!之前我一直以為微信小程式也是要企業才能申請,沒想到小程式個人就能申請。 訊息推送平臺🔥推送下發【郵件】【短信】【微信服務號】【微信小程式】【企業微信】【釘釘】等訊息型別。 https://gitee.com/zhongfuch ......

    uj5u.com 2023-04-20 07:22:59 more
  • java -- 緩沖流、轉換流、序列化流

    緩沖流 緩沖流, 也叫高效流, 按照資料型別分類: 位元組緩沖流:BufferedInputStream,BufferedOutputStream 字符緩沖流:BufferedReader,BufferedWriter 緩沖流的基本原理,是在創建流物件時,會創建一個內置的默認大小的緩沖區陣列,通過緩沖 ......

    uj5u.com 2023-04-20 07:22:49 more
  • Java-SpringBoot-Range請求頭設定實作視頻分段傳輸

    老實說,人太懶了,現在基本都不喜歡寫筆記了,但是網上有關Range請求頭的文章都太水了 下面是抄的一段StackOverflow的代碼...自己大修改過的,寫的注釋挺全的,應該直接看得懂,就不解釋了 寫的不好...只是希望能給視頻網站開發的新手一點點幫助吧. 業務場景:視頻分段傳輸、視頻多段傳輸(理 ......

    uj5u.com 2023-04-20 07:22:42 more
  • Windows 10開發教程_編程入門自學教程_菜鳥教程-免費教程分享

    教程簡介 Windows 10開發入門教程 - 從簡單的步驟了解Windows 10開發,從基本到高級概念,包括簡介,UWP,第一個應用程式,商店,XAML控制元件,資料系結,XAML性能,自適應設計,自適應UI,自適應代碼,檔案管理,SQLite資料庫,應用程式到應用程式通信,應用程式本地化,應用程式 ......

    uj5u.com 2023-04-20 07:22:35 more