主頁 > 軟體設計 > Android 音頻降噪 webrtc 去回聲

Android 音頻降噪 webrtc 去回聲

2020-11-15 11:43:53 軟體設計

Android 音頻降噪 webrtc 去回聲

  • 集成AECM模塊
  • 集成NS模塊
  • 需要原始碼請留言

集成AECM模塊

1.通過 webrtc官網下載需要模塊\modules\audio_processing\aecm
2.新建eclipse工程,新建jni檔案夾將webrtc aecm模塊拷貝到jni檔案夾下
在這里插入圖片描述

3.撰寫本地介面

package com.wrtcmy.webrtc.aecm;

/**
 * This class supports the acoustic echo cancellation for mobile edition. Please <b>bug me</b> if you find any bugs in
 * this toolkit.<br>
 * <br>
 * <b>[Notice]</b><br>
 * 1. there are 5 more native interface that I'm not trying to provide in this MobileAEC toolkit.<br>
 * But I think I should mention it out as a list below, for secondary development if necessary: <br>
 * <ul>
 * <li>WebRtc_Word32 WebRtcAecm_get_config(void *, AecmConfig *);</li>
 * <li>WebRtc_Word32 WebRtcAecm_InitEchoPath(void* , const void* , size_t);</li>
 * <li>WebRtc_Word32 WebRtcAecm_GetEchoPath(void* , void* , size_t);</li>
 * <li>size_t WebRtcAecm_echo_path_size_bytes();</li>
 * <li>WebRtc_Word32 WebRtcAecm_get_error_code(void *);</li>
 * </ul>
 * 2. if you are working on an android platform, put the shared library "libwebrtc_aecm.so"<br>
 * into path "/your project/libs/armeabi/", if the dir does not exist, you should create it, otherwise you<br>
 * will get a "unsatisfied link error" at run time.<br>
 * 3. you should always call <b>close()</b> method <b>manually</b> when all things are finished.<br>
 * <br>
 * <b>[Usage]</b> <br>
 * <ul>
 * 1. You create a MobileAEC object first(set the parameters to constructor or null are both Ok, if null are set, then
 * we will use default values instead).<br>
 * 2. change the aggressiveness or sampling frequency of the AECM instance if necessary.<br>
 * 3. call <b>prepare()</b> method to make the AECM instance prepared. <br>
 * 4. then call "farendBuffer" to set far-end signal to AECM instance. <br>
 * 5. now you call "echoCancellation()" to deal with the acoustic echo things.<br>
 * The order of step 1,2,3,4 and 5 is significant, when all settings are done or you changed previous<br>
 * settings, <b>DO NOT</b> forget to call prepare() method, otherwise your new settings will be ignored by AECM
 * instance. <br>
 * 6. finally you should call <b>close()</b> method <b>manually</b> when all things are done, after that, the AECM
 * instance is no longer available until next <b>prepare()</b> is called.<br>
 * </ul>
 * 
 * @version 0.1 2013-3-8
 * 
 */
public class AECM {
    static {
        System.loadLibrary("webrtc_aecm"); // to load the libwebrtc_aecm.so library.
    }

    // /
    // PUBLIC CONSTANTS

    /**
     * constant unable mode for Aecm configuration settings.
     */
    public static final short AECM_UNABLE = 0;

    /**
     * constant enable mode for Aecm configuration settings.
     */
    public static final short AECM_ENABLE = 1;

    // /
    // PUBLIC NESTED CLASSES

    /**
     * For security reason, this class supports constant sampling frequency values in
     * {@link SamplingFrequency#FS_8000Hz FS_8000Hz}, {@link SamplingFrequency#FS_16000Hz FS_16000Hz}
     */
    public static final class SamplingFrequency {
        public long getFS() {
            return mSamplingFrequency;
        }

        /**
         * This constant represents sampling frequency in 8000Hz
         */
        public static final SamplingFrequency FS_8000Hz  = new SamplingFrequency(
                                                                 8000);

        /**
         * This constant represents sampling frequency in 16000Hz
         */
        public static final SamplingFrequency FS_16000Hz = new SamplingFrequency(
                                                                 16000);

        private final long                    mSamplingFrequency;

        private SamplingFrequency(long fs) {
            this.mSamplingFrequency = fs;
        }
    }

    /**
     * For security reason, this class supports constant aggressiveness of the AECM instance in
     * {@link AggressiveMode#MILD MILD}, {@link AggressiveMode#MEDIUM MEDIUM}, {@link AggressiveMode#HIGH HIGH},
     * {@link AggressiveMode#AGGRESSIVE AGGRESSIVE}, {@link AggressiveMode#MOST_AGGRESSIVE MOST_AGGRESSIVE}.
     */
    public static final class AggressiveMode {
        public int getMode() {
            return mMode;
        }

        /**
         * This constant represents the aggressiveness of the AECM instance in MILD_MODE
         */
        public static final AggressiveMode MILD            = new AggressiveMode(
                                                                   0);

        /**
         * This constant represents the aggressiveness of the AECM instance in MEDIUM_MODE
         */
        public static final AggressiveMode MEDIUM          = new AggressiveMode(
                                                                   1);

        /**
         * This constant represents the aggressiveness of the AECM instance in HIGH_MODE
         */
        public static final AggressiveMode HIGH            = new AggressiveMode(
                                                                   2);

        /**
         * This constant represents the aggressiveness of the AECM instance in AGGRESSIVE_MODE
         */
        public static final AggressiveMode AGGRESSIVE      = new AggressiveMode(
                                                                   3);

        /**
         * This constant represents the aggressiveness of the AECM instance in MOST_AGGRESSIVE_MODE
         */
        public static final AggressiveMode MOST_AGGRESSIVE = new AggressiveMode(
                                                                   4);

        private final int                  mMode;

        private AggressiveMode(int mode) {
            mMode = mode;
        }
    }

    // /
    // PRIVATE MEMBERS

    private int               mAecmHandler = -1;   // the handler of AECM instance.
    private AecmConfig        mAecmConfig  = null; // the configurations of AECM instance.
    private SamplingFrequency mSampFreq    = null; // sampling frequency of input speech data.
    private boolean           mIsInit      = false; // whether the AECM instance is initialized or not.

    // /
    // CONSTRUCTOR

    /**
     * To generate a new AECM instance, whether you set the sampling frequency of each parameter or not are both ok.
     * 
     * @param sampFreqOfData
     *            - sampling frequency of input audio data. if null, then {@link SamplingFrequency#FS_16000Hz
     *            FS_16000Hz} is set.
     */
    public AECM(SamplingFrequency sampFreqOfData) {
        setSampFreq(sampFreqOfData);
        mAecmConfig = new AecmConfig();

        // create new AECM instance but without initialize. Init things are in prepare() method instead.
        mAecmHandler = nativeCreateAecmInstance();
    }

    // /
    // PUBLIC METHODS

    /**
     * set the sampling rate of speech data.
     * 
     * @param fs
     *            - sampling frequency of speech data, if null then {@link SamplingFrequency#FS_16000Hz FS_16000Hz} is
     *            set.
     */
    public void setSampFreq(SamplingFrequency fs) {
        if (fs == null)
            mSampFreq = SamplingFrequency.FS_16000Hz;
        else
            mSampFreq = fs;
    }

    /**
     * set the far-end signal of AECM instance.
     * 
     * @param farendBuf
     * @param numOfSamples
     * @return the {@link AECM MobileAEC} object itself.
     * @throws Exception
     *             - if farendBuffer() is called on an unprepared AECM instance or you pass an invalid parameter.<br>
     */
    public AECM farendBuffer(short[] farendBuf, int numOfSamples)
            throws Exception {
        // check if AECM instance is not initialized.
        if (!mIsInit) {
            // TODO(billhoo) - create a custom exception instead of using java.lang.Exception
            throw new Exception(
                    "setFarendBuffer() called on an unprepared AECM instance.");
        }

        if (nativeBufferFarend(mAecmHandler, farendBuf, numOfSamples) == -1)
            // TODO(billhoo) - create a custom exception instead of using java.lang.Exception
            throw new Exception(
                    "setFarendBuffer() failed due to invalid arguments.");

        return this;
    }

    /**
     * core process of AECM instance, must called on a prepared AECM instance. we only support 80 or 160 sample blocks
     * of data.
     * 
     * @param nearendNoisy
     *            - In buffer containing one frame of reference nearend+echo signal. If noise reduction is active,
     *            provide the noisy signal here.
     * @param nearendClean
     *            - In buffer containing one frame of nearend+echo signal. If noise reduction is active, provide the
     *            clean signal here. Otherwise pass a NULL pointer.
     * @param out
     *            - Out buffer, one frame of processed nearend.
     * @param numOfSamples
     *            - Number of samples in nearend buffer
     * @param delay
     *            - Delay estimate for sound card and system buffers <br>
     *            delay = (t_render - t_analyze) + (t_process - t_capture)<br>
     *            where<br>
     *            - t_analyze is the time a frame is passed to farendBuffer() and t_render is the time the first sample
     *            of the same frame is rendered by the audio hardware.<br>
     *            - t_capture is the time the first sample of a frame is captured by the audio hardware and t_process is
     *            the time the same frame is passed to echoCancellation().
     * 
     * @throws Exception
     *             - if echoCancellation() is called on an unprepared AECM instance or you pass an invalid parameter.<br>
     */
    public void echoCancellation(short[] nearendNoisy, short[] nearendClean,
            short[] out, short numOfSamples, short delay) throws Exception {
        // check if AECM instance is not initialized.
        if (!mIsInit) {
            // TODO(billhoo) - create a custom exception instead of using java.lang.Exception
            throw new Exception(
                    "echoCancelling() called on an unprepared AECM instance.");
        }

        if (nativeAecmProcess(mAecmHandler, nearendNoisy, nearendClean, out,
                numOfSamples, delay) == -1)
            // TODO(billhoo) - create a custom exception instead of using java.lang.Exception
            throw new Exception(
                    "echoCancellation() failed due to invalid arguments.");
    }

    /**
     * Set the aggressiveness mode of AECM instance, more higher the mode is, more aggressive the instance will be.
     * 
     * @param mode
     * @return the {@link AECM MobileAEC} object itself.
     * @throws NullPointerException
     *             - if mode is null.
     */
    public AECM setAecmMode(AggressiveMode mode)
            throws NullPointerException {
        // check the mode argument.
        if (mode == null)
            throw new NullPointerException(
                    "setAecMode() failed due to null argument.");

        mAecmConfig.mAecmMode = (short) mode.getMode();
        return this;
    }

    /**
     * When finished the pre-works or any settings are changed, call this to make AECM instance prepared. Otherwise your
     * new settings will be ignored by the AECM instance.
     * 
     * @return the {@link AECM MobileAEC} object itself.
     */
    public AECM prepare() {
        if (mIsInit) {
            close();
            mAecmHandler = nativeCreateAecmInstance();
        }

        mInitAecmInstance((int) mSampFreq.getFS());
        mIsInit = true;

        // set AecConfig to native side.
        nativeSetConfig(mAecmHandler, mAecmConfig);
        return this;
    }

    /**
     * Release the resources in AECM instance and the AECM instance is no longer available until next <b>prepare()</b>
     * is called.<br>
     * You should <b>always</b> call this <b>manually</b> when all things are done.
     */
    public void close() {
        if (mIsInit) {
            nativeFreeAecmInstance(mAecmHandler);
            mAecmHandler = -1;
            mIsInit = false;
        }
    }

    // 
    // PROTECTED METHODS

    @Override
    protected void finalize() throws Throwable {
        super.finalize();
        // TODO(billhoo) need a safety one.
        if (mIsInit) {
            close();
        }
    }

    // 
    // PRIVATE METHODS

    /**
     * initialize the AECM instance
     * 
     * @param SampFreq
     */
    private void mInitAecmInstance(int SampFreq) {
        if (!mIsInit) {
            nativeInitializeAecmInstance(mAecmHandler, SampFreq);

            // initialize configurations of AECM instance.
            mAecmConfig = new AecmConfig();

            // set default configuration of AECM instance
            nativeSetConfig(mAecmHandler, mAecmConfig);

            mIsInit = true;
        }
    }

    // 
    // PRIVATE NESTED CLASSES

    /**
     * Acoustic Echo Cancellation for Mobile Configuration class, holds the config Info. of AECM instance.<br>
     * [NOTE] <b>DO NOT</b> modify the name of members, or you must change the native code to match your modifying.
     * Otherwise the native code could not find pre-binding members name.<br>
     * 
     */
    @SuppressWarnings("unused")
    public class AecmConfig {
        private short mAecmMode = (short) AggressiveMode.AGGRESSIVE.getMode(); // default AggressiveMode.AGGRESSIVE
        private short mCngMode  = AECM_ENABLE;                                // AECM_UNABLE, AECM_ENABLE (default)
    }

    // ///
    // PRIVATE NATIVE INTERFACES

    /**
     * Allocates the memory needed by the AECM. The memory needs to be initialized separately using the
     * nativeInitializeAecmInstance() method.
     * 
     * @return -1: error<br>
     *         other values: created AECM instance handler.
     * 
     */
    private static native int nativeCreateAecmInstance();

    /**
     * Release the memory allocated by nativeCreateAecmInstance().
     * 
     * @param aecmHandler
     *            - handler of the AECM instance created by nativeCreateAecmInstance()
     * @return 0: OK<br>
     *         -1: error
     */
    private static native int nativeFreeAecmInstance(int aecmHandler);

    /**
     * Initializes an AECM instance.
     * 
     * @param aecmHandler
     *            - Handler of AECM instance
     * @param samplingFrequency
     *            - Sampling frequency of data
     * @return: 0: OK<br>
     *          -1: error
     */
    private static native int nativeInitializeAecmInstance(int aecmHandler,
            int samplingFrequency);

    /**
     * Inserts an 80 or 160 sample block of data into the farend buffer.
     * 
     * @param aecmHandler
     *            - Handler to the AECM instance
     * @param farend
     *            - In buffer containing one frame of farend signal for L band
     * @param nrOfSamples
     *            - Number of samples in farend buffer
     * @return: 0: OK<br>
     *          -1: error
     */
    private static native int nativeBufferFarend(int aecmHandler,
            short[] farend, int nrOfSamples);

    /**
     * Runs the AECM on an 80 or 160 sample blocks of data.
     * 
     * @param aecmHandler
     *            - Handler to the AECM handler
     * @param nearendNoisy
     *            - In buffer containing one frame of reference nearend+echo signal. If noise reduction is active,
     *            provide the noisy signal here.
     * @param nearendClean
     *            - In buffer containing one frame of nearend+echo signal. If noise reduction is active, provide the
     *            clean signal here.Otherwise pass a NULL pointer.
     * @param out
     *            - Out buffer, one frame of processed nearend.
     * @param nrOfSamples
     *            - Number of samples in nearend buffer
     * @param msInSndCardBuf
     *            - Delay estimate for sound card and system buffers <br>
     * @return: 0: OK<br>
     *          -1: error
     */
    private static native int nativeAecmProcess(int aecmHandler,
            short[] nearendNoisy, short[] nearendClean, short[] out,
            short nrOfSamples, short msInSndCardBuf);

    /**
     * Enables the user to set certain parameters on-the-fly.
     * 
     * @param aecmHandler
     *            - Handler to the AECM instance
     * @param aecmConfig
     *            - the new configuration of AECM instance to set.
     * 
     * @return 0: OK<br>
     *         -1: error
     */
    private static native int nativeSetConfig(int aecmHandler,
            AecmConfig aecmConfig);
}

4.在jni檔案夾下新建Android.mk與Application.mk并在對應模塊下新建Android.mk
Android.mk

include $(call all-subdir-makefiles)

Application.mk

LOCAL_PATH:= $(call my-dir)
include $(CLEAR_VARS)
APP_PROJECT_PATH := $(call my-dir)/../
APP_STL := gnustl_static

APP_BUILD_SCRIPT:=$(call my-dir)/Android.mk
APP_PLATFORM := android-22
APP_ABI := armeabi-v7a,armeabi
APP_CFLAGS:=-DDISABLE_NEON 

aecm\Android.mk

LOCAL_PATH := $(call my-dir)

include $(CLEAR_VARS)

LOCAL_MODULE := webrtc_aecm
LOCAL_CFLAGS += -DWEBRTC_POSIX
LOCAL_SRC_FILES	:= \
				randomization_functions.c \
				spl_sqrt_floor.c \
				division_operations.c \
				vector_scaling_operations.c \
				downsample_fast.c \
				cross_correlation.c \
				spl_init.c \
				min_max_operations.c \
				complex_fft.c \
				complex_bit_reverse.c \
				real_fft.c \
				delay_estimator.c \
				delay_estimator_wrapper.c \
				ring_buffer.c \
				aecm_core.c \
				echo_control_mobile.c \
				com_wrtcmy_webrtc_aecm_AECM.c
				#aecm_wrapper.c
				
LOCAL_LDLIBS :=-llog

include $(BUILD_SHARED_LIBRARY)

5.編譯生成頭檔案可參考: Android原始碼下編譯apk、jar與jni ndk-build
6.通過c檔案實作

/* DO NOT EDIT THIS FILE - it is machine generated */
#include <jni.h>
#include <stdlib.h> // for NULL
#include <assert.h>
#include <echo_control_mobile.h>
#include "com_wrtcmy_webrtc_aecm_AECM.h"
/* Header for class com_wrtcmy_webrtc_aecm_AECM */

/*
 * Class:     com_wrtcmy_webrtc_aecm_AECM
 * Method:    nativeCreateAecmInstance
 * Signature: ()I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_aecm_AECM_nativeCreateAecmInstance
  (JNIEnv *env,jclass jclazz) {
		void *aecmInstHandler = NULL;
		if (WebRtcAecm_Create(&aecmInstHandler) == -1)
			return -1;
		else
			return ((int) aecmInstHandler); //returns the pointer which points to created AECM instance to JAVA layer.
	}


/*
 * Class:     com_wrtcmy_webrtc_aecm_AECM
 * Method:    nativeFreeAecmInstance
 * Signature: (I)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_aecm_AECM_nativeFreeAecmInstance
  (JNIEnv *env, jclass jclazz, jint aecmHandler) {
	void *aecmInst = (void *) aecmHandler;
	if (aecmInst == NULL)
		return -1;
	int ret = WebRtcAecm_Free(aecmInst);
	aecmInst = NULL;
	return ret;
}


/*
 * Class:     com_wrtcmy_webrtc_aecm_AECM
 * Method:    nativeInitializeAecmInstance
 * Signature: (II)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_aecm_AECM_nativeInitializeAecmInstance
  (JNIEnv *env, jclass jclazz, jint aecmHandler, jint sampFreq) {
	void *aecmInst = (void *) aecmHandler;
	if (aecmInst == NULL)
		return -1;
	return WebRtcAecm_Init(aecmInst, sampFreq);
}

/*
 * Class:     com_wrtcmy_webrtc_aecm_AECM
 * Method:    nativeBufferFarend
 * Signature: (I[SI)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_aecm_AECM_nativeBufferFarend
  (JNIEnv *env, jclass jclazz, jint aecmHandler, jshortArray farend,
			jint nrOfSamples) {
		void *aecmInst = (void *) aecmHandler;
		if (aecmInst == NULL)
			return -1;

		int ret = -1;
		if (farend != NULL) {
			short *arrFarend = (*env)->GetShortArrayElements(env, farend, NULL);
			ret = WebRtcAecm_BufferFarend(aecmInst, arrFarend, nrOfSamples);

			//TODO(billhoo) should use JNI_ABORT instead of 0 in 4th param.
			//I think there is no need to copy this array back to Java layer.
			(*env)->ReleaseShortArrayElements(env, farend, arrFarend, 0);
		}
		return ret;
	}
/*
 * Class:     com_wrtcmy_webrtc_aecm_AECM
 * Method:    nativeAecmProcess
 * Signature: (I[S[S[SSS)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_aecm_AECM_nativeAecmProcess
  (JNIEnv *env, jclass jclazz, jint aecmHandler,
			const jshortArray nearendNoisy, const jshortArray nearendClean,
			jshortArray out, jshort nrOfSamples, jshort msInSndCardBuf) {

		int16_t *arrNearendNoisy = NULL;
		int16_t *arrNearendClean = NULL;
		int16_t *arrOut = NULL;

		void *aecmInst = (void *) aecmHandler;
		if (aecmInst == NULL)
			return -1;

		int ret = -1;

		//nearendNoisy and out must not be NULL, otherwise process can not be run, return -1 for error.
		if (nearendNoisy == NULL || out == NULL)
			return ret;

		//get data from java side.
		arrNearendNoisy = (*env)->GetShortArrayElements(env, nearendNoisy, NULL);
		arrOut = (*env)->GetShortArrayElements(env, out, NULL);

		if (nearendClean != NULL)
			arrNearendClean = (*env)->GetShortArrayElements(env, nearendClean,
					NULL);

		ret = WebRtcAecm_Process(aecmInst, arrNearendNoisy, arrNearendClean, arrOut,
				nrOfSamples, msInSndCardBuf);

		//release and send the changes back to java side.
		(*env)->ReleaseShortArrayElements(env, nearendNoisy, arrNearendNoisy, 0);
		(*env)->ReleaseShortArrayElements(env, out, arrOut, 0);

		if (nearendClean != NULL)
			(*env)->ReleaseShortArrayElements(env, nearendClean, arrNearendClean,
					0);

		return ret;
	}

/*
 * Class:     com_wrtcmy_webrtc_aecm_AECM
 * Method:    nativeSetConfig
 * Signature: (ILcom/wrtcmy/webrtc/aecm/AECM/AecmConfig;)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_aecm_AECM_nativeSetConfig
  (JNIEnv *env, jclass jclazz, jint aecmHandler, jobject aecmConfig) {

	void * aecmInst = (void *) aecmHandler;
	if (aecmInst == NULL)
		return -1;

	//get reference of AecmConfig class  from java side.
	jclass JavaAecmConfig = (*env)->GetObjectClass(env, aecmConfig);

	//assertion that class not be NULL
	//TODO(billhoo) should use Exception handler to handle this situation instead of assertion.
	assert(JavaAecmConfig != NULL);

	//get configuration field IDs from java side.
	jfieldID mAecmModeID = (*env)->GetFieldID(env, JavaAecmConfig, "mAecmMode",
			"S");
	jfieldID mCngModeID = (*env)->GetFieldID(env, JavaAecmConfig, "mCngMode",
			"S");

	//if any ID is NULL, return -1 for error.
	if (mAecmModeID == NULL || mCngModeID == NULL){
	    LOGD("$$$$$$$$$$nativeSetConfig->(mAecmModeID == NULL || mCngModeID == NULL)");
		return -1;
	}
	//get values of fields
	short echoMode = (*env)->GetShortField(env, aecmConfig, mAecmModeID);
	short cngMode = (*env)->GetShortField(env, aecmConfig, mCngModeID);

	//set new configuration to AECM instance.
	AecmConfig config;
	config.echoMode = echoMode;
	config.cngMode = cngMode;

    LOGD("$$$$$$$$$$WebRtcAecm_set_config");
	return WebRtcAecm_set_config(aecmInst, config);
}

7.編譯so庫可參考: Android原始碼下編譯apk、jar與jni ndk-build可在專案\libs\查看生成檔案

集成NS模塊

流程嚴格按照AECM模塊只列出不同地方

  1. 原始碼檔案在\modules\audio_processing\ns
  2. 撰寫本地介面
package com.wrtcmy.webrtc.ns;

import android.util.Log;

public class NS {

   private static final String TAG = "$$$NS$$$";
   
   static {
   	try {
   		// 加載降噪庫
   		System.loadLibrary("webrtc_ns");
   	} catch (UnsatisfiedLinkError e) {
   		e.printStackTrace();
   	}

   }

   private int mFrequency;
   private int mMode;

   // -----------------------------------------NS
   // 定點數運算----------------------------------------------//
   private int nsInstance = -1;
   private boolean isNsInit = false;

   /**
    * 創建ns實體
    * 
    * @return 成功時回傳ns實體,失敗回傳-1
    */
   public native int nsCreate();

   /**
    * 初始化ns
    * 
    * @param frequency
    *            采樣率
    */
   public native int nsInit(int nsInstance, int frequency);

   /**
    * 設定降噪策略 等級越高,效果越明顯
    * 
    * @param mode
    *            0: Mild, 1: Medium , 2: Aggressive
    */
   public native int nsSetPolicy(int nsInstance, int mode);

   /**
    * 核心處理方法 sample_H與outData_H 我不是很懂,希望有明白的可以指點下
    * 
    * @param sample
    *            低頻段音頻資料-輸入
    * @param sample_H
    *            高頻段音頻資料-輸入(demo中傳的是null)
    * @param outData
    *            低頻段音頻資料-輸出
    * @param outData_H
    *            高頻段音頻資料-輸出(demo中傳的是null)
    */
   public native int nsProcess(int nsInstance, short[] sample,
   		short[] sample_H, short[] outData, short[] outData_H);

   /**
    * 銷毀實體
    */
   public native int nsFree(int nsInstance);

   public NS useNs() {
   	nsInstance = nsCreate();
   	Log.d(TAG, "nsInstance = " + nsInstance);
   	return this;
   }

   public NS setNsConfig(int frequency, int mode) {
   	this.mFrequency = frequency;
   	this.mMode = mode;
   	return this;
   }

   public NS prepareNs() {
   	if (isNsInit) {
   		closeNs();
   		nsInstance = nsCreate();
   	}
   	int initStatus = nsInit(nsInstance, mFrequency);
   	Log.e(TAG, "nsInitStatus = " + initStatus);
   	isNsInit = true;
   	int setStatus = nsSetPolicy(nsInstance, mMode);
   	Log.e(TAG, "nsSetStatus = " + setStatus);
   	return this;
   }

   public int nsProcess(short[] sample, short[] sample_H, short[] outData,
   		short[] outData_H) {
   	return nsProcess(nsInstance, sample, sample_H, outData, outData_H);
   }

   public void closeNs() {
   	if (isNsInit) {
   		nsFree(nsInstance);
   		nsInstance = -1;
   		isNsInit = false;
   	}
   }

   // -------------------------------------------NSX
   // 浮點數運算------------------------------------------//

   private int nsxInstance = -1;
   private boolean isNsxInit = false;

   public native int nsxCreate();

   public native int nsxInit(int nsxInstance, int frequency);

   public native int nsxSetPolicy(int nsxInstance, int mode);

   public native int nsxProcess(int nsxInstance, short[] sample,
   		short[] sample_H, short[] outData, short[] outData_H);

   public native int nsxFree(int nsxInstance);

   public NS useNsx() {
   	nsxInstance = nsxCreate();
   	Log.d(TAG, "nsxInstance = " + nsxInstance);
   	return this;
   }

   public NS setNsxConfig(int frequency, int mode) {
   	this.mFrequency = frequency;
   	this.mMode = mode;
   	return this;
   }

   public NS prepareNsx() {
   	if (isNsxInit) {
   		closeNsx();
   		nsxInstance = nsxCreate();
   	}
   	int initStatus = nsxInit(nsxInstance, mFrequency);
   	Log.e(TAG, "nsxInitStatus = " + initStatus);
   	isNsxInit = true;
   	int setStatus = nsxSetPolicy(nsxInstance, mMode);
   	Log.e(TAG, "nsxSetStatus = " + setStatus);
   	return this;
   }

   public int nsxProcess(short[] sample, short[] sample_H, short[] outData,
   		short[] outData_H) {
   	return nsxProcess(nsxInstance, sample, sample_H, outData, outData_H);
   }

   public void closeNsx() {
   	if (isNsxInit) {
   		nsxFree(nsxInstance);
   		nsxInstance = -1;
   		isNsxInit = false;
   	}
   }

}

  1. ns\Android.mk
LOCAL_PATH := $(call my-dir)
include $(CLEAR_VARS)

LOCAL_MODULE := webrtc_ns
LOCAL_CFLAGS += -DWEBRTC_POSIX

LOCAL_SRC_FILES := $(wildcard $(LOCAL_PATH)/*.c)


LOCAL_LDLIBS :=-llog

include $(BUILD_SHARED_LIBRARY)

  1. 通過c檔案實作
/* DO NOT EDIT THIS FILE - it is machine generated */
#include <jni.h>
/* Header for class com_wrtcmy_webrtc_ns_NS */

#include <stdlib.h> // for NULL
#include "noise_suppression_x.h"
#include "noise_suppression.h"
#include "com_wrtcmy_webrtc_ns_NS.h"

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsCreate
 * Signature: ()I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsCreate
	(JNIEnv *env, jobject obj){

    NsHandle* handle = NULL;
    WebRtcNs_Create(&handle);

    LOGD("$$$$$$$$$$WebRtcNs_Create");
    return (int)handle;
}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsInit
 * Signature: (II)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsInit
	(JNIEnv *env, jobject obj, jint nsHandler, jint frequency){
    NsHandle *handler = (NsHandle *) nsHandler;
    if (handler == NULL){
        return -3;
    }
    return WebRtcNs_Init(handler,frequency);
}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsSetPolicy
 * Signature: (II)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsSetPolicy
	(JNIEnv *env, jobject obj, jint nsHandler, jint mode){

    NsHandle *handle = (NsHandle *) nsHandler;

    if (handle == NULL){
        return -3;
    }
    return WebRtcNs_set_policy(handle,mode);

}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsProcess
 * Signature: (I[S[S[S[S)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsProcess
	(JNIEnv *env, jobject obj, jint nsHandler, jshortArray sample,
			jshortArray sample_H, jshortArray out,jshortArray out_H){
    NsHandle *handle = (NsHandle *) nsHandler;
    if(handle == NULL){
        return -3;
    }
   short* spframe = NULL;
   short* outframe = NULL;
   short* spframe_H = NULL;
   short* outframe_H = NULL;

   int ret = -1;
   spframe = (*env)->GetShortArrayElements(env,sample, NULL);
   outframe = (*env)->GetShortArrayElements(env,out, NULL);
   if(sample_H != NULL){
       spframe_H = (*env)->GetShortArrayElements(env,sample_H, NULL);
   }
   if(out_H != NULL){
       outframe_H = (*env)->GetShortArrayElements(env,out_H, NULL);
   }

   ret = WebRtcNs_Process(handle,spframe,spframe_H,outframe,outframe_H);

   (*env)->ReleaseShortArrayElements(env,sample, spframe, 0);
   (*env)->ReleaseShortArrayElements(env,out, outframe, 0);

   if(sample_H != NULL){
       (*env)->ReleaseShortArrayElements(env,sample_H, spframe_H, 0);
   }
   if(out_H != NULL){
       (*env)->ReleaseShortArrayElements(env,out_H, outframe_H, 0);
   }

   return ret;

}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsFree
 * Signature: (I)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsFree
	(JNIEnv *env, jobject obj, jint nsHandler){
    NsHandle *handle = (NsHandle *) nsHandler;
    if(handle == NULL){
        return -3;
    }

    return WebRtcNs_Free(handle);

}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsxCreate
 * Signature: ()I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsxCreate
	(JNIEnv *env, jobject obj){

    NsHandle* handle = NULL;
    WebRtcNsx_Create(&handle);

    return (int)handle;

}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsxInit
 * Signature: (II)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsxInit
	(JNIEnv *env, jobject obj, jint nsxHandler, jint frequency ){
   NsHandle *handler = (NsHandle *) nsxHandler;
   if (handler == NULL){
       return -3;
   }
   return WebRtcNsx_Init(handler,frequency);

}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsxSetPolicy
 * Signature: (II)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsxSetPolicy
	(JNIEnv *env, jobject obj, jint nsxHandler, jint mode){
    NsHandle *handle = (NsHandle *) nsxHandler;

    if (handle == NULL){
        return -3;
    }
    return WebRtcNsx_set_policy(handle,mode);
}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsxProcess
 * Signature: (I[S[S[S[S)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsxProcess
	(JNIEnv *env, jobject obj, jint nsxHandler, jshortArray sample,
			jshortArray sample_H, jshortArray out,jshortArray out_H){
    NsHandle *handle = (NsHandle *) nsxHandler;
    if(handle == NULL){
        return -3;
    }
    short* spframe = NULL;
    short* outframe = NULL;
    short* spframe_H = NULL;
    short* outframe_H = NULL;

    int ret = -1;
    spframe = (*env)->GetShortArrayElements(env,sample, NULL);
    outframe = (*env)->GetShortArrayElements(env,out, NULL);
    if(sample_H != NULL){
        spframe_H = (*env)->GetShortArrayElements(env,sample_H, NULL);
    }
    if(out_H != NULL){
        outframe_H = (*env)->GetShortArrayElements(env,out_H, NULL);
    }

    ret = WebRtcNsx_Process(handle,spframe,spframe_H,outframe,outframe_H);

    (*env)->ReleaseShortArrayElements(env,sample, spframe, 0);
    (*env)->ReleaseShortArrayElements(env,out, outframe, 0);

    if(sample_H != NULL){
        (*env)->ReleaseShortArrayElements(env,sample_H, spframe_H, 0);
    }
    if(out_H != NULL){
        (*env)->ReleaseShortArrayElements(env,out_H, outframe_H, 0);
    }

    return ret;
}


/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsxFree
 * Signature: (I)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsxFree
	(JNIEnv *env, jobject obj, jint nsxHandler){
    NsHandle *handle = (NsHandle *) nsxHandler;
    if(handle == NULL){
        return -3;
    }

    return WebRtcNsx_Free(handle);
}

需要原始碼請留言

轉載請註明出處,本文鏈接:https://www.uj5u.com/ruanti/217150.html

標籤:其他

上一篇:【Android】利用HelloChart繪制曲線

下一篇:Android 救援模式(Rescue Mode)原理剖析

標籤雲
其他(157675) Python(38076) JavaScript(25376) Java(17977) C(15215) 區塊鏈(8255) C#(7972) AI(7469) 爪哇(7425) MySQL(7132) html(6777) 基礎類(6313) sql(6102) 熊猫(6058) PHP(5869) 数组(5741) R(5409) Linux(5327) 反应(5209) 腳本語言(PerlPython)(5129) 非技術區(4971) Android(4554) 数据框(4311) css(4259) 节点.js(4032) C語言(3288) json(3245) 列表(3129) 扑(3119) C++語言(3117) 安卓(2998) 打字稿(2995) VBA(2789) Java相關(2746) 疑難問題(2699) 细绳(2522) 單片機工控(2479) iOS(2429) ASP.NET(2402) MongoDB(2323) 麻木的(2285) 正则表达式(2254) 字典(2211) 循环(2198) 迅速(2185) 擅长(2169) 镖(2155) 功能(1967) .NET技术(1958) Web開發(1951) python-3.x(1918) HtmlCss(1915) 弹簧靴(1913) C++(1909) xml(1889) PostgreSQL(1872) .NETCore(1853) 谷歌表格(1846) Unity3D(1843) for循环(1842)

熱門瀏覽
  • 面試突擊第一季,第二季,第三季

    第一季必考 https://www.bilibili.com/video/BV1FE411y79Y?from=search&seid=15921726601957489746 第二季分布式 https://www.bilibili.com/video/BV13f4y127ee/?spm_id_fro ......

    uj5u.com 2020-09-10 05:35:24 more
  • 第三單元作業總結

    1.前言 這應該是本學期最后一次寫作業總結了吧。總體來說,對作業的節奏也差不多掌握了,作業做起來的效率也更高了。雖然和之前的作業一樣,作業中都要用到新的知識,但是相比之前,更加懂得了如何利用工具以及資料。雖然之間卡過殼,但總體而言,這幾次作業還算完成的比較好。 2.作業程序總結 相比前兩個單元,此單 ......

    uj5u.com 2020-09-10 05:35:41 more
  • 北航OO(2020)第四單元博客作業暨課程總結博客

    北航OO(2020)第四單元博客作業暨課程總結博客 本單元作業的架構設計 在本單元中,由于UML圖具有比較清晰的樹形結構,因此我對其中需要進行查詢操作的元素進行了包裝,在樹的父節點中存盤所有孩子的參考。考慮到性能問題,我采用了快取機制,一次查詢后盡可能快取已經遍歷過的資訊,以減少遍歷次數。 本單元我 ......

    uj5u.com 2020-09-10 05:35:48 more
  • BUAA_OO_第四單元

    一、UML決議器設計 ? 先看下題目:第四單元實作一個基于JDK 8帶有效性檢查的UML(Unified Modeling Language)類圖,順序圖,狀態圖分析器 MyUmlInteraction,實際上我們要建立一個有向圖模型,UML中的物件(元素)可能與同級元素連接,也可與低級元素相連形成 ......

    uj5u.com 2020-09-10 05:35:54 more
  • 6.1邏輯運算子

    邏輯運算子 1. && 短路與 運算式1 && 運算式2 01.運算式1為true并且運算式2也為true 整體回傳為true 02.運算式1為false,將不會執行運算式2 整體回傳為false 03.只要有一個運算式為false 整體回傳為false 2. || 短路或 運算式1 || 運算式2 ......

    uj5u.com 2020-09-10 05:35:56 more
  • BUAAOO 第四單元 & 課程總結

    1. 第四單元:StarUml檔案決議 本單元采用了圖模型決議UML。 UML檔案可以抽象為圖、子圖、邊的邏輯結構。 在實作中,圖的節點包括類、介面、屬性,子圖包括狀態圖、順序圖等。 采用了三次遍歷UML元素的方法建圖,第一遍遍歷建點,第二、三次遍歷設定屬性、連邊,實作圖物件的初始化。這里借鑒了一些 ......

    uj5u.com 2020-09-10 05:36:06 more
  • 談談我對C# 多型的理解

    面向物件三要素:封裝、繼承、多型。 封裝和繼承,這兩個比較好理解,但要理解多型的話,可就稍微有點難度了。今天,我們就來講講多型的理解。 我們應該經常會看到面試題目:請談談對多型的理解。 其實呢,多型非常簡單,就一句話:呼叫同一種方法產生了不同的結果。 具體實作方式有三種。 一、多載 多載很簡單。 p ......

    uj5u.com 2020-09-10 05:36:09 more
  • Python 資料驅動工具:DDT

    背景 python 的unittest 沒有自帶資料驅動功能。 所以如果使用unittest,同時又想使用資料驅動,那么就可以使用DDT來完成。 DDT是 “Data-Driven Tests”的縮寫。 資料:http://ddt.readthedocs.io/en/latest/ 使用方法 dd. ......

    uj5u.com 2020-09-10 05:36:13 more
  • Python里面的xlrd模塊詳解

    那我就一下面積個問題對xlrd模塊進行學習一下: 1.什么是xlrd模塊? 2.為什么使用xlrd模塊? 3.怎樣使用xlrd模塊? 1.什么是xlrd模塊? ?python操作excel主要用到xlrd和xlwt這兩個庫,即xlrd是讀excel,xlwt是寫excel的庫。 今天就先來說一下xl ......

    uj5u.com 2020-09-10 05:36:28 more
  • 當我們創建HashMap時,底層到底做了什么?

    jdk1.7中的底層實作程序(底層基于陣列+鏈表) 在我們new HashMap()時,底層創建了默認長度為16的一維陣列Entry[ ] table。當我們呼叫map.put(key1,value1)方法向HashMap里添加資料的時候: 首先,呼叫key1所在類的hashCode()計算key1 ......

    uj5u.com 2020-09-10 05:36:38 more
最新发布
  • 【中介者設計模式詳解】C/Java/JS/Go/Python/TS不同語言實作

    * 中介者模式是一種行為型設計模式,它可以用來減少類之間的直接依賴關系,
    * 將物件之間的通信封裝到一個中介者物件中,從而使得各個物件之間的關系更加松散。
    * 在中介者模式中,物件之間不再直接相互互動,而是通過中介者來中轉訊息。 ......

    uj5u.com 2023-04-20 08:20:47 more
  • 露天煤礦現場調研和交流案例分享

    他們集團的資訊化公司及研究院在一個礦區正在做智能礦山的統一平臺的 試點,專案投資大概1億,包括了礦山的各方面的內容,顯示得我們這次交流有點多余。他們2年前開始做智能礦山的規劃,有很多煤礦行業專家的加持,他們的描述是非常完美,但是去年底應該上線的平臺,現在還沒有看到影子。他們確實有很多場景需求,但是被... ......

    uj5u.com 2023-04-20 08:20:25 more
  • 《社區人員管理》實戰案例設計&個人案例分享

    設計是一個讓人夢想成真程序,開始編碼、測驗、除錯之前進行需求分析和架構設計,才能保證關鍵方面都做正確 ......

    uj5u.com 2023-04-20 08:20:17 more
  • 軟體架構生態化-多角色交付的探索實踐

    作為一個技術架構師,不僅僅要緊跟行業技術趨勢,還要結合研發團隊現狀及痛點,探索新的交付方案。在日常中,你是否遇到如下問題 “ 業務需求排期長研發是瓶頸;非研發角色感受不到研發技改提效的變化;引入ISV 團隊又擔心質量和安全,培訓周期長“等等,基于此我們探索了一種新的技術體系及交付方案來解決如上問題。 ......

    uj5u.com 2023-04-20 08:20:10 more
  • 【中介者設計模式詳解】C/Java/JS/Go/Python/TS不同語言實作

    * 中介者模式是一種行為型設計模式,它可以用來減少類之間的直接依賴關系,
    * 將物件之間的通信封裝到一個中介者物件中,從而使得各個物件之間的關系更加松散。
    * 在中介者模式中,物件之間不再直接相互互動,而是通過中介者來中轉訊息。 ......

    uj5u.com 2023-04-20 08:19:44 more
  • 露天煤礦現場調研和交流案例分享

    他們集團的資訊化公司及研究院在一個礦區正在做智能礦山的統一平臺的 試點,專案投資大概1億,包括了礦山的各方面的內容,顯示得我們這次交流有點多余。他們2年前開始做智能礦山的規劃,有很多煤礦行業專家的加持,他們的描述是非常完美,但是去年底應該上線的平臺,現在還沒有看到影子。他們確實有很多場景需求,但是被... ......

    uj5u.com 2023-04-20 08:19:07 more
  • 《社區人員管理》實戰案例設計&個人案例分享

    設計是一個讓人夢想成真程序,開始編碼、測驗、除錯之前進行需求分析和架構設計,才能保證關鍵方面都做正確 ......

    uj5u.com 2023-04-20 08:18:57 more
  • 軟體架構生態化-多角色交付的探索實踐

    作為一個技術架構師,不僅僅要緊跟行業技術趨勢,還要結合研發團隊現狀及痛點,探索新的交付方案。在日常中,你是否遇到如下問題 “ 業務需求排期長研發是瓶頸;非研發角色感受不到研發技改提效的變化;引入ISV 團隊又擔心質量和安全,培訓周期長“等等,基于此我們探索了一種新的技術體系及交付方案來解決如上問題。 ......

    uj5u.com 2023-04-20 08:18:49 more
  • 05單件模式

    #經典的單件模式 public class Singleton { private static Singleton uniqueInstance; //一個靜態變數持有Singleton類的唯一實體。 // 其他有用的實體變數寫在這里 //構造器宣告為私有,只有Singleton可以實體化這個類! ......

    uj5u.com 2023-04-19 08:42:51 more
  • 【架構與設計】常見微服務分層架構的區別和落地實踐

    軟體工程的方方面面都遵循一個最基本的道理:沒有銀彈,架構分層模型更是如此,每一種都有各自優缺點,所以請根據不同的業務場景,并遵循簡單、可演進這兩個重要的架構原則選擇合適的架構分層模型即可。 ......

    uj5u.com 2023-04-19 08:42:41 more