主頁 >  其他 > Android 音頻降噪 webrtc 去回聲

Android 音頻降噪 webrtc 去回聲

2020-11-16 02:21:00 其他

Android 音頻降噪 webrtc 去回聲

  • 集成AECM模塊
  • 集成NS模塊
  • 需要原始碼請留言

集成AECM模塊

1.通過 webrtc官網下載需要模塊\modules\audio_processing\aecm
2.新建eclipse工程,新建jni檔案夾將webrtc aecm模塊拷貝到jni檔案夾下
在這里插入圖片描述

3.撰寫本地介面

package com.wrtcmy.webrtc.aecm;

/**
 * This class supports the acoustic echo cancellation for mobile edition. Please <b>bug me</b> if you find any bugs in
 * this toolkit.<br>
 * <br>
 * <b>[Notice]</b><br>
 * 1. there are 5 more native interface that I'm not trying to provide in this MobileAEC toolkit.<br>
 * But I think I should mention it out as a list below, for secondary development if necessary: <br>
 * <ul>
 * <li>WebRtc_Word32 WebRtcAecm_get_config(void *, AecmConfig *);</li>
 * <li>WebRtc_Word32 WebRtcAecm_InitEchoPath(void* , const void* , size_t);</li>
 * <li>WebRtc_Word32 WebRtcAecm_GetEchoPath(void* , void* , size_t);</li>
 * <li>size_t WebRtcAecm_echo_path_size_bytes();</li>
 * <li>WebRtc_Word32 WebRtcAecm_get_error_code(void *);</li>
 * </ul>
 * 2. if you are working on an android platform, put the shared library "libwebrtc_aecm.so"<br>
 * into path "/your project/libs/armeabi/", if the dir does not exist, you should create it, otherwise you<br>
 * will get a "unsatisfied link error" at run time.<br>
 * 3. you should always call <b>close()</b> method <b>manually</b> when all things are finished.<br>
 * <br>
 * <b>[Usage]</b> <br>
 * <ul>
 * 1. You create a MobileAEC object first(set the parameters to constructor or null are both Ok, if null are set, then
 * we will use default values instead).<br>
 * 2. change the aggressiveness or sampling frequency of the AECM instance if necessary.<br>
 * 3. call <b>prepare()</b> method to make the AECM instance prepared. <br>
 * 4. then call "farendBuffer" to set far-end signal to AECM instance. <br>
 * 5. now you call "echoCancellation()" to deal with the acoustic echo things.<br>
 * The order of step 1,2,3,4 and 5 is significant, when all settings are done or you changed previous<br>
 * settings, <b>DO NOT</b> forget to call prepare() method, otherwise your new settings will be ignored by AECM
 * instance. <br>
 * 6. finally you should call <b>close()</b> method <b>manually</b> when all things are done, after that, the AECM
 * instance is no longer available until next <b>prepare()</b> is called.<br>
 * </ul>
 * 
 * @version 0.1 2013-3-8
 * 
 */
public class AECM {
    static {
        System.loadLibrary("webrtc_aecm"); // to load the libwebrtc_aecm.so library.
    }

    // /
    // PUBLIC CONSTANTS

    /**
     * constant unable mode for Aecm configuration settings.
     */
    public static final short AECM_UNABLE = 0;

    /**
     * constant enable mode for Aecm configuration settings.
     */
    public static final short AECM_ENABLE = 1;

    // /
    // PUBLIC NESTED CLASSES

    /**
     * For security reason, this class supports constant sampling frequency values in
     * {@link SamplingFrequency#FS_8000Hz FS_8000Hz}, {@link SamplingFrequency#FS_16000Hz FS_16000Hz}
     */
    public static final class SamplingFrequency {
        public long getFS() {
            return mSamplingFrequency;
        }

        /**
         * This constant represents sampling frequency in 8000Hz
         */
        public static final SamplingFrequency FS_8000Hz  = new SamplingFrequency(
                                                                 8000);

        /**
         * This constant represents sampling frequency in 16000Hz
         */
        public static final SamplingFrequency FS_16000Hz = new SamplingFrequency(
                                                                 16000);

        private final long                    mSamplingFrequency;

        private SamplingFrequency(long fs) {
            this.mSamplingFrequency = fs;
        }
    }

    /**
     * For security reason, this class supports constant aggressiveness of the AECM instance in
     * {@link AggressiveMode#MILD MILD}, {@link AggressiveMode#MEDIUM MEDIUM}, {@link AggressiveMode#HIGH HIGH},
     * {@link AggressiveMode#AGGRESSIVE AGGRESSIVE}, {@link AggressiveMode#MOST_AGGRESSIVE MOST_AGGRESSIVE}.
     */
    public static final class AggressiveMode {
        public int getMode() {
            return mMode;
        }

        /**
         * This constant represents the aggressiveness of the AECM instance in MILD_MODE
         */
        public static final AggressiveMode MILD            = new AggressiveMode(
                                                                   0);

        /**
         * This constant represents the aggressiveness of the AECM instance in MEDIUM_MODE
         */
        public static final AggressiveMode MEDIUM          = new AggressiveMode(
                                                                   1);

        /**
         * This constant represents the aggressiveness of the AECM instance in HIGH_MODE
         */
        public static final AggressiveMode HIGH            = new AggressiveMode(
                                                                   2);

        /**
         * This constant represents the aggressiveness of the AECM instance in AGGRESSIVE_MODE
         */
        public static final AggressiveMode AGGRESSIVE      = new AggressiveMode(
                                                                   3);

        /**
         * This constant represents the aggressiveness of the AECM instance in MOST_AGGRESSIVE_MODE
         */
        public static final AggressiveMode MOST_AGGRESSIVE = new AggressiveMode(
                                                                   4);

        private final int                  mMode;

        private AggressiveMode(int mode) {
            mMode = mode;
        }
    }

    // /
    // PRIVATE MEMBERS

    private int               mAecmHandler = -1;   // the handler of AECM instance.
    private AecmConfig        mAecmConfig  = null; // the configurations of AECM instance.
    private SamplingFrequency mSampFreq    = null; // sampling frequency of input speech data.
    private boolean           mIsInit      = false; // whether the AECM instance is initialized or not.

    // /
    // CONSTRUCTOR

    /**
     * To generate a new AECM instance, whether you set the sampling frequency of each parameter or not are both ok.
     * 
     * @param sampFreqOfData
     *            - sampling frequency of input audio data. if null, then {@link SamplingFrequency#FS_16000Hz
     *            FS_16000Hz} is set.
     */
    public AECM(SamplingFrequency sampFreqOfData) {
        setSampFreq(sampFreqOfData);
        mAecmConfig = new AecmConfig();

        // create new AECM instance but without initialize. Init things are in prepare() method instead.
        mAecmHandler = nativeCreateAecmInstance();
    }

    // /
    // PUBLIC METHODS

    /**
     * set the sampling rate of speech data.
     * 
     * @param fs
     *            - sampling frequency of speech data, if null then {@link SamplingFrequency#FS_16000Hz FS_16000Hz} is
     *            set.
     */
    public void setSampFreq(SamplingFrequency fs) {
        if (fs == null)
            mSampFreq = SamplingFrequency.FS_16000Hz;
        else
            mSampFreq = fs;
    }

    /**
     * set the far-end signal of AECM instance.
     * 
     * @param farendBuf
     * @param numOfSamples
     * @return the {@link AECM MobileAEC} object itself.
     * @throws Exception
     *             - if farendBuffer() is called on an unprepared AECM instance or you pass an invalid parameter.<br>
     */
    public AECM farendBuffer(short[] farendBuf, int numOfSamples)
            throws Exception {
        // check if AECM instance is not initialized.
        if (!mIsInit) {
            // TODO(billhoo) - create a custom exception instead of using java.lang.Exception
            throw new Exception(
                    "setFarendBuffer() called on an unprepared AECM instance.");
        }

        if (nativeBufferFarend(mAecmHandler, farendBuf, numOfSamples) == -1)
            // TODO(billhoo) - create a custom exception instead of using java.lang.Exception
            throw new Exception(
                    "setFarendBuffer() failed due to invalid arguments.");

        return this;
    }

    /**
     * core process of AECM instance, must called on a prepared AECM instance. we only support 80 or 160 sample blocks
     * of data.
     * 
     * @param nearendNoisy
     *            - In buffer containing one frame of reference nearend+echo signal. If noise reduction is active,
     *            provide the noisy signal here.
     * @param nearendClean
     *            - In buffer containing one frame of nearend+echo signal. If noise reduction is active, provide the
     *            clean signal here. Otherwise pass a NULL pointer.
     * @param out
     *            - Out buffer, one frame of processed nearend.
     * @param numOfSamples
     *            - Number of samples in nearend buffer
     * @param delay
     *            - Delay estimate for sound card and system buffers <br>
     *            delay = (t_render - t_analyze) + (t_process - t_capture)<br>
     *            where<br>
     *            - t_analyze is the time a frame is passed to farendBuffer() and t_render is the time the first sample
     *            of the same frame is rendered by the audio hardware.<br>
     *            - t_capture is the time the first sample of a frame is captured by the audio hardware and t_process is
     *            the time the same frame is passed to echoCancellation().
     * 
     * @throws Exception
     *             - if echoCancellation() is called on an unprepared AECM instance or you pass an invalid parameter.<br>
     */
    public void echoCancellation(short[] nearendNoisy, short[] nearendClean,
            short[] out, short numOfSamples, short delay) throws Exception {
        // check if AECM instance is not initialized.
        if (!mIsInit) {
            // TODO(billhoo) - create a custom exception instead of using java.lang.Exception
            throw new Exception(
                    "echoCancelling() called on an unprepared AECM instance.");
        }

        if (nativeAecmProcess(mAecmHandler, nearendNoisy, nearendClean, out,
                numOfSamples, delay) == -1)
            // TODO(billhoo) - create a custom exception instead of using java.lang.Exception
            throw new Exception(
                    "echoCancellation() failed due to invalid arguments.");
    }

    /**
     * Set the aggressiveness mode of AECM instance, more higher the mode is, more aggressive the instance will be.
     * 
     * @param mode
     * @return the {@link AECM MobileAEC} object itself.
     * @throws NullPointerException
     *             - if mode is null.
     */
    public AECM setAecmMode(AggressiveMode mode)
            throws NullPointerException {
        // check the mode argument.
        if (mode == null)
            throw new NullPointerException(
                    "setAecMode() failed due to null argument.");

        mAecmConfig.mAecmMode = (short) mode.getMode();
        return this;
    }

    /**
     * When finished the pre-works or any settings are changed, call this to make AECM instance prepared. Otherwise your
     * new settings will be ignored by the AECM instance.
     * 
     * @return the {@link AECM MobileAEC} object itself.
     */
    public AECM prepare() {
        if (mIsInit) {
            close();
            mAecmHandler = nativeCreateAecmInstance();
        }

        mInitAecmInstance((int) mSampFreq.getFS());
        mIsInit = true;

        // set AecConfig to native side.
        nativeSetConfig(mAecmHandler, mAecmConfig);
        return this;
    }

    /**
     * Release the resources in AECM instance and the AECM instance is no longer available until next <b>prepare()</b>
     * is called.<br>
     * You should <b>always</b> call this <b>manually</b> when all things are done.
     */
    public void close() {
        if (mIsInit) {
            nativeFreeAecmInstance(mAecmHandler);
            mAecmHandler = -1;
            mIsInit = false;
        }
    }

    // 
    // PROTECTED METHODS

    @Override
    protected void finalize() throws Throwable {
        super.finalize();
        // TODO(billhoo) need a safety one.
        if (mIsInit) {
            close();
        }
    }

    // 
    // PRIVATE METHODS

    /**
     * initialize the AECM instance
     * 
     * @param SampFreq
     */
    private void mInitAecmInstance(int SampFreq) {
        if (!mIsInit) {
            nativeInitializeAecmInstance(mAecmHandler, SampFreq);

            // initialize configurations of AECM instance.
            mAecmConfig = new AecmConfig();

            // set default configuration of AECM instance
            nativeSetConfig(mAecmHandler, mAecmConfig);

            mIsInit = true;
        }
    }

    // 
    // PRIVATE NESTED CLASSES

    /**
     * Acoustic Echo Cancellation for Mobile Configuration class, holds the config Info. of AECM instance.<br>
     * [NOTE] <b>DO NOT</b> modify the name of members, or you must change the native code to match your modifying.
     * Otherwise the native code could not find pre-binding members name.<br>
     * 
     */
    @SuppressWarnings("unused")
    public class AecmConfig {
        private short mAecmMode = (short) AggressiveMode.AGGRESSIVE.getMode(); // default AggressiveMode.AGGRESSIVE
        private short mCngMode  = AECM_ENABLE;                                // AECM_UNABLE, AECM_ENABLE (default)
    }

    // ///
    // PRIVATE NATIVE INTERFACES

    /**
     * Allocates the memory needed by the AECM. The memory needs to be initialized separately using the
     * nativeInitializeAecmInstance() method.
     * 
     * @return -1: error<br>
     *         other values: created AECM instance handler.
     * 
     */
    private static native int nativeCreateAecmInstance();

    /**
     * Release the memory allocated by nativeCreateAecmInstance().
     * 
     * @param aecmHandler
     *            - handler of the AECM instance created by nativeCreateAecmInstance()
     * @return 0: OK<br>
     *         -1: error
     */
    private static native int nativeFreeAecmInstance(int aecmHandler);

    /**
     * Initializes an AECM instance.
     * 
     * @param aecmHandler
     *            - Handler of AECM instance
     * @param samplingFrequency
     *            - Sampling frequency of data
     * @return: 0: OK<br>
     *          -1: error
     */
    private static native int nativeInitializeAecmInstance(int aecmHandler,
            int samplingFrequency);

    /**
     * Inserts an 80 or 160 sample block of data into the farend buffer.
     * 
     * @param aecmHandler
     *            - Handler to the AECM instance
     * @param farend
     *            - In buffer containing one frame of farend signal for L band
     * @param nrOfSamples
     *            - Number of samples in farend buffer
     * @return: 0: OK<br>
     *          -1: error
     */
    private static native int nativeBufferFarend(int aecmHandler,
            short[] farend, int nrOfSamples);

    /**
     * Runs the AECM on an 80 or 160 sample blocks of data.
     * 
     * @param aecmHandler
     *            - Handler to the AECM handler
     * @param nearendNoisy
     *            - In buffer containing one frame of reference nearend+echo signal. If noise reduction is active,
     *            provide the noisy signal here.
     * @param nearendClean
     *            - In buffer containing one frame of nearend+echo signal. If noise reduction is active, provide the
     *            clean signal here.Otherwise pass a NULL pointer.
     * @param out
     *            - Out buffer, one frame of processed nearend.
     * @param nrOfSamples
     *            - Number of samples in nearend buffer
     * @param msInSndCardBuf
     *            - Delay estimate for sound card and system buffers <br>
     * @return: 0: OK<br>
     *          -1: error
     */
    private static native int nativeAecmProcess(int aecmHandler,
            short[] nearendNoisy, short[] nearendClean, short[] out,
            short nrOfSamples, short msInSndCardBuf);

    /**
     * Enables the user to set certain parameters on-the-fly.
     * 
     * @param aecmHandler
     *            - Handler to the AECM instance
     * @param aecmConfig
     *            - the new configuration of AECM instance to set.
     * 
     * @return 0: OK<br>
     *         -1: error
     */
    private static native int nativeSetConfig(int aecmHandler,
            AecmConfig aecmConfig);
}

4.在jni檔案夾下新建Android.mk與Application.mk并在對應模塊下新建Android.mk
Android.mk

include $(call all-subdir-makefiles)

Application.mk

LOCAL_PATH:= $(call my-dir)
include $(CLEAR_VARS)
APP_PROJECT_PATH := $(call my-dir)/../
APP_STL := gnustl_static

APP_BUILD_SCRIPT:=$(call my-dir)/Android.mk
APP_PLATFORM := android-22
APP_ABI := armeabi-v7a,armeabi
APP_CFLAGS:=-DDISABLE_NEON 

aecm\Android.mk

LOCAL_PATH := $(call my-dir)

include $(CLEAR_VARS)

LOCAL_MODULE := webrtc_aecm
LOCAL_CFLAGS += -DWEBRTC_POSIX
LOCAL_SRC_FILES	:= \
				randomization_functions.c \
				spl_sqrt_floor.c \
				division_operations.c \
				vector_scaling_operations.c \
				downsample_fast.c \
				cross_correlation.c \
				spl_init.c \
				min_max_operations.c \
				complex_fft.c \
				complex_bit_reverse.c \
				real_fft.c \
				delay_estimator.c \
				delay_estimator_wrapper.c \
				ring_buffer.c \
				aecm_core.c \
				echo_control_mobile.c \
				com_wrtcmy_webrtc_aecm_AECM.c
				#aecm_wrapper.c
				
LOCAL_LDLIBS :=-llog

include $(BUILD_SHARED_LIBRARY)

5.編譯生成頭檔案可參考: Android原始碼下編譯apk、jar與jni ndk-build
6.通過c檔案實作

/* DO NOT EDIT THIS FILE - it is machine generated */
#include <jni.h>
#include <stdlib.h> // for NULL
#include <assert.h>
#include <echo_control_mobile.h>
#include "com_wrtcmy_webrtc_aecm_AECM.h"
/* Header for class com_wrtcmy_webrtc_aecm_AECM */

/*
 * Class:     com_wrtcmy_webrtc_aecm_AECM
 * Method:    nativeCreateAecmInstance
 * Signature: ()I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_aecm_AECM_nativeCreateAecmInstance
  (JNIEnv *env,jclass jclazz) {
		void *aecmInstHandler = NULL;
		if (WebRtcAecm_Create(&aecmInstHandler) == -1)
			return -1;
		else
			return ((int) aecmInstHandler); //returns the pointer which points to created AECM instance to JAVA layer.
	}


/*
 * Class:     com_wrtcmy_webrtc_aecm_AECM
 * Method:    nativeFreeAecmInstance
 * Signature: (I)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_aecm_AECM_nativeFreeAecmInstance
  (JNIEnv *env, jclass jclazz, jint aecmHandler) {
	void *aecmInst = (void *) aecmHandler;
	if (aecmInst == NULL)
		return -1;
	int ret = WebRtcAecm_Free(aecmInst);
	aecmInst = NULL;
	return ret;
}


/*
 * Class:     com_wrtcmy_webrtc_aecm_AECM
 * Method:    nativeInitializeAecmInstance
 * Signature: (II)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_aecm_AECM_nativeInitializeAecmInstance
  (JNIEnv *env, jclass jclazz, jint aecmHandler, jint sampFreq) {
	void *aecmInst = (void *) aecmHandler;
	if (aecmInst == NULL)
		return -1;
	return WebRtcAecm_Init(aecmInst, sampFreq);
}

/*
 * Class:     com_wrtcmy_webrtc_aecm_AECM
 * Method:    nativeBufferFarend
 * Signature: (I[SI)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_aecm_AECM_nativeBufferFarend
  (JNIEnv *env, jclass jclazz, jint aecmHandler, jshortArray farend,
			jint nrOfSamples) {
		void *aecmInst = (void *) aecmHandler;
		if (aecmInst == NULL)
			return -1;

		int ret = -1;
		if (farend != NULL) {
			short *arrFarend = (*env)->GetShortArrayElements(env, farend, NULL);
			ret = WebRtcAecm_BufferFarend(aecmInst, arrFarend, nrOfSamples);

			//TODO(billhoo) should use JNI_ABORT instead of 0 in 4th param.
			//I think there is no need to copy this array back to Java layer.
			(*env)->ReleaseShortArrayElements(env, farend, arrFarend, 0);
		}
		return ret;
	}
/*
 * Class:     com_wrtcmy_webrtc_aecm_AECM
 * Method:    nativeAecmProcess
 * Signature: (I[S[S[SSS)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_aecm_AECM_nativeAecmProcess
  (JNIEnv *env, jclass jclazz, jint aecmHandler,
			const jshortArray nearendNoisy, const jshortArray nearendClean,
			jshortArray out, jshort nrOfSamples, jshort msInSndCardBuf) {

		int16_t *arrNearendNoisy = NULL;
		int16_t *arrNearendClean = NULL;
		int16_t *arrOut = NULL;

		void *aecmInst = (void *) aecmHandler;
		if (aecmInst == NULL)
			return -1;

		int ret = -1;

		//nearendNoisy and out must not be NULL, otherwise process can not be run, return -1 for error.
		if (nearendNoisy == NULL || out == NULL)
			return ret;

		//get data from java side.
		arrNearendNoisy = (*env)->GetShortArrayElements(env, nearendNoisy, NULL);
		arrOut = (*env)->GetShortArrayElements(env, out, NULL);

		if (nearendClean != NULL)
			arrNearendClean = (*env)->GetShortArrayElements(env, nearendClean,
					NULL);

		ret = WebRtcAecm_Process(aecmInst, arrNearendNoisy, arrNearendClean, arrOut,
				nrOfSamples, msInSndCardBuf);

		//release and send the changes back to java side.
		(*env)->ReleaseShortArrayElements(env, nearendNoisy, arrNearendNoisy, 0);
		(*env)->ReleaseShortArrayElements(env, out, arrOut, 0);

		if (nearendClean != NULL)
			(*env)->ReleaseShortArrayElements(env, nearendClean, arrNearendClean,
					0);

		return ret;
	}

/*
 * Class:     com_wrtcmy_webrtc_aecm_AECM
 * Method:    nativeSetConfig
 * Signature: (ILcom/wrtcmy/webrtc/aecm/AECM/AecmConfig;)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_aecm_AECM_nativeSetConfig
  (JNIEnv *env, jclass jclazz, jint aecmHandler, jobject aecmConfig) {

	void * aecmInst = (void *) aecmHandler;
	if (aecmInst == NULL)
		return -1;

	//get reference of AecmConfig class  from java side.
	jclass JavaAecmConfig = (*env)->GetObjectClass(env, aecmConfig);

	//assertion that class not be NULL
	//TODO(billhoo) should use Exception handler to handle this situation instead of assertion.
	assert(JavaAecmConfig != NULL);

	//get configuration field IDs from java side.
	jfieldID mAecmModeID = (*env)->GetFieldID(env, JavaAecmConfig, "mAecmMode",
			"S");
	jfieldID mCngModeID = (*env)->GetFieldID(env, JavaAecmConfig, "mCngMode",
			"S");

	//if any ID is NULL, return -1 for error.
	if (mAecmModeID == NULL || mCngModeID == NULL){
	    LOGD("$$$$$$$$$$nativeSetConfig->(mAecmModeID == NULL || mCngModeID == NULL)");
		return -1;
	}
	//get values of fields
	short echoMode = (*env)->GetShortField(env, aecmConfig, mAecmModeID);
	short cngMode = (*env)->GetShortField(env, aecmConfig, mCngModeID);

	//set new configuration to AECM instance.
	AecmConfig config;
	config.echoMode = echoMode;
	config.cngMode = cngMode;

    LOGD("$$$$$$$$$$WebRtcAecm_set_config");
	return WebRtcAecm_set_config(aecmInst, config);
}

7.編譯so庫可參考: Android原始碼下編譯apk、jar與jni ndk-build可在專案\libs\查看生成檔案

集成NS模塊

流程嚴格按照AECM模塊只列出不同地方

  1. 原始碼檔案在\modules\audio_processing\ns
  2. 撰寫本地介面
package com.wrtcmy.webrtc.ns;

import android.util.Log;

public class NS {

   private static final String TAG = "$$$NS$$$";
   
   static {
   	try {
   		// 加載降噪庫
   		System.loadLibrary("webrtc_ns");
   	} catch (UnsatisfiedLinkError e) {
   		e.printStackTrace();
   	}

   }

   private int mFrequency;
   private int mMode;

   // -----------------------------------------NS
   // 定點數運算----------------------------------------------//
   private int nsInstance = -1;
   private boolean isNsInit = false;

   /**
    * 創建ns實體
    * 
    * @return 成功時回傳ns實體,失敗回傳-1
    */
   public native int nsCreate();

   /**
    * 初始化ns
    * 
    * @param frequency
    *            采樣率
    */
   public native int nsInit(int nsInstance, int frequency);

   /**
    * 設定降噪策略 等級越高,效果越明顯
    * 
    * @param mode
    *            0: Mild, 1: Medium , 2: Aggressive
    */
   public native int nsSetPolicy(int nsInstance, int mode);

   /**
    * 核心處理方法 sample_H與outData_H 我不是很懂,希望有明白的可以指點下
    * 
    * @param sample
    *            低頻段音頻資料-輸入
    * @param sample_H
    *            高頻段音頻資料-輸入(demo中傳的是null)
    * @param outData
    *            低頻段音頻資料-輸出
    * @param outData_H
    *            高頻段音頻資料-輸出(demo中傳的是null)
    */
   public native int nsProcess(int nsInstance, short[] sample,
   		short[] sample_H, short[] outData, short[] outData_H);

   /**
    * 銷毀實體
    */
   public native int nsFree(int nsInstance);

   public NS useNs() {
   	nsInstance = nsCreate();
   	Log.d(TAG, "nsInstance = " + nsInstance);
   	return this;
   }

   public NS setNsConfig(int frequency, int mode) {
   	this.mFrequency = frequency;
   	this.mMode = mode;
   	return this;
   }

   public NS prepareNs() {
   	if (isNsInit) {
   		closeNs();
   		nsInstance = nsCreate();
   	}
   	int initStatus = nsInit(nsInstance, mFrequency);
   	Log.e(TAG, "nsInitStatus = " + initStatus);
   	isNsInit = true;
   	int setStatus = nsSetPolicy(nsInstance, mMode);
   	Log.e(TAG, "nsSetStatus = " + setStatus);
   	return this;
   }

   public int nsProcess(short[] sample, short[] sample_H, short[] outData,
   		short[] outData_H) {
   	return nsProcess(nsInstance, sample, sample_H, outData, outData_H);
   }

   public void closeNs() {
   	if (isNsInit) {
   		nsFree(nsInstance);
   		nsInstance = -1;
   		isNsInit = false;
   	}
   }

   // -------------------------------------------NSX
   // 浮點數運算------------------------------------------//

   private int nsxInstance = -1;
   private boolean isNsxInit = false;

   public native int nsxCreate();

   public native int nsxInit(int nsxInstance, int frequency);

   public native int nsxSetPolicy(int nsxInstance, int mode);

   public native int nsxProcess(int nsxInstance, short[] sample,
   		short[] sample_H, short[] outData, short[] outData_H);

   public native int nsxFree(int nsxInstance);

   public NS useNsx() {
   	nsxInstance = nsxCreate();
   	Log.d(TAG, "nsxInstance = " + nsxInstance);
   	return this;
   }

   public NS setNsxConfig(int frequency, int mode) {
   	this.mFrequency = frequency;
   	this.mMode = mode;
   	return this;
   }

   public NS prepareNsx() {
   	if (isNsxInit) {
   		closeNsx();
   		nsxInstance = nsxCreate();
   	}
   	int initStatus = nsxInit(nsxInstance, mFrequency);
   	Log.e(TAG, "nsxInitStatus = " + initStatus);
   	isNsxInit = true;
   	int setStatus = nsxSetPolicy(nsxInstance, mMode);
   	Log.e(TAG, "nsxSetStatus = " + setStatus);
   	return this;
   }

   public int nsxProcess(short[] sample, short[] sample_H, short[] outData,
   		short[] outData_H) {
   	return nsxProcess(nsxInstance, sample, sample_H, outData, outData_H);
   }

   public void closeNsx() {
   	if (isNsxInit) {
   		nsxFree(nsxInstance);
   		nsxInstance = -1;
   		isNsxInit = false;
   	}
   }

}

  1. ns\Android.mk
LOCAL_PATH := $(call my-dir)
include $(CLEAR_VARS)

LOCAL_MODULE := webrtc_ns
LOCAL_CFLAGS += -DWEBRTC_POSIX

LOCAL_SRC_FILES := $(wildcard $(LOCAL_PATH)/*.c)


LOCAL_LDLIBS :=-llog

include $(BUILD_SHARED_LIBRARY)

  1. 通過c檔案實作
/* DO NOT EDIT THIS FILE - it is machine generated */
#include <jni.h>
/* Header for class com_wrtcmy_webrtc_ns_NS */

#include <stdlib.h> // for NULL
#include "noise_suppression_x.h"
#include "noise_suppression.h"
#include "com_wrtcmy_webrtc_ns_NS.h"

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsCreate
 * Signature: ()I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsCreate
	(JNIEnv *env, jobject obj){

    NsHandle* handle = NULL;
    WebRtcNs_Create(&handle);

    LOGD("$$$$$$$$$$WebRtcNs_Create");
    return (int)handle;
}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsInit
 * Signature: (II)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsInit
	(JNIEnv *env, jobject obj, jint nsHandler, jint frequency){
    NsHandle *handler = (NsHandle *) nsHandler;
    if (handler == NULL){
        return -3;
    }
    return WebRtcNs_Init(handler,frequency);
}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsSetPolicy
 * Signature: (II)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsSetPolicy
	(JNIEnv *env, jobject obj, jint nsHandler, jint mode){

    NsHandle *handle = (NsHandle *) nsHandler;

    if (handle == NULL){
        return -3;
    }
    return WebRtcNs_set_policy(handle,mode);

}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsProcess
 * Signature: (I[S[S[S[S)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsProcess
	(JNIEnv *env, jobject obj, jint nsHandler, jshortArray sample,
			jshortArray sample_H, jshortArray out,jshortArray out_H){
    NsHandle *handle = (NsHandle *) nsHandler;
    if(handle == NULL){
        return -3;
    }
   short* spframe = NULL;
   short* outframe = NULL;
   short* spframe_H = NULL;
   short* outframe_H = NULL;

   int ret = -1;
   spframe = (*env)->GetShortArrayElements(env,sample, NULL);
   outframe = (*env)->GetShortArrayElements(env,out, NULL);
   if(sample_H != NULL){
       spframe_H = (*env)->GetShortArrayElements(env,sample_H, NULL);
   }
   if(out_H != NULL){
       outframe_H = (*env)->GetShortArrayElements(env,out_H, NULL);
   }

   ret = WebRtcNs_Process(handle,spframe,spframe_H,outframe,outframe_H);

   (*env)->ReleaseShortArrayElements(env,sample, spframe, 0);
   (*env)->ReleaseShortArrayElements(env,out, outframe, 0);

   if(sample_H != NULL){
       (*env)->ReleaseShortArrayElements(env,sample_H, spframe_H, 0);
   }
   if(out_H != NULL){
       (*env)->ReleaseShortArrayElements(env,out_H, outframe_H, 0);
   }

   return ret;

}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsFree
 * Signature: (I)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsFree
	(JNIEnv *env, jobject obj, jint nsHandler){
    NsHandle *handle = (NsHandle *) nsHandler;
    if(handle == NULL){
        return -3;
    }

    return WebRtcNs_Free(handle);

}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsxCreate
 * Signature: ()I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsxCreate
	(JNIEnv *env, jobject obj){

    NsHandle* handle = NULL;
    WebRtcNsx_Create(&handle);

    return (int)handle;

}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsxInit
 * Signature: (II)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsxInit
	(JNIEnv *env, jobject obj, jint nsxHandler, jint frequency ){
   NsHandle *handler = (NsHandle *) nsxHandler;
   if (handler == NULL){
       return -3;
   }
   return WebRtcNsx_Init(handler,frequency);

}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsxSetPolicy
 * Signature: (II)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsxSetPolicy
	(JNIEnv *env, jobject obj, jint nsxHandler, jint mode){
    NsHandle *handle = (NsHandle *) nsxHandler;

    if (handle == NULL){
        return -3;
    }
    return WebRtcNsx_set_policy(handle,mode);
}

/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsxProcess
 * Signature: (I[S[S[S[S)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsxProcess
	(JNIEnv *env, jobject obj, jint nsxHandler, jshortArray sample,
			jshortArray sample_H, jshortArray out,jshortArray out_H){
    NsHandle *handle = (NsHandle *) nsxHandler;
    if(handle == NULL){
        return -3;
    }
    short* spframe = NULL;
    short* outframe = NULL;
    short* spframe_H = NULL;
    short* outframe_H = NULL;

    int ret = -1;
    spframe = (*env)->GetShortArrayElements(env,sample, NULL);
    outframe = (*env)->GetShortArrayElements(env,out, NULL);
    if(sample_H != NULL){
        spframe_H = (*env)->GetShortArrayElements(env,sample_H, NULL);
    }
    if(out_H != NULL){
        outframe_H = (*env)->GetShortArrayElements(env,out_H, NULL);
    }

    ret = WebRtcNsx_Process(handle,spframe,spframe_H,outframe,outframe_H);

    (*env)->ReleaseShortArrayElements(env,sample, spframe, 0);
    (*env)->ReleaseShortArrayElements(env,out, outframe, 0);

    if(sample_H != NULL){
        (*env)->ReleaseShortArrayElements(env,sample_H, spframe_H, 0);
    }
    if(out_H != NULL){
        (*env)->ReleaseShortArrayElements(env,out_H, outframe_H, 0);
    }

    return ret;
}


/*
 * Class:     com_wrtcmy_webrtc_ns_NS
 * Method:    nsxFree
 * Signature: (I)I
 */
JNIEXPORT jint JNICALL Java_com_wrtcmy_webrtc_ns_NS_nsxFree
	(JNIEnv *env, jobject obj, jint nsxHandler){
    NsHandle *handle = (NsHandle *) nsxHandler;
    if(handle == NULL){
        return -3;
    }

    return WebRtcNsx_Free(handle);
}

需要原始碼請留言

轉載請註明出處,本文鏈接:https://www.uj5u.com/qita/218828.html

標籤:AI

上一篇:faker.js 登 GitHub 趨勢榜標星 27.1k,可大批量生成假資料!

下一篇:請問spi顯示屏如何使用dma2d?

標籤雲
其他(157675) Python(38076) JavaScript(25376) Java(17977) C(15215) 區塊鏈(8255) C#(7972) AI(7469) 爪哇(7425) MySQL(7132) html(6777) 基礎類(6313) sql(6102) 熊猫(6058) PHP(5869) 数组(5741) R(5409) Linux(5327) 反应(5209) 腳本語言(PerlPython)(5129) 非技術區(4971) Android(4554) 数据框(4311) css(4259) 节点.js(4032) C語言(3288) json(3245) 列表(3129) 扑(3119) C++語言(3117) 安卓(2998) 打字稿(2995) VBA(2789) Java相關(2746) 疑難問題(2699) 细绳(2522) 單片機工控(2479) iOS(2429) ASP.NET(2402) MongoDB(2323) 麻木的(2285) 正则表达式(2254) 字典(2211) 循环(2198) 迅速(2185) 擅长(2169) 镖(2155) 功能(1967) .NET技术(1958) Web開發(1951) python-3.x(1918) HtmlCss(1915) 弹簧靴(1913) C++(1909) xml(1889) PostgreSQL(1872) .NETCore(1853) 谷歌表格(1846) Unity3D(1843) for循环(1842)

熱門瀏覽
  • 網閘典型架構簡述

    網閘架構一般分為兩種:三主機的三系統架構網閘和雙主機的2+1架構網閘。 三主機架構分別為內端機、外端機和仲裁機。三機無論從軟體和硬體上均各自獨立。首先從硬體上來看,三機都用各自獨立的主板、記憶體及存盤設備。從軟體上來看,三機有各自獨立的作業系統。這樣能達到完全的三機獨立。對于“2+1”系統,“2”分為 ......

    uj5u.com 2020-09-10 02:00:44 more
  • 如何從xshell上傳檔案到centos linux虛擬機里

    如何從xshell上傳檔案到centos linux虛擬機里及:虛擬機CentOs下執行 yum -y install lrzsz命令,出現錯誤:鏡像無法找到軟體包 前言 一、安裝lrzsz步驟 二、上傳檔案 三、遇到的問題及解決方案 總結 前言 提示:其實很簡單,往虛擬機上安裝一個上傳檔案的工具 ......

    uj5u.com 2020-09-10 02:00:47 more
  • 一、SQLMAP入門

    一、SQLMAP入門 1、判斷是否存在注入 sqlmap.py -u 網址/id=1 id=1不可缺少。當注入點后面的引數大于兩個時。需要加雙引號, sqlmap.py -u "網址/id=1&uid=1" 2、判斷文本中的請求是否存在注入 從文本中加載http請求,SQLMAP可以從一個文本檔案中 ......

    uj5u.com 2020-09-10 02:00:50 more
  • Metasploit 簡單使用教程

    metasploit 簡單使用教程 浩先生, 2020-08-28 16:18:25 分類專欄: kail 網路安全 linux 文章標簽: linux資訊安全 編輯 著作權 metasploit 使用教程 前言 一、Metasploit是什么? 二、準備作業 三、具體步驟 前言 Msfconsole ......

    uj5u.com 2020-09-10 02:00:53 more
  • 游戲逆向之驅動層與用戶層通訊

    驅動層代碼: #pragma once #include <ntifs.h> #define add_code CTL_CODE(FILE_DEVICE_UNKNOWN,0x800,METHOD_BUFFERED,FILE_ANY_ACCESS) /* 更多游戲逆向視頻www.yxfzedu.com ......

    uj5u.com 2020-09-10 02:00:56 more
  • 北斗電力時鐘(北斗授時服務器)讓網路資料更精準

    北斗電力時鐘(北斗授時服務器)讓網路資料更精準 北斗電力時鐘(北斗授時服務器)讓網路資料更精準 京準電子科技官微——ahjzsz 近幾年,資訊技術的得了快速發展,互聯網在逐漸普及,其在人們生活和生產中都得到了廣泛應用,并且取得了不錯的應用效果。計算機網路資訊在電力系統中的應用,一方面使電力系統的運行 ......

    uj5u.com 2020-09-10 02:01:03 more
  • 【CTF】CTFHub 技能樹 彩蛋 writeup

    ?碎碎念 CTFHub:https://www.ctfhub.com/ 筆者入門CTF時時剛開始刷的是bugku的舊平臺,后來才有了CTFHub。 感覺不論是網頁UI設計,還是題目質量,賽事跟蹤,工具軟體都做得很不錯。 而且因為獨到的金幣制度的確讓人有一種想去刷題賺金幣的感覺。 個人還是非常喜歡這個 ......

    uj5u.com 2020-09-10 02:04:05 more
  • 02windows基礎操作

    我學到了一下幾點 Windows系統目錄結構與滲透的作用 常見Windows的服務詳解 Windows埠詳解 常用的Windows注冊表詳解 hacker DOS命令詳解(net user / type /md /rd/ dir /cd /net use copy、批處理 等) 利用dos命令制作 ......

    uj5u.com 2020-09-10 02:04:18 more
  • 03.Linux基礎操作

    我學到了以下幾點 01Linux系統介紹02系統安裝,密碼啊破解03Linux常用命令04LAMP 01LINUX windows: win03 8 12 16 19 配置不繁瑣 Linux:redhat,centos(紅帽社區版),Ubuntu server,suse unix:金融機構,證券,銀 ......

    uj5u.com 2020-09-10 02:04:30 more
  • 05HTML

    01HTML介紹 02頭部標簽講解03基礎標簽講解04表單標簽講解 HTML前段語言 js1.了解代碼2.根據代碼 懂得挖掘漏洞 (POST注入/XSS漏洞上傳)3.黑帽seo 白帽seo 客戶網站被黑帽植入劫持代碼如何處理4.熟悉html表單 <html><head><title>TDK標題,描述 ......

    uj5u.com 2020-09-10 02:04:36 more
最新发布
  • 2023年最新微信小程式抓包教程

    01 開門見山 隔一個月發一篇文章,不過分。 首先回顧一下《微信系結手機號資料庫被脫庫事件》,我也是第一時間得知了這個訊息,然后跟蹤了整件事情的經過。下面是這起事件的相關截圖以及近日流出的一萬條資料樣本: 個人認為這件事也沒什么,還不如關注一下之前45億快遞資料查詢渠道疑似在近日復活的訊息。 訊息是 ......

    uj5u.com 2023-04-20 08:48:24 more
  • web3 產品介紹:metamask 錢包 使用最多的瀏覽器插件錢包

    Metamask錢包是一種基于區塊鏈技術的數字貨幣錢包,它允許用戶在安全、便捷的環境下管理自己的加密資產。Metamask錢包是以太坊生態系統中最流行的錢包之一,它具有易于使用、安全性高和功能強大等優點。 本文將詳細介紹Metamask錢包的功能和使用方法。 一、 Metamask錢包的功能 數字資 ......

    uj5u.com 2023-04-20 08:47:46 more
  • vulnhub_Earth

    前言 靶機地址->>>vulnhub_Earth 攻擊機ip:192.168.20.121 靶機ip:192.168.20.122 參考文章 https://www.cnblogs.com/Jing-X/archive/2022/04/03/16097695.html https://www.cnb ......

    uj5u.com 2023-04-20 07:46:20 more
  • 從4k到42k,軟體測驗工程師的漲薪史,給我看哭了

    清明節一過,盲猜大家已經無心上班,在數著日子準備過五一,但一想到銀行卡里的余額……瞬間心情就不美麗了。最近,2023年高校畢業生就業調查顯示,本科畢業月平均起薪為5825元。調查一出,便有很多同學表示自己又被平均了。看著這一資料,不免讓人想到前不久中國青年報的一項調查:近六成大學生認為畢業10年內會 ......

    uj5u.com 2023-04-20 07:44:00 more
  • 最新版本 Stable Diffusion 開源 AI 繪畫工具之中文自動提詞篇

    🎈 標簽生成器 由于輸入正向提示詞 prompt 和反向提示詞 negative prompt 都是使用英文,所以對學習母語的我們非常不友好 使用網址:https://tinygeeker.github.io/p/ai-prompt-generator 這個網址是為了讓大家在使用 AI 繪畫的時候 ......

    uj5u.com 2023-04-20 07:43:36 more
  • 漫談前端自動化測驗演進之路及測驗工具分析

    隨著前端技術的不斷發展和應用程式的日益復雜,前端自動化測驗也在不斷演進。隨著 Web 應用程式變得越來越復雜,自動化測驗的需求也越來越高。如今,自動化測驗已經成為 Web 應用程式開發程序中不可或缺的一部分,它們可以幫助開發人員更快地發現和修復錯誤,提高應用程式的性能和可靠性。 ......

    uj5u.com 2023-04-20 07:43:16 more
  • CANN開發實踐:4個DVPP記憶體問題的典型案例解讀

    摘要:由于DVPP媒體資料處理功能對存放輸入、輸出資料的記憶體有更高的要求(例如,記憶體首地址128位元組對齊),因此需呼叫專用的記憶體申請介面,那么本期就分享幾個關于DVPP記憶體問題的典型案例,并給出原因分析及解決方法。 本文分享自華為云社區《FAQ_DVPP記憶體問題案例》,作者:昇騰CANN。 DVPP ......

    uj5u.com 2023-04-20 07:43:03 more
  • msf學習

    msf學習 以kali自帶的msf為例 一、msf核心模塊與功能 msf模塊都放在/usr/share/metasploit-framework/modules目錄下 1、auxiliary 輔助模塊,輔助滲透(埠掃描、登錄密碼爆破、漏洞驗證等) 2、encoders 編碼器模塊,主要包含各種編碼 ......

    uj5u.com 2023-04-20 07:42:59 more
  • Halcon軟體安裝與界面簡介

    1. 下載Halcon17版本到到本地 2. 雙擊安裝包后 3. 步驟如下 1.2 Halcon軟體安裝 界面分為四大塊 1. Halcon的五個助手 1) 影像采集助手:與相機連接,設定相機引數,采集影像 2) 標定助手:九點標定或是其它的標定,生成標定檔案及內參外參,可以將像素單位轉換為長度單位 ......

    uj5u.com 2023-04-20 07:42:17 more
  • 在MacOS下使用Unity3D開發游戲

    第一次發博客,先發一下我的游戲開發環境吧。 去年2月份買了一臺MacBookPro2021 M1pro(以下簡稱mbp),這一年來一直在用mbp開發游戲。我大致分享一下我的開發工具以及使用體驗。 1、Unity 官網鏈接: https://unity.cn/releases 我一般使用的Apple ......

    uj5u.com 2023-04-20 07:40:19 more