es學習筆記

臨近過年,小弟我上班閑來無事,左翻翻又看看,甚是無聊,思來想去還是b站有意思.每天給我推薦學習資料,沉迷學習,難以自拔,光看不不練吧,假把式,故記下筆記一篇.希望和大家攜手共進,學習java,從入門到入土…

一 docker安裝es,kibana,ik

拉取es鏡像

docker pull elasticsearch:7.4.2

拉取kibana鏡像:可視化資料檢索

docker pull kibana:7.4.2

創建es容器

mkdir -p /home/mrmei/mydata/elasticsearch/config  //創建需要掛載外部組態檔的目錄
mkdir -p /home/mrmei/mydata/elasticsearch/data //創建需要掛載外部資料檔案的目錄
mkdir -p /home/mrmei/mydata/elasticsearch/data //創建插件掛載目錄
//組態檔配置跨域
echo "http.host: 0.0.0.0" >> /mydata/elasticsearch/config/elasticsearch.yml
chmod -R 777 /mydata/elasticsearch/ //保證目錄權限
//創建并運行容器
docker run --name elasticsearch -p 9200:9200 -p 9300:9300 \
-e "discovery.type=single-node" \
-e ES_JAVA_OPTS="-Xms64m -Xmx512m" \
-v /home/mrmei/mydata/elasticsearch/config/elasticsearch.yml:/usr/share/elasticsearch/config/elasticsearch.yml \
-v /home/mrmei/mydata/elasticsearch/data:/usr/share/elasticsearch/data \
-v /home/mrmei/mydata/elasticsearch/plugins:/usr/share/elasticsearch/plugins \
-d elasticsearch:7.4.2

創建kibana容器

docker run --name kibana -e ELASTICSEARCH_HOSTS=http://192.168.217.128:9200 -p 5601:5601 -d kibana:7.4.2 //ip地址修改為虛擬機地址

kibana圖形化界面訪問地址

http://192.168.217.128:5601/

ki分詞器

https://github.com/medcl/elasticsearch-analysis-ik/releases 選擇es對應版本的ik分詞器

//直接在外部掛載的plugins目錄下安裝ik分詞器
//安裝wget
yum -y install wget
//拉取ki分詞器
//進入plugins目錄
wget https://github.com/medcl/elasticsearch-analysis-ik/releases/download/v7.4.2/elasticsearch-analysis-ik-7.4.2.zip
//安裝unzip
unzip elasticsearch-analysis-ik-7.4.2.zip
//洗掉壓縮包
rm -r *.zip

自定義詞庫

修改/usr/share/elasticsearch/plugins/ik/config/中的 IKAnalyzer.cfg.xml

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE properties SYSTEM "http://java.sun.com/dtd/properties.dtd">
<properties> <comment>IK Analyzer 擴展配置</comment>
    <!--用戶可以在這里配置自己的擴展字典 --> 
    <entry key="ext_dict"></entry> 
    <!--用戶可以在這里配置自己的擴展停止詞字典--> 
    <entry key="ext_stopwords"></entry> <!--用戶可以在這里配置遠程擴展字典 -->
    <entry key="remote_ext_dict">http://192.168.128.130/fenci/myword.txt</entry>
    <!--用戶可以在這里配置遠程擴展停止詞字典--> 
    <!-- <entry key="remote_ext_stopwords">words_location</entry> -->
</properties>

二 檢索

官方檔案地址:https://www.elastic.co/guide/index.html

1 Elasticsearch-rest-client

1. 9300:tcp
2. 9200:http
   • JestClient:非官方,更新比較慢
   • RestTemplate:模擬發送請求,需要自己封裝請求,比較麻煩
   • HttpClient:同上
   • Elasticsearche-Rest-Client:官方RestClient,封裝ES操作上手簡單

https://www.elastic.co/guide/en/elasticsearch/client/java-rest

2 SpringBoot整合es

匯入依賴(版本與es保持一致)

<dependency>
    <groupId>org.elasticsearch.client</groupId>
    <artifactId>elasticsearch-rest-high-level-client</artifactId>
    <version>7.4.2</version>
</dependency>

出現了6.4.3版本的依賴,springboot默認集成的高級客戶端的版本

[外鏈圖片轉存失敗,源站可能有防盜鏈機制,建議將圖片保存下來直接上傳(img-elkfBiIR-1612755150786)(C:\Users\pc\AppData\Roaming\Typora\typora-user-images\image-20210206143926404.png)]

在pom檔案的properties中配置版本

<properties>
    <java.version>1.8</java.version>
    <elasticsearch.version>7.4.2</elasticsearch.version>
</properties>

注入配置類

@Configuration
public class ElasticSearchConfig {
    @Bean
    public RestHighLevelClient esRestClient(){
        RestClientBuilder builder = RestClient.builder(
                new HttpHost("192.168.217.128", 9200, "http")
        );
        return new RestHighLevelClient(builder);
    }
}

3 client檢索測驗

請求設定項RequestOptions https://www.elastic.co/guide/en/elasticsearch/client/java-rest/7.5/java-rest-low-usage-requests.html#java-rest-low-usage-request-options

private static final RequestOptions COMMON_OPTIONS;
static {
    RequestOptions.Builder builder = RequestOptions.DEFAULT.toBuilder();
    builder.addHeader("Authorization", "Bearer " + TOKEN); 
    builder.setHttpAsyncResponseConsumerFactory(           
        new HttpAsyncResponseConsumerFactory
            .HeapBufferedResponseConsumerFactory(30 * 1024 * 1024 * 1024));
    COMMON_OPTIONS = builder.build();
}

測驗存盤/更新資料

/**
* 測驗存盤資料到es
* 更新也ok
*/
@Test
public void test() throws IOException {
    //創建索引的請求
    IndexRequest indexRequest = new IndexRequest("users");
    //資料的id
    indexRequest.id("1");
    //json字串
    User user = new User("張三", "123456", 18);
    Object str = JSON.toJSON(user);
    //要保存的資訊
    indexRequest.source(str, XContentType.JSON);
    //發送請求
    IndexResponse res = client.index(indexRequest, ElasticSearchConfig.COMMON_OPTIONS);
    log.info(res.toString());
}

GET /users/_search

檢索 https://www.elastic.co/guide/en/elasticsearch/client/java-rest/7.5/java-rest-high-search.html

/**
     * 測驗搜索
     */
    @Test
    public void testSearch() throws IOException {
        //創建檢索請求
        SearchRequest request = new SearchRequest();
        request.indices("users");
        //構建檢索條件
        //SearchSourceBuilder 封裝條件
        SearchSourceBuilder builder = new SearchSourceBuilder();
        /*builder.query(); 查詢條件
        builder.from(); 分頁
        builder.size();
        builder.aggregation(); 聚合
        */
        builder.query(QueryBuilders.matchQuery("name","zhangsan"));
        builder.aggregation(AggregationBuilders.sum("sumAge").field("age"));
        request.source(builder);
        //執行檢索
        SearchResponse response = client.search(request, ElasticSearchConfig.COMMON_OPTIONS);
        //獲取回傳的結果
        System.out.println(response);
        //獲取所有命中的記錄 最外成hits
        SearchHits hits = response.getHits();
        //里層hits
        SearchHit[] hits1 = hits.getHits();
        for(SearchHit hit :hits){
            User user = JSONUtil.toBean(hit.getSourceAsString(), User.class);
        }
        //獲取聚合資訊
        Aggregations aggregations = response.getAggregations();
        Terms sumAge = aggregations.get("sumAge");
    }

祝大家新年快樂!!!