我在 JAVA 程式中使用模式標記器。我正在使用正則運算式:“\p{Punct}{1}”
我還使用相同的正則運算式創建了一個 JAVA 程式。但是,當我用相同的模式比較 JAVA 程式和 elasticsearch 分析器的結果時,它們是不同的。
我的 JAVA 檔案中的代碼是:
import java.util.regex.Matcher;
import java.util.regex.Pattern;
import java.util.*;
public class characters {
public static void main(String[] args) {
String userInput = "HTTps://www.google.cOM/";
userInput = userInput.toLowerCase();
Pattern pattern = Pattern.compile("\\p{Punct}{1}");
List<String> list = new ArrayList<String>();
Matcher m = pattern.matcher(userInput);
while (m.find()) {
list.add(m.group());
}
System.out.println(list);
}
}
上面的程式給出了以下結果:
[:, /, /, ., ., /]
elasticsearch模式檔案中的代碼是:
import org.apache.lucene.analysis.Tokenizer;
import org.apache.lucene.analysis.pattern.PatternTokenizer;
import org.elasticsearch.common.regex.Regex;
import org.elasticsearch.common.settings.Settings;
import org.elasticsearch.env.Environment;
import org.elasticsearch.index.IndexSettings;
import org.elasticsearch.index.analysis.AbstractTokenizerFactory;
import java.util.regex.Pattern;
public class UrlTokenizerFactory extends AbstractTokenizerFactory {
private final Pattern pattern;
private final int group;
public UrlTokenizerFactory(IndexSettings indexSettings, Environment environment, String name, Settings settings) {
super(indexSettings, name, settings);
String sPattern = settings.get("pattern", "\\p{Punct}{1}");
if (sPattern == null) {
throw new IllegalArgumentException("pattern is missing for [" name "] tokenizer of type 'pattern'");
}
this.pattern = Regex.compile(sPattern, settings.get("flags"));
this.group = settings.getAsInt("group", -1);
}
@Override
public Tokenizer create() {
return new PatternTokenizer(pattern, group);
}
}
它正在生成以下結果:
"tokens" : [
{
"token" : "https",
"start_offset" : 0,
"end_offset" : 5,
"type" : "word",
"position" : 0
},
{
"token" : "www",
"start_offset" : 8,
"end_offset" : 11,
"type" : "word",
"position" : 1
},
{
"token" : "google",
"start_offset" : 12,
"end_offset" : 18,
"type" : "word",
"position" : 2
},
{
"token" : "com",
"start_offset" : 19,
"end_offset" : 22,
"type" : "word",
"position" : 3
}
]
所需的結果是 JAVA 檔案的結果。但是,在彈性搜索的情況下,我得到了不同的結果。
uj5u.com熱心網友回復:
我能夠通過簡單地改變值來解決這個問題
this.group = settings.getAsInt("group", -1);
到:
this.group = settings.getAsInt("group", 0);
在我的 patternTokenizer 檔案中。
轉載請註明出處,本文鏈接:https://www.uj5u.com/ruanti/453960.html
