- Sort Score
- Result 10 results
- Languages All
Results 1 - 3 of 3 for Tokenize (0.03 sec)
-
src/main/java/org/codelibs/fess/suggest/converter/KatakanaConverter.java
* use a tokenizer to process the input. * * <p> * The class provides methods to initialize the converter, convert strings, and * check if a tokenizer is enabled. It also includes methods to create a token * stream and extract reading information from the stream's attributes, although * the tokenizer-related functionality is currently commented out. * </p> */
Registered: Fri Sep 19 09:08:11 UTC 2025 - Last Modified: Fri Jul 04 14:00:23 UTC 2025 - 6.1K bytes - Viewed (0) -
src/test/java/org/codelibs/fess/suggest/analysis/SuggestAnalyzerTest.java
List<AnalyzeToken> tokens = analyzer.analyzeAndReading(text, field, lang); assertNotNull(tokens); assertEquals(2, tokens.size()); // "Test123" and "ABC-456" (hyphen is not a split char in our tokenizer) assertEquals("Test123", tokens.get(0).getTerm()); assertEquals("ABC-456", tokens.get(1).getTerm()); assertEquals("TEST123", ((TestAnalyzeToken) tokens.get(0)).getReading());Registered: Fri Sep 19 09:08:11 UTC 2025 - Last Modified: Mon Sep 01 13:33:03 UTC 2025 - 15.7K bytes - Viewed (0) -
src/test/java/org/codelibs/fess/suggest/converter/AnalyzerConverterTest.java
.put("analysis.analyzer.test_reading_analyzer.tokenizer", "standard") .put("analysis.analyzer.test_reading_term_analyzer.type", "custom") .put("analysis.analyzer.test_reading_term_analyzer.tokenizer", "standard") .put("analysis.analyzer.test_reading_analyzer_ja.type", "custom") .put("analysis.analyzer.test_reading_analyzer_ja.tokenizer", "keyword")
Registered: Fri Sep 19 09:08:11 UTC 2025 - Last Modified: Mon Sep 01 13:33:03 UTC 2025 - 12.5K bytes - Viewed (0)