Search Options

Results per page
Sort
Preferred Languages
Advance

Results 11 - 20 of 24 for tokenize (0.32 sec)

  2. github.com/codelibs/fess

    src/main/resources/suggest_indices/_aws/suggest_analyzer.json 

            "tokenizer" : "standard"
      },
      "reading_term_analyzer_mk" : {
        "type" : "custom",
        "tokenizer" : "standard"
      },
      "normalize_analyzer_mk" : {
        "type" : "custom",
        "tokenizer" : "keyword",
        "char_filter" : ["mapping_char"],
        "filter" : ["lowercase"]
      },
      "contents_analyzer_mk" : {
        "type" : "custom",
        "tokenizer" : "standard",
    Registered: Thu Sep 04 12:52:25 UTC 2025
    - Last Modified: Wed Mar 24 12:55:37 UTC 2021
    - 57.4K bytes
    - Viewed (0)
  3. github.com/codelibs/fess

    src/main/resources/suggest_indices/suggest_analyzer.json 

            "tokenizer" : "standard"
      },
      "reading_term_analyzer_mk" : {
        "type" : "custom",
        "tokenizer" : "standard"
      },
      "normalize_analyzer_mk" : {
        "type" : "custom",
        "tokenizer" : "keyword",
        "char_filter" : ["mapping_char"],
        "filter" : ["lowercase"]
      },
      "contents_analyzer_mk" : {
        "type" : "custom",
        "tokenizer" : "standard",
    Registered: Thu Sep 04 12:52:25 UTC 2025
    - Last Modified: Thu May 23 05:09:51 UTC 2019
    - 57.7K bytes
    - Viewed (0)
  4. github.com/codelibs/corelib

    src/test/java/org/codelibs/core/text/TokenizerTest.java 

        public void testEOF() throws Exception {
        final Tokenizer tokenizer = new Tokenizer("");
        assertThat(tokenizer.nextToken(), is(Tokenizer.TT_EOF));
        assertThat(tokenizer.nextToken(), is(Tokenizer.TT_EOF));
    }

    /**
     * @throws Exception
     */
    @Test
    public void testWhitespace() throws Exception {
        final Tokenizer tokenizer = new Tokenizer("\t       \n");
    Registered: Fri Sep 05 20:58:11 UTC 2025
    - Last Modified: Sat May 10 01:32:17 UTC 2025
    - 2K bytes
    - Viewed (0)
  5. github.com/codelibs/fess

    src/main/resources/fess_indices/fess_config.data_config.json 

          "number_of_shards": 1,
      "number_of_replicas": 0,
      "auto_expand_replicas": "0-1"
    },
    "analysis": {
      "analyzer": {
        "standard_analyzer": {
          "type": "custom",
          "tokenizer": "standard",
          "filter": [
            "cjk_width",
            "asciifolding",
            "lowercase",
            "stop",
            "stemmer"
          ]
        }
      }
    }
  }
    Registered: Thu Sep 04 12:52:25 UTC 2025
    - Last Modified: Thu Dec 02 13:14:56 UTC 2021
    - 484 bytes
    - Viewed (0)
  6. github.com/codelibs/fess

    src/main/resources/fess_indices/fess_config.file_config.json 

          "number_of_shards": 1,
      "number_of_replicas": 0,
      "auto_expand_replicas": "0-1"
    },
    "analysis": {
      "analyzer": {
        "standard_analyzer": {
          "type": "custom",
          "tokenizer": "standard",
          "filter": [
            "cjk_width",
            "asciifolding",
            "lowercase",
            "stop",
            "stemmer"
          ]
        }
      }
    }
  }
    Registered: Thu Sep 04 12:52:25 UTC 2025
    - Last Modified: Thu Dec 02 13:14:56 UTC 2021
    - 484 bytes
    - Viewed (0)
  7. github.com/codelibs/fess

    src/main/resources/fess_indices/fess_config.web_config.json 

          "number_of_shards": 1,
      "number_of_replicas": 0,
      "auto_expand_replicas": "0-1"
    },
    "analysis": {
      "analyzer": {
        "standard_analyzer": {
          "type": "custom",
          "tokenizer": "standard",
          "filter": [
            "cjk_width",
            "asciifolding",
            "lowercase",
            "stop",
            "stemmer"
          ]
        }
      }
    }
  }
    Registered: Thu Sep 04 12:52:25 UTC 2025
    - Last Modified: Thu Dec 02 13:14:56 UTC 2021
    - 484 bytes
    - Viewed (0)
  8. github.com/codelibs/fess

    src/main/resources/fess_indices/_aws/fess.json 

              "type": "custom",
          "tokenizer": "standard",
          "filter": [
            "truncate20_filter",
            "lowercase",
            "arabic_stop",
            "arabic_normalization",
            "arabic_keywords",
            "arabic_override",
            "arabic_stemmer"
          ]
        },
        "armenian_analyzer": {
          "tokenizer":  "standard",
          "filter": [
    Registered: Thu Sep 04 12:52:25 UTC 2025
    - Last Modified: Sat Jun 14 00:36:40 UTC 2025
    - 117.3K bytes
    - Viewed (0)
  9. github.com/codelibs/fess

    src/main/resources/fess_indices/_cloud/fess.json 

              "type": "custom",
          "tokenizer": "standard",
          "filter": [
            "truncate20_filter",
            "lowercase",
            "arabic_stop",
            "arabic_normalization",
            "arabic_keywords",
            "arabic_override",
            "arabic_stemmer"
          ]
        },
        "armenian_analyzer": {
          "tokenizer":  "standard",
          "filter": [
    Registered: Thu Sep 04 12:52:25 UTC 2025
    - Last Modified: Sat Feb 27 09:26:16 UTC 2021
    - 117.3K bytes
    - Viewed (0)
  10. github.com/codelibs/corelib

    README.md 

    String escaped = JsonUtil.escape("Hello \"World\" with special chars");
String unescaped = JsonUtil.unescape(escaped);

// Text tokenization
Tokenizer tokenizer = new Tokenizer("field1,field2,field3", ",");
while (tokenizer.hasMoreTokens()) {
    String token = tokenizer.nextToken();
    // Process each token
}

// Decimal formatting
DecimalFormat format = DecimalFormatUtil.getDecimalFormat("###,###.00");
```
    Registered: Fri Sep 05 20:58:11 UTC 2025
    - Last Modified: Sun Aug 31 02:56:02 UTC 2025
    - 12.7K bytes
    - Viewed (0)
  11. github.com/kubernetes/kubernetes

    CHANGELOG/CHANGELOG-1.13.md 

    * client-go: restores behavior of populating the BearerToken field in rest.Config objects constructed from kubeconfig files containing tokenFile config, or from in-cluster configuration. An additional BearerTokenFile field is now populated to enable constructed clients to periodically refresh tokens. ([#71713](https://github.com/kubernetes/kubernetes/pull/71713), [@liggitt](https://github.com/liggitt))...
    Registered: Fri Sep 05 09:05:11 UTC 2025
    - Last Modified: Thu May 05 13:44:43 UTC 2022
    - 273.1K bytes
    - Viewed (0)
Back to top