Search Options

Display Count
Sort
Preferred Language
Advanced Search

Results 1 - 4 of 4 for addInclude (0.05 seconds)

The search processing time has exceeded the limit. The displayed results may be partial.

  2. github.com/codelibs/fess-crawler

    README.md 

    ```

### URL Filtering

```java
// Include patterns
crawler.urlFilter.addInclude("https://example.com/.*");
crawler.urlFilter.addInclude(".*\\.pdf$");

// Exclude patterns  
crawler.urlFilter.addExclude(".*\\.js$");
crawler.urlFilter.addExclude(".*login.*");
```

## Supported Protocols and Formats

### Protocols
    Created: Sun Apr 12 03:50:13 GMT 2026
    - Last Modified: Sun Aug 31 05:32:52 GMT 2025
    - 15.3K bytes
    - Click Count (0)
  3. github.com/codelibs/fess-crawler

    fess-crawler-lasta/src/test/java/org/codelibs/fess/crawler/CrawlerTest.java 

            crawler.crawlerContext.setMaxAccessCount(maxCount);
        crawler.crawlerContext.setNumOfThread(numOfThread);
        crawler.urlFilter.addInclude(url + ".*");
        crawler.urlFilter.addExclude(url + "/dir1/.*");
        final String sessionId = crawler.execute();
        assertEquals(maxCount, dataService.getCount(sessionId));
        dataService.delete(sessionId);
    }
    Created: Sun Apr 12 03:50:13 GMT 2026
    - Last Modified: Thu Jan 15 01:11:43 GMT 2026
    - 13.1K bytes
    - Click Count (0)
  4. github.com/codelibs/fess-crawler

    fess-crawler/src/main/java/org/codelibs/fess/crawler/client/http/Hc4HttpClient.java 

                                            final String urlValue = hostUrl + urlPattern;
                                        crawlerContext.getUrlFilter().addInclude(urlValue);
                                        if (logger.isInfoEnabled()) {
                                            logger.info("Included URL: {}", urlValue);
                                        }
    Created: Sun Apr 12 03:50:13 GMT 2026
    - Last Modified: Fri Jan 09 23:46:52 GMT 2026
    - 54.4K bytes
    - Click Count (0)
  5. github.com/codelibs/fess-crawler

    fess-crawler/src/main/java/org/codelibs/fess/crawler/client/http/Hc5HttpClient.java 

                                            final String urlValue = hostUrl + urlPattern;
                                        crawlerContext.getUrlFilter().addInclude(urlValue);
                                        if (logger.isInfoEnabled()) {
                                            logger.info("Included URL: {}", urlValue);
                                        }
    Created: Sun Apr 12 03:50:13 GMT 2026
    - Last Modified: Sat Jan 31 12:23:29 GMT 2026
    - 62.2K bytes
    - Click Count (0)
Back to Top