Search Options

Display Count
Sort
Preferred Language
Advanced Search

Results 1 - 1 of 1 for addExclude (0.04 seconds)

  1. CLAUDE.md

    3. **Add test with sample file** in `src/test/resources/`
    
    ### Configuring URL Filtering
    
    ```java
    // Include patterns (must match)
    crawler.urlFilter.addInclude("https://example.com/.*");
    
    // Exclude patterns (must not match)
    crawler.urlFilter.addExclude(".*\\.(css|js|png|jpg)$");
    ```
    
    ### Setting Crawl Limits
    
    ```java
    context.setMaxAccessCount(1000);  // Max URLs (0 = unlimited)
    Created: Sat Dec 20 11:21:39 GMT 2025
    - Last Modified: Fri Nov 28 17:31:34 GMT 2025
    - 10.7K bytes
    - Click Count (0)
Back to Top