- Sort Score
- Result 10 results
- Languages All
Results 1 - 1 of 1 for addExcludes (0.06 sec)
-
CLAUDE.md
### Configuring URL Filtering ```java // Include patterns (must match) crawler.urlFilter.addInclude("https://example.com/.*"); // Exclude patterns (must not match) crawler.urlFilter.addExclude(".*\\.(css|js|png|jpg)$"); ``` ### Setting Crawl Limits ```java context.setMaxAccessCount(1000); // Max URLs (0 = unlimited) context.setMaxDepth(3); // Max depth (-1 = unlimited)
Registered: Sat Dec 20 11:21:39 UTC 2025 - Last Modified: Fri Nov 28 17:31:34 UTC 2025 - 10.7K bytes - Viewed (0)