* to perform its tasks.
 * </p>
 *
 * <p>
 * The crawling process involves the following steps:
 * </p>
 * <ol>
 *   <li>Fetching a URL from the queue using {@link UrlQueueService#poll(String)}.</li>
 *   <li>Checking if the URL is valid using {@link #isValid(UrlQueue)}.</li>
 *   <li>Accessing the content using a {@link CrawlerClient} obtained from {@link CrawlerClientFactory}.</li>

 * of crawled documents into the search engine.
 *
 * <p>The DataIndexHelper supports:</p>
 * <ul>
 *   <li>Concurrent crawling of multiple data configurations</li>
 *   <li>Thread pool management for crawler execution</li>
 *   <li>Session-based crawling with cleanup operations</li>
 *   <li>Old document deletion after successful crawling</li>
 *   <li>Crawling execution monitoring and timing</li>
 * </ul>

        return path.replaceAll("\\\\+", "/");
    }

    // Object pooling methods for performance optimization
    private AuditEntry getAuditEntry() {
        AuditEntry entry = auditEntryPool.poll();
        if (entry == null) {
            entry = new AuditEntry();
        } else {
            // Reset the entry
            entry.context = null;
            entry.message = null;

errors.invalid_query_parse_error = Podane zapytanie jest nieprawidłowe.
errors.invalid_query_sort_value = Określona wartość sortowania {0} jest nieprawidłowa.
errors.invalid_query_unsupported_sort_field = Określone pole sortowania {0} nie jest obsługiwane.
errors.invalid_query_unsupported_sort_order = Określona kolejność sortowania {0} nie jest obsługiwana.
errors.invalid_query_cannot_process=Nie można przetworzyć określonego zapytania.

int maxDepth = -1               // Max depth (-1 = unlimited)
long maxAccessCount = 0         // Max URLs (0 = unlimited)
```

### CrawlerThread (`CrawlerThread.java`)

Worker thread for crawling.

**Flow**: Poll URL → Validate → Get client → Delay → Check last-modified → Execute → Process → Extract children → Queue children → Delay

### CrawlerClientFactory

Pattern-based client selection using `LinkedHashMap<Pattern, CrawlerClient>`.

    }

    @Override
    public synchronized Map<String, Object> read() {
        while (!isFinished.get() && queue.isEmpty()) {
            addDocumentToQueue();
        }

        return queue.poll();
    }

    @Override
    public void close() {
        isFinished.set(true);
        queue.clear();
    }

    /**
     * Sets the scroll size.
     * @param scrollSize The scroll size.

        if (!leakDetectionEnabled) {
            return;
        }

        // Process phantom references to detect leaks
        Reference<?> ref;
        while ((ref = referenceQueue.poll()) != null) {
            handlePhantomReference(ref);
        }

        // Check for old unclosed resources
        long now = System.currentTimeMillis();

        final List<SearchLog> searchLogList = new ArrayList<>();
        final Map<String, UserInfo> userInfoMap = new HashMap<>();
        while (!queue.isEmpty()) {
            final SearchLog searchLog = queue.poll();
            if (searchLog != null) {
                final String userAgent = searchLog.getUserAgent();
                final boolean isBot =

            }
        }
    }

    static MyToken getNextUniqueToken(final PriorityQueue<MyToken> que, final MyToken prev) {
        while (true) {
            final MyToken token = que.poll();
            if (token == null) {
                return null;
            }
            if (prev == null || !prev.identical(token)) {
                return token;
            }
        }
    }

    }

    @Test
    public void testThreadPoolMethod() {
        CurlRequest request = new CurlRequest(Method.GET, "https://example.com");
        ForkJoinPool pool = new ForkJoinPool();

        CurlRequest result = request.threadPool(pool);

        assertSame(request, result); // Fluent API
    }

    @Test
    public void testEncodingSpecialCharacters() {