* {@link MemoryDataHelper} to store and manage the URL patterns in memory.
 *
 */
public class UrlFilterServiceImpl implements UrlFilterService {

    /**
     * Creates a new UrlFilterServiceImpl instance.
     */
    public UrlFilterServiceImpl() {
        // NOP
    }

    /**
     * The memory data helper.
     */
    @Resource
    protected MemoryDataHelper dataHelper;

    /*

 * This class provides methods to store, retrieve, update, and delete access results,
 * as well as to iterate over them. It uses a {@link MemoryDataHelper} to store the data in memory.
 *
 * <p>
 * The class uses a static {@code idCount} to generate unique IDs for each access result.
 * The {@code idCountLock} object is used to synchronize access to the {@code idCount} variable,

    client.setConnectionTimeout(30000);     // Connection timeout
    client.setSocketTimeout(60000);         // Read timeout
});
```

### Memory Management

```java
// Configure memory usage
crawler.crawlerContext.setMaxAccessCount(10000);     // Limit crawled URLs
crawler.crawlerContext.setMaxDepth(5);               // Limit crawl depth

// Use streaming for large files

 * This class provides methods for managing a queue of URLs to be crawled,
 * including adding, deleting, and retrieving URLs from the queue.
 * It uses a {@link MemoryDataHelper} to store the URL queue data in memory.
 *
 * <p>
 * The class is responsible for:
 * </p>
 * <ul>
 *   <li>Updating session IDs for URL queues.</li>
 *   <li>Adding new URLs to the queue.</li>

     */
    public void setReplaceDuplication(final boolean replaceDuplication) {
        this.replaceDuplication = replaceDuplication;
    }

    /**
     * Sets the memory size.
     * @param memorySize The memory size.
     */
    public void setMemorySize(final int memorySize) {
        this.memorySize = memorySize;
    }

    /**
     * Sets the maximum size of an alpha-numeric term.

import org.codelibs.fess.crawler.entity.AccessResultImpl;
import org.codelibs.fess.crawler.entity.UrlQueueImpl;

/**
 * The {@code MemoryDataHelper} class provides a helper for managing crawler data in memory.
 * It stores URL queues, access results, and URL patterns for inclusion and exclusion.
 * This class is designed to be used in a single-threaded environment or with external synchronization.
 *

 * {@link ESSourceReader} reads documents from Elasticsearch using the scroll API.
 * It implements the {@link DocumentReader} interface to provide a way to iterate over documents
 * in a large index without loading all of them into memory at once.
 * </p>
 *
 * <p>
 * The reader supports limiting the number of documents read based on a percentage of the total documents

- Verify analyzer configurations

**Performance Issues**
- Increase thread pool size in SuggesterBuilder
- Optimize batch sizes for indexing operations
- Review OpenSearch cluster performance

**Memory Usage**
- Configure appropriate JVM heap settings
- Monitor index sizes and optimize mappings
- Use streaming for large data imports

### Debug Logging

Enable debug logging for detailed troubleshooting:

        for (Thread thread : threads) {
            thread.join();
        }

        // Verify no exceptions
        assertTrue(exceptions.isEmpty());
    }

    /**
     * Test memory reference equality
     */
    public void test_memoryReferenceEquality() {
        // Enum instances are singletons
        CrawlerStatus status1 = CrawlerStatus.INITIALIZING;

        urlFilter.addInclude(".+"); // Match at least one character
        assertTrue(urlFilter.match("https://example.com/"));
        assertFalse(urlFilter.match(""));
    }

    /**
     * Test memory efficiency with large number of patterns
     */
    public void test_largeNumberOfPatterns() {
        String sessionId = "test-session-028";
        urlFilter.init(sessionId);

        // Add many patterns