* such as index, size, tags, roles, fields, languages, and exclusion words.
 *
 * <p>Key functionalities include:</p>
 * <ul>
 *   <li>Setting the target index for the search.</li>
 *   <li>Limiting the number of results (size).</li>
 *   <li>Filtering by tags, roles, fields, and languages.</li>
 *   <li>Excluding specific words from the results.</li>

        }
        longPath.append("file.txt");

        trans2QueryPathInfo = new Trans2QueryPathInformation(config, longPath.toString(), TEST_INFO_LEVEL);

        byte[] buffer = new byte[8192]; // Large buffer for long path
        int written = trans2QueryPathInfo.writeParametersWireFormat(buffer, 0);

        // Should write the entire path
        assertTrue(written > longPath.length());

            System.arraycopy(data, offset, result, 0, length);
            return result;
        }
        if (length > MAX_COMPRESSION_SIZE) {
            throw new CIFSException("Data too large for compression: " + length + " bytes");
        }

        switch (algorithm) {
        case COMPRESSION_NONE:
            byte[] uncompressed = new byte[length];

        final Integer threadCheckCount = (Integer) objs[2];
        if (logger.isDebugEnabled()) {
            if (urlQueue != null && urlQueue.getUrl() != null) {
                logger.debug("{} is not a target url. ({})", urlQueue.getUrl(), threadCheckCount);
            } else {
                logger.debug("The url is null. ({})", threadCheckCount);
            }
        }
    }

    /**

                ErrorCategory.PROTOCOL, false), INVALID_PROTOCOL("Invalid protocol", ErrorCategory.PROTOCOL,
                        false), MESSAGE_TOO_LARGE("Message too large", ErrorCategory.PROTOCOL, false),

        // Resource errors
        OUT_OF_MEMORY("Out of memory", ErrorCategory.RESOURCE, true), TOO_MANY_SESSIONS("Too many sessions", ErrorCategory.RESOURCE,

- `volatile` for status flags
- Synchronized blocks for critical sections
- Thread-local storage via `CrawlingParameterUtil`

**Resource Management**:
- `AutoCloseable` throughout
- `DeferredFileOutputStream` for large responses (temp files for >1MB)
- Connection pooling with limits
- Background temp file deletion via `FileUtil.deleteInBackground()`

**Fault Tolerance**:
- `FaultTolerantClient` wrapper (retry, circuit breaker)

            assertEquals(-1, stream.read()); // Should indicate end of stream
        }
    }

    @Test
    public void testMemoryBasedCacheWithLargeData() throws IOException {
        // Create a large byte array (1MB)
        byte[] data = new byte[1024 * 1024];
        for (int i = 0; i < data.length; i++) {
            data[i] = (byte) (i % 256);
        }

        ContentCache cache = new ContentCache(data);

/**
 * <p>
 * {@link ESSourceReader} reads documents from Elasticsearch using the scroll API.
 * It implements the {@link DocumentReader} interface to provide a way to iterate over documents
 * in a large index without loading all of them into memory at once.
 * </p>
 *
 * <p>
 * The reader supports limiting the number of documents read based on a percentage of the total documents

        // WEB-INF/classes
        buf.append("WEB-INF");
        buf.append(File.separator);
        buf.append("classes");
        // target/classes
        final String userDir = System.getProperty("user.dir");
        final File targetDir = new File(userDir, "target");
        final File targetClassesDir = new File(targetDir, "classes");
        if (targetClassesDir.isDirectory()) {
            buf.append(cpSeparator);

        if (value != null) {
            return value;
        }
        return defaultValue;
    }

    /**
     * Determines if the given path represents a web crawling target.
     * Checks if the path starts with HTTP or HTTPS protocols.
     *
     * @param path the path to check
     * @return true if the path is a web crawling path, false otherwise
     */