*   <li>Extracting child URLs and adding them to the queue using {@link #storeChildUrls(Set, String, int)}
 *       or {@link #storeChildUrl(String, String, float, int)}.</li>
 *   <li>Handling exceptions that may occur during the crawling process.</li>
 * </ol>
 *
 * <p>
 * The thread also manages the active thread count using {@code crawlerContext.activeThreadCountLock}

 *   <li>Building the query and filter query for the suggestion request.</li>
 *   <li>Processing the request and handling the response or failure.</li>
 *   <li>Creating the response from the search results.</li>
 * </ul>
 *
 * <p>Example usage:</p>
 * <pre>
 * SuggestRequest suggestRequest = new SuggestRequest();

 *   <li>Storing the HTML content as data in the {@link ResultData}.</li>
 *   <li>Extracting child URLs from the HTML content based on configured rules.</li>
 *   <li>Handling redirect URLs specified in the response headers.</li>
 * </ol>
 * <p>
 * The class also provides methods for configuring features and properties of the

     *
     * @param scrollSize The scroll size.
     */
    public void setScrollSize(final int scrollSize) {
        this.scrollSize = scrollSize;
    }

    /**
     * Converter for handling timestamps in OpenSearch.
     */
    protected static class EsTimestampConverter implements Converter {
        /**
         * Creates a new instance of EsTimestampConverter.
         */

import org.opensearch.transport.client.Client;

/**
 * The SuggestIndexer class is responsible for indexing and managing suggest items in an OpenSearch index.
 * It provides methods to index, delete, and manage suggest items, including handling bad words and elevate words.
 *
 * <p>Constructor:
 * <ul>
 * <li>{@link #SuggestIndexer(Client, String, ReadingConverter, ReadingConverter, Normalizer, SuggestAnalyzer, SuggestSettings, ExecutorService)}
 * </ul>
 *

        }
    }

    /**
     * Processes an HTTP method request and returns the response data.
     * This method handles the complete HTTP request lifecycle including content processing,
     * redirect handling, and error management.
     *
     * @param url The URL being accessed
     * @param httpRequest The HTTP request to process
     * @return The response data containing the retrieved information
     */

 * It supports password-protected PDFs and can extract embedded documents and annotations.
 *
 * <p>The extractor runs text extraction in a separate thread with a configurable timeout
 * to prevent hanging on problematic PDF files. It also extracts metadata from the PDF
 * document and includes it in the extraction result.
 *
 * <p>Features:
 * <ul>
 *   <li>Text extraction from PDF pages</li>