* governing permissions and limitations under the License.
 */
package org.codelibs.fess.crawler.exception;

/**
 * Exception thrown during the extraction process in the crawler.
 * This exception indicates a failure or error that occurred while extracting content from a crawled resource.
 * It extends {@link org.codelibs.fess.crawler.exception.CrawlerSystemException} and provides constructors

 * and processing them according to specific rules. The main functionality is encapsulated
 * within the nested {@link TextNormalizeContext} class.
 *
 * <p>The text normalization process includes:
 * <ul>
 *   <li>Treating ISO control characters and specified space characters as spaces.</li>
 *   <li>Appending alphanumeric characters (0-9, A-Z, a-z) to the buffer.</li>

 */
package org.codelibs.fess.crawler.exception;

/**
 * CrawlingAccessException is an exception class that represents an issue encountered while accessing a resource during the crawling process.
 * It extends CrawlerSystemException and provides functionality to set and check the log level for the exception.
 *
 * <p>

    /**
     * Add an url pattern as a non-target.
     *
     * @param urlPattern Regular expression that is not crawled
     */
    void addExclude(String urlPattern);

    /**
     * Process an url when it's added as a seed url.
     *
     * @param url URL
     */
    void processUrl(String url);

    /**
     * Clear this filter.
     */
    void clear();

        private final String name;
        private int processCount = 0;

        public TestResponseProcessor(String name) {
            this.name = name;
        }

        @Override
        public void process(ResponseData responseData) {
            processCount++;
        }

        public String getName() {
            return name;
        }

        public int getProcessCount() {

        return xmlEncodingPattern;
    }

    /**
     * Returns the precompiled {@link Pattern} used to match XML tags within the content.
     * This pattern is utilized by the extractor to identify and process XML elements.
     *
     * @return the {@link Pattern} instance for XML tag matching
     */
    @Override
    protected Pattern getTagPattern() {
        return xmlTagPattern;
    }

    /**

 *
 * <p>The conversion is performed by iterating through the conversion map and applying
 * each replacement rule sequentially. The order of the rules in the map is preserved
 * during the conversion process.</p>
 *
 * <p>Example usage:</p>
 *
 * <pre>{@code
 * UrlConvertHelper helper = new UrlConvertHelper();
 * helper.add("old-domain.com", "new-domain.com");

 * to process and analyze the input data.</p>
 *
 * <p>It also handles the exclusion of search words based on certain criteria and manages the
 * maximum length of analyzed content.</p>
 *
 * <p>Methods in this class may throw SuggesterException in case of failures during the parsing process.</p>
 *
 * <p>Usage example:</p>
 * <pre>
 * {@code

 *   <li>Embedded document extraction</li>
 *   <li>Annotation extraction (file attachments)</li>
 *   <li>Metadata extraction</li>
 *   <li>Password-protected PDF support</li>
 *   <li>Configurable timeout for extraction process</li>
 * </ul>
 *
 * @author shinsuke
 */
public class PdfExtractor extends PasswordBasedExtractor {
    /** Logger instance for this class. */

import com.ibm.icu.text.Transliterator;

/**
 * {@link KatakanaConverter} converts input strings to katakana representation.
 * It utilizes a transliterator to convert hiragana to katakana and can optionally
 * use a tokenizer to process the input.
 *
 * <p>
 * The class provides methods to initialize the converter, convert strings, and
 * check if a tokenizer is enabled. It also includes methods to create a token