throw exception;
        }
    }

    /**
     * Calculates the limit document number based on total, percentage, and number.
     * @param total The total number of documents.
     * @param limitPercentage The limit percentage.
     * @param limitNumber The limit number.
     * @return The calculated limit document number.
     */

 * The delayBeforeProcessing method is overridden to introduce a delay before processing a URL,
 * ensuring that requests to the same host are not made too frequently.
 * The delay is calculated based on the configured delayMillisBeforeProcessing parameter.
 * If the time since the last request to the host is less than the configured delay,
 * the thread waits until the delay has elapsed.
 * This class is thread-safe.