+ ") from disabled repository " + repository.getId() + " ("
                                        + repository.getUrl() + ")");
                    }
                } else if (request.isForceUpdate()) {
                    update = true;

        }
        final Extractor extractor = extractorFactory.getExtractor(responseData.getMimeType());
        if (logger.isDebugEnabled()) {
            logger.debug("url={}, extractor={}", responseData.getUrl(), extractor);
        }
        return extractor;
    }

        this.filterType = filterType;
    }

    /**
     * Returns the URL.
     * @return The URL.
     */
    public String getUrl() {
        return url;
    }

    /**
     * Sets the URL.
     * @param url The URL.
     */
    public void setUrl(final String url) {
        this.url = url;
    }

    /**
     * Converts this URL filter to XContent format for OpenSearch indexing.

            if (!list.isEmpty()) {
                final List<String> newUrlList = new ArrayList<>(list.size());
                for (final FavoriteLog favoriteLog : list) {
                    newUrlList.add(favoriteLog.getUrl());
                }
                return newUrlList;
            }
            return Collections.<String> emptyList();
        }).orElse(Collections.<String> emptyList());

    }

        if (r1 == r2) {
            return true;
        }

        return Objects.equals(r1.getId(), r2.getId())
                && Objects.equals(r1.getUrl(), r2.getUrl())
                && repositoryPolicyEquals(r1.getReleases(), r2.getReleases())
                && repositoryPolicyEquals(r1.getSnapshots(), r2.getSnapshots());
    }

    void setRuleId(String ruleId);

    /**
     * Returns the URL of the accessed resource.
     *
     * @return the URL
     */
    String getUrl();

    /**
     * Sets the URL of the accessed resource.
     *
     * @param url the URL
     */
    void setUrl(String url);

    /**
     * Returns the parent URL of the accessed resource.
     *
     * @return the parent URL
     */

    /**
     * Retrieves the URL from the queue.
     *
     * @return the URL as a String.
     */
    String getUrl();

    /**
     * Sets the URL for this UrlQueue.
     *
     * @param url the URL to be set
     */
    void setUrl(String url);

    /**
     * Retrieves the metadata associated with the URL queue.
     *
     * @return a String representing the metadata.
     */

    public String getLocation() {
        return url.toString();
    }

    /**
     * Gets the URL of this source.
     *
     * @return The underlying URL, never {@code null}.
     */
    public URL getUrl() {
        return url;
    }

    @Override
    public String toString() {
        return getLocation();
    }

    @Override
    public int hashCode() {
        return hashCode;
    }

            CloseableUtil.closeQuietly(fos); // for deleting file
            FileUtil.deleteInBackground(tempFile); // clean up
            throw new CrawlingAccessException("Could not read a response body: " + responseData.getUrl(), e);
        } finally {
            CloseableUtil.closeQuietly(fos);
        }
        return tempFile;
    }

        Repository repo = new Repository();

        repo.setId(profileXmlRepo.getId());
        repo.setLayout(profileXmlRepo.getLayout());
        repo.setName(profileXmlRepo.getName());
        repo.setUrl(profileXmlRepo.getUrl());

        if (profileXmlRepo.getSnapshots() != null) {
            repo.setSnapshots(convertRepositoryPolicy(profileXmlRepo.getSnapshots()));
        }
        if (profileXmlRepo.getReleases() != null) {