url = url.replaceFirst("/[^/]+/\\.\\./", "/");
        }

        return url.replaceAll("([^:])/+", "$1/");
    }

    /**
     * Checks if a path is valid for crawling (not a JavaScript, mailto, or other invalid URL).
     *
     * @param path the path to validate
     * @return true if the path is valid, false otherwise
     */
    protected boolean isValidPath(final String path) {

   * Glob patterns must be unique, if there's a clash assign to the most
     popular format
   * The main mime type should be the canonical one, use aliases for any
     other widely used forms
   * Where there's a hierarchy in the types, list it via a parent
   * Highly specific magic matches get a high priority
   * General magic matches which could trigger a false-positive need
     a low one

     * It handles SSL/TLS configuration, authentication, and various FTP client settings.
     *
     * @param info The FTP information containing host, port, and other connection details
     * @return A configured FTP client ready for use
     * @throws IOException If the FTP client cannot be created or connected
     */