labels.menu_system=Sistema
labels.menu_wizard=Asistente
labels.menu_crawl_config=General
labels.menu_scheduler_config=Programador
labels.menu_dashboard_config=Tablero
labels.menu_design=Diseño de página
labels.menu_dict=Diccionario
labels.menu_data=Copia de seguridad/Restauración
labels.menu_crawl=Rastreador
labels.menu_web=Web
labels.menu_file_system=Sistema de archivos

                    if (robotsTxt != null) {
                        final String[] sitemaps = robotsTxt.getSitemaps();
                        if (sitemaps.length > 0) {
                            crawlerContext.addSitemaps(sitemaps);
                        }

                        final RobotsTxt.Directive directive = robotsTxt.getMatchedDirective(userAgent);

    is now asynchronous and they may be enqueued before the web socket is connected.

 *  **OkHttp no longer attempts a direct connection if the system's HTTP proxy fails.** This
    behavior was surprising because OkHttp was disregarding the user's specified configuration. If
    you need to customize proxy fallback behavior, implement your own `java.net.ProxySelector`.