</component>

	<component name="clientFactory"
		class="org.codelibs.fess.crawler.client.CrawlerClientFactory" instance="prototype">
		<postConstruct name="addClient">
			<arg>["http:.*", "https:.*"]</arg>
			<arg>httpClient</arg>
		</postConstruct>
		<postConstruct name="addClient">
			<arg>"file:.*"</arg>
			<arg>fsClient</arg>
		</postConstruct>
		<postConstruct name="addClient">

        List<String> urls = new ArrayList<>();
        urls.add("http://example.com/page1");
        urls.add("http://example.com/page2");
        urls.add("http://example.com/page1"); // Duplicate
        urls.add("http://example.com/page3");
        urls.add("http://example.com/page2"); // Duplicate

        Set<RequestData> result = crawlerThread.getAnchorSet(urls);

 * either express or implied. See the License for the specific language
 * governing permissions and limitations under the License.
-->
<web-app xmlns="https://jakarta.ee/xml/ns/jakartaee"
         xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="https://jakarta.ee/xml/ns/jakartaee
                             web-app_6_1.xsd"
         version="6.1">

      if (urlIterator.next().startsWith("https://www.google.com/")) {
        urlIterator.remove()
      }
    }
```

### Troubleshooting

1. Valid cacheable responses are not being cached

Make sure you are reading responses fully as unless they are read fully, cancelled or stalled Responses will not be cached.

### Overriding normal cache behaviour

* [Link externo](https://sqlmodel.tiangolo.com/)
* [Link para um estilo](https://fastapi.tiangolo.com/css/styles.css)
* [Link para um script](https://fastapi.tiangolo.com/js/logic.js)
* [Link para uma imagem](https://fastapi.tiangolo.com/img/foo.jpg)

O texto do link deve ser traduzido, o endereço do link deve apontar para a tradução:

* [Link do FastAPI](https://fastapi.tiangolo.com/pt/)

////

        assertNull(source.getUrl());
        assertNull(source.getTitle());
        assertNull(source.getSnippet());

        source.setUrl("https://example.com");
        source.setTitle("Example Page");
        source.setSnippet("This is a snippet...");

        assertEquals("https://example.com", source.getUrl());
        assertEquals("Example Page", source.getTitle());
        assertEquals("This is a snippet...", source.getSnippet());

///

Это очень простое и короткое руководство. Если вы хотите узнать больше о базах данных в целом, об SQL или о более продвинутых возможностях, обратитесь к [документации SQLModel](https://sqlmodel.tiangolo.com/).

## Установка `SQLModel` { #install-sqlmodel }

   <span style="background-color:#007166"><font color="#D3D7CF"> server </font></span>  Documentation at <font color="#729FCF"><u style="text-decoration-style:solid">http://0.0.0.0:8000/docs</u></font>

             Logs:

   <span style="background-color:#007166"><font color="#D3D7CF"> server </font></span>  Documentation at <font color="#729FCF"><u style="text-decoration-style:solid">http://0.0.0.0:8000/docs</u></font>

             Logs:

## Advertencia { #caveat }

Si necesitas realizar una computación intensa en segundo plano y no necesariamente necesitas que se ejecute por el mismo proceso (por ejemplo, no necesitas compartir memoria, variables, etc.), podrías beneficiarte del uso de otras herramientas más grandes como [Celery](https://docs.celeryq.dev).