Search Options

Results per page
Sort
Preferred Languages
Advance

Results 1 - 1 of 1 for robotsTxtHelper (0.06 sec)

  2. github.com/codelibs/fess-crawler

    fess-crawler-lasta/src/main/resources/crawler/robotstxt.xml 

    <!DOCTYPE components PUBLIC "-//DBFLUTE//DTD LastaDi 1.0//EN"
	"http://dbflute.org/meta/lastadi10.dtd">
<components namespace="fessCrawler">
	<include path="crawler/container.xml" />

	<component name="robotsTxtHelper" class="org.codelibs.fess.crawler.helper.RobotsTxtHelper"
		instance="prototype">
	</component>
    Registered: Sat Dec 20 11:21:39 UTC 2025
    - Last Modified: Sun Oct 11 02:16:55 UTC 2015
    - 367 bytes
    - Viewed (0)
Back to top