Search Options

Results per page
Sort
Preferred Languages
Advance

Results 1 - 4 of 4 for ddd (0.01 sec)

  2. github.com/codelibs/fess-crawler

    fess-crawler/src/test/java/org/codelibs/fess/crawler/helper/RobotsTxtHelperTest.java 

            assertTrue(robotsTxt.allows("/ccc", "Crawler"));
        assertTrue(robotsTxt.allows("/ddd", "Crawler"));
        assertTrue(robotsTxt.allows("/aaa", "Crawler/1.0"));
        assertFalse(robotsTxt.allows("/bbb", "Crawler/1.0"));
        assertTrue(robotsTxt.allows("/ccc", "Crawler/1.0"));
        assertTrue(robotsTxt.allows("/ddd", "Crawler/1.0"));
        assertTrue(robotsTxt.allows("/aaa", "Crawler/2.0"));
    Registered: Sun Sep 21 03:50:09 UTC 2025
    - Last Modified: Sat Mar 15 06:52:00 UTC 2025
    - 5.9K bytes
    - Viewed (0)
  3. github.com/codelibs/fess-crawler

    fess-crawler/src/test/resources/org/codelibs/fess/crawler/helper/robots.txt 

    Allow: /help/faq.html
Crawl-delay: 3

User-agent: Crawler
Disallow: /aaa

User-agent: Crawler/1.0
Disallow: /bbb

User-agent: Crawler/2.0
Disallow: /ccc

User-agent: Hoge Crawler
Disallow: /ddd

sitemap: http://www.example.com/sitmap.xml
    Registered: Sun Sep 21 03:50:09 UTC 2025
    - Last Modified: Sun Oct 11 02:16:55 UTC 2015
    - 566 bytes
    - Viewed (0)
  4. github.com/codelibs/fess-crawler

    fess-crawler-lasta/src/main/resources/crawler/extractor.xml 

    				"application/vnd.fujitsu.oasysprs",
				"application/vnd.fujixerox.art-ex",
				"application/vnd.fujixerox.art4",
				"application/vnd.fujixerox.hbpl",
				"application/vnd.fujixerox.ddd",
				"application/vnd.fujixerox.docuworks",
				"application/vnd.fujixerox.docuworks.binder",
				"application/vnd.fut-misnet",
				"application/vnd.fuzzysheet",
				"application/vnd.genomatix.tuxedo",
    Registered: Sun Sep 21 03:50:09 UTC 2025
    - Last Modified: Sat Aug 01 21:40:30 UTC 2020
    - 49K bytes
    - Viewed (0)
  5. github.com/codelibs/fess-crawler

    fess-crawler/src/main/resources/org/codelibs/fess/crawler/mime/tika-mimetypes.xml 

      <mime-type type="application/vnd.fujixerox.art-ex"/>
  <mime-type type="application/vnd.fujixerox.art4"/>
  <mime-type type="application/vnd.fujixerox.hbpl"/>
  <mime-type type="application/vnd.fujixerox.ddd">
    <glob pattern="*.ddd"/>
  </mime-type>
  <mime-type type="application/vnd.fujixerox.docuworks">
    <glob pattern="*.xdw"/>
  </mime-type>
  <mime-type type="application/vnd.fujixerox.docuworks.binder">
    Registered: Sun Sep 21 03:50:09 UTC 2025
    - Last Modified: Thu Mar 13 08:18:01 UTC 2025
    - 320.1K bytes
    - Viewed (1)
Back to top