nofollow - Code Search

src/main/java/org/codelibs/fess/crawler/transformer/FessXpathTransformer.java

                    }
                    if (content.contains(ROBOTS_TAG_NOFOLLOW)) {
                        nofollow = true;
                    }
                }
                if (noindex && nofollow) {
                    logger.info("META(robots=noindex,nofollow): {}", responseData.getUrl());
                    throw new ChildUrlsException(Collections.emptySet(), "#processMetaRobots");
                }

Created: Tue Mar 31 13:07:34 GMT 2026

- Last Modified: Thu Mar 12 01:46:45 GMT 2026

- 55.3K bytes

- Click Count (0)

github.com/codelibs/fess

src/test/java/org/codelibs/fess/mylasta/direction/FessPropTest.java

        FessConfig fessConfig = new FessConfig.SimpleImpl() {
            @Override
            public String getCrawlerDocumentHtmlPrunedTags() {
                return "script,div#main,p.image,a[rel=nofollow],div[x-y=a-.:_0]";
            }
        };

        PrunedTag[] tags = fessConfig.getCrawlerDocumentHtmlPrunedTagsAsArray();
        assertTrue(matchesTag(tags[0], "<script></script>"));

Created: Tue Mar 31 13:07:34 GMT 2026

- Last Modified: Fri Mar 13 23:01:26 GMT 2026

- 25.4K bytes

- Click Count (0)

github.com/codelibs/fess

src/test/java/org/codelibs/fess/helper/MarkdownRendererTest.java

        assertTrue(result.contains("<a"));
        assertTrue(result.contains("href=\"http://example.com\""));
        assertTrue(result.contains("Link"));
        assertTrue(result.contains("rel=\"nofollow\""));
    }

    @Test
    public void test_render_link_https() {
        String result = markdownRenderer.render("[Secure Link](https://example.com)");
        assertTrue(result.contains("<a"));

Created: Tue Mar 31 13:07:34 GMT 2026

- Last Modified: Wed Jan 14 14:29:07 GMT 2026

- 11.1K bytes

- Click Count (0)

github.com/codelibs/fess

src/test/java/org/codelibs/fess/crawler/transformer/FessXpathTransformerTest.java

            };
        };

        final ResponseData responseData = new ResponseData();
        responseData.addMetaData("X-Robots-Tag", "nofollow");

        transformer.processXRobotsTag(responseData, new ResultData());
        assertTrue(responseData.isNoFollow());
    }

    @Test
    public void test_processMetaRobots_no() throws Exception {
        final String data = "<html><body>foo</body></html>";

Created: Tue Mar 31 13:07:34 GMT 2026

- Last Modified: Fri Mar 13 23:01:26 GMT 2026

- 62.9K bytes

- Click Count (0)

github.com/codelibs/fess

src/main/webapp/js/chat.js

        // Register hook once: add rel="nofollow" to links, restrict class to code/pre/span/div
        // (matches server-side requireRelNofollowOnLinks and allowAttributes("class").onElements(...))
        DOMPurify.addHook('afterSanitizeAttributes', function(node) {
            if (node.tagName === 'A' && node.hasAttribute('href')) {
                node.setAttribute('rel', 'nofollow');
            }

Created: Tue Mar 31 13:07:34 GMT 2026

- Last Modified: Thu Mar 19 01:36:02 GMT 2026

- 30.6K bytes

- Click Count (0)

github.com/codelibs/fess

src/main/resources/fess_config.properties

crawler.document.html.canonical.xpath=//LINK[@rel='canonical'][1]/@href
# HTML tags to prune (remove) during document processing.
crawler.document.html.pruned.tags=noscript,script,style,header,footer,aside,nav,a[rel=nofollow]
# Maximum length of digest extracted from HTML documents.
crawler.document.html.max.digest.length=120
# Default language for HTML documents.
crawler.document.html.default.lang=

Created: Tue Mar 31 13:07:34 GMT 2026

- Last Modified: Sat Mar 28 06:59:19 GMT 2026

- 59.3K bytes

- Click Count (0)

github.com/codelibs/fess

src/main/java/org/codelibs/fess/mylasta/direction/FessConfig.java

    String CRAWLER_DOCUMENT_HTML_CANONICAL_XPATH = "crawler.document.html.canonical.xpath";

    /** The key of the configuration. e.g. noscript,script,style,header,footer,aside,nav,a[rel=nofollow] */
    String CRAWLER_DOCUMENT_HTML_PRUNED_TAGS = "crawler.document.html.pruned.tags";

    /** The key of the configuration. e.g. 120 */

Created: Tue Mar 31 13:07:34 GMT 2026

- Last Modified: Sat Mar 28 06:59:19 GMT 2026

- 576.9K bytes

- Click Count (2)

github.com/gradle/gradle

architecture/standards/0010-gradle-properties-naming.md

Examples of properties that follow the naming rules:

* `org.gradle.experimental.declarative-common`

Properties that don’t follow the naming rules, and SHOULD be renamed:

* `org.gradle.unsafe.isolated-projects`
* `org.gradle.unsafe.suppress-gradle-api`

### Properties of incubating features

Created: Wed Apr 01 11:36:16 GMT 2026

- Last Modified: Fri Mar 06 09:25:54 GMT 2026

- 8K bytes

- Click Count (0)

github.com/gradle/gradle

architecture/standards/0006-use-of-provider-apis-in-gradle.md

The Gradle codebase has evolved over time and has a mixture of simple getter/setter methods, Provider API and things in between.  It can be hard to follow best practices because Gradle provided types are reused in unexpected ways and extended by third party plugins.

Given these constraints, we cannot always follow best practices.  This ADR proposes the way we should handle the use of Provider APIs in the gradle/gradle codebase.

## Decision

Created: Wed Apr 01 11:36:16 GMT 2026

- Last Modified: Thu Mar 05 12:39:41 GMT 2026

- 10K bytes

- Click Count (0)

github.com/gradle/gradle

architecture/standards/0001-use-architectural-decision-records.md

We use *Specification* and *Discovery* documents stored in Google Drive, but they present some downsides:

* They are rarely updated after creation and initial review, and then become hard to follow, especially after important decisions are made
* They are not synced with the code to reflect the eventual solution that is committed
* Google Docs is not a "code-oriented" tool, like Markdown can be

Created: Wed Apr 01 11:36:16 GMT 2026

- Last Modified: Thu Mar 05 12:39:41 GMT 2026

- 2.9K bytes

- Click Count (0)

Search Options