nofollow - Code Search

src/main/java/org/codelibs/fess/crawler/transformer/FessXpathTransformer.java

                    }
                    if (content.contains(ROBOTS_TAG_NOFOLLOW)) {
                        nofollow = true;
                    }
                }
                if (noindex && nofollow) {
                    logger.info("META(robots=noindex,nofollow): {}", responseData.getUrl());
                    throw new ChildUrlsException(Collections.emptySet(), "#processMetaRobots");
                }

Created: Tue Mar 31 13:07:34 GMT 2026

- Last Modified: Thu Mar 12 01:46:45 GMT 2026

- 55.3K bytes

- Click Count (0)

github.com/codelibs/fess

src/test/java/org/codelibs/fess/mylasta/direction/FessPropTest.java

        FessConfig fessConfig = new FessConfig.SimpleImpl() {
            @Override
            public String getCrawlerDocumentHtmlPrunedTags() {
                return "script,div#main,p.image,a[rel=nofollow],div[x-y=a-.:_0]";
            }
        };

        PrunedTag[] tags = fessConfig.getCrawlerDocumentHtmlPrunedTagsAsArray();
        assertTrue(matchesTag(tags[0], "<script></script>"));

Created: Tue Mar 31 13:07:34 GMT 2026

- Last Modified: Fri Mar 13 23:01:26 GMT 2026

- 25.4K bytes

- Click Count (0)

github.com/codelibs/fess

src/main/webapp/js/chat.js

        // Register hook once: add rel="nofollow" to links, restrict class to code/pre/span/div
        // (matches server-side requireRelNofollowOnLinks and allowAttributes("class").onElements(...))
        DOMPurify.addHook('afterSanitizeAttributes', function(node) {
            if (node.tagName === 'A' && node.hasAttribute('href')) {
                node.setAttribute('rel', 'nofollow');
            }

Created: Tue Mar 31 13:07:34 GMT 2026

- Last Modified: Thu Mar 19 01:36:02 GMT 2026

- 30.6K bytes

- Click Count (0)

github.com/codelibs/fess

src/test/java/org/codelibs/fess/crawler/transformer/FessXpathTransformerTest.java

            };
        };

        final ResponseData responseData = new ResponseData();
        responseData.addMetaData("X-Robots-Tag", "nofollow");

        transformer.processXRobotsTag(responseData, new ResultData());
        assertTrue(responseData.isNoFollow());
    }

    @Test
    public void test_processMetaRobots_no() throws Exception {
        final String data = "<html><body>foo</body></html>";

Created: Tue Mar 31 13:07:34 GMT 2026

- Last Modified: Fri Mar 13 23:01:26 GMT 2026

- 62.9K bytes

- Click Count (0)

github.com/codelibs/fess

src/main/resources/fess_config.properties

crawler.document.html.canonical.xpath=//LINK[@rel='canonical'][1]/@href
# HTML tags to prune (remove) during document processing.
crawler.document.html.pruned.tags=noscript,script,style,header,footer,aside,nav,a[rel=nofollow]
# Maximum length of digest extracted from HTML documents.
crawler.document.html.max.digest.length=120
# Default language for HTML documents.
crawler.document.html.default.lang=

Created: Tue Mar 31 13:07:34 GMT 2026

- Last Modified: Sat Mar 28 06:59:19 GMT 2026

- 59.3K bytes

- Click Count (0)

github.com/codelibs/fess

src/main/java/org/codelibs/fess/mylasta/direction/FessConfig.java

    String CRAWLER_DOCUMENT_HTML_CANONICAL_XPATH = "crawler.document.html.canonical.xpath";

    /** The key of the configuration. e.g. noscript,script,style,header,footer,aside,nav,a[rel=nofollow] */
    String CRAWLER_DOCUMENT_HTML_PRUNED_TAGS = "crawler.document.html.pruned.tags";

    /** The key of the configuration. e.g. 120 */

Created: Tue Mar 31 13:07:34 GMT 2026

- Last Modified: Sat Mar 28 06:59:19 GMT 2026

- 576.9K bytes

- Click Count (2)

github.com/gradle/gradle

architecture/standards/0001-use-architectural-decision-records.md

We use *Specification* and *Discovery* documents stored in Google Drive, but they present some downsides:

* They are rarely updated after creation and initial review, and then become hard to follow, especially after important decisions are made
* They are not synced with the code to reflect the eventual solution that is committed
* Google Docs is not a "code-oriented" tool, like Markdown can be

Created: Wed Apr 01 11:36:16 GMT 2026

- Last Modified: Thu Mar 05 12:39:41 GMT 2026

- 2.9K bytes

- Click Count (0)

github.com/tiangolo/fastapi

docs/en/docs/help-fastapi.md

* News about FastAPI and friends 🚀
* Guides 📝
* Features ✨
* Breaking changes 🚨
* Tips and tricks ✅

## Follow FastAPI on X (Twitter) { #follow-fastapi-on-x-twitter }

[Follow @fastapi on **X (Twitter)**](https://x.com/fastapi) to get the latest news about **FastAPI**. 🐦

## Star **FastAPI** in GitHub { #star-fastapi-in-github }

Created: Sun Apr 05 07:19:11 GMT 2026

- Last Modified: Thu Mar 05 18:13:19 GMT 2026

- 12.6K bytes

- Click Count (0)

github.com/square/okhttp

docs/features/calls.md

If a conditional GET was successful, responses from the network and cache are merged as directed by the spec.

## Follow-up Requests

When your requested URL has moved, the webserver will return a response code like `302` to indicate the document’s new URL. OkHttp will follow the redirect to retrieve a final response.

Created: Fri Apr 03 11:42:14 GMT 2026

- Last Modified: Sun Mar 15 09:01:42 GMT 2026

- 3.9K bytes

- Click Count (0)

github.com/gradle/gradle

architecture/standards/0010-gradle-properties-naming.md

Examples of properties that follow the naming rules:

* `org.gradle.experimental.declarative-common`

Properties that don’t follow the naming rules, and SHOULD be renamed:

* `org.gradle.unsafe.isolated-projects`
* `org.gradle.unsafe.suppress-gradle-api`

### Properties of incubating features

Created: Wed Apr 01 11:36:16 GMT 2026

- Last Modified: Fri Mar 06 09:25:54 GMT 2026

- 8K bytes

- Click Count (0)

Search Options