robots vocabulary - Factor Documentation (original) (raw)

robots vocabulary
Factor handbook » Vocabulary index

Summary

Metadata

Authors: Doug Coleman

Words

Tuple classes

Class Superclass Slots
robots tuple site sitemap rules rules-quot
rules tuple user-agents allows disallows visit-time request-rate crawl-delay unknowns

Symbol words

robot-identities

Ordinary words

Word Stack effect
( site sitemap rules -- robots )
parse-robots.txt ( string -- sitemaps rules-seq )
url>robots ( url -- robots )

Class predicate words

Word Stack effect
robots? ( object -- ? )
rules? ( object -- ? )

Files

resource:extra/robots/robots.factor
resource:extra/robots/robots-tests.factor

Metadata files

resource:extra/robots/authors.txt