# Luar, https://luar.cafe
#
# Search engines may index the pages allowed below, for one purpose: returning
# them as search results. Every other use of anything on this site (scraping,
# AI training, or feeding a model at answer time, whether directly or as a step
# in some longer toolchain) is refused. See https://luar.cafe/legal/terms.
#
# Chapters are copyright material owned by their authors, and no crawler may
# fetch or index them. Only Author bios and their Work summary pages may be
# indexed.
#
# The Content-Signal lines state that reservation in a form an automated reader
# can act on (https://contentsignals.org):
#   search:   building a search index, returning links and short excerpts
#   ai-input: feeding content to a model at answer time (RAG, grounding,
#             generative answers)
#   ai-train: training or fine-tuning a model

# User-agent: Googlebot
# User-agent: Bingbot
# User-agent: DuckDuckBot
# User-agent: Slurp
# User-agent: Baiduspider
User-agent: *
Content-Signal: search=yes, ai-input=yes, ai-train=no
Allow: /$
Allow: /read/
Allow: /news
Allow: /about
Allow: /legal
Disallow: /read/*/*/*
Disallow: /read/.
Disallow: /legal/*/
Disallow: /legal/updates
Disallow: /login
Disallow: /register
Disallow: /

# User-agent: *
# Content-Signal: search=no, ai-input=no, ai-train=no
# Disallow: /