Take only what we need.
Start with permitted HTML. Render candidate pages to capture their appearance, with limits on requests, bytes, time, and media. No automatic full-video downloads or endless scrolling.
FOR THE PEOPLE WHO MAKE THE WEB
Hello,
website builder.
The internet is bigger than anyone’s feed.
Thank you for making a corner of it your own.
A CONSIDERATE GUEST
Meet FellIntoBot.
FellInto helps people find free, engaging independent websites: art, games, niche knowledge, and personal obsessions. Our planned crawler will discover URLs through curated lists, nominations, and links on eligible sites.
User-Agent: FellIntoBot/1.0 (+https://fellinto.com/bot)
Remember the visit.
Save completed work durably, reuse captured evidence, and use conditional requests on revisits where supported. A model update should not make us download your site again.
Leave room for your visitors.
Use conservative per-site budgets, respect Retry-After, and slow down on errors or signs of strain. Numerical limits and revisit intervals are listed below. Missing settings must be completed before public crawling begins.
Look, then explain.
Every assessed page needs screenshot evidence or an explicit capture-failure record. Original captures stay internal as assessment evidence. We plan to publish selected, resized screenshots as directory and page-detail previews that link to the original site. Creator restrictions and removal requests apply to previews too, and restricted-content previews will require the same opt-in as their destinations.
CHECK THE GUEST LIST
Is that really our spider?
A User-Agent is a label, not proof of identity. Compare the source IP in your server logs with our published outbound addresses. We cannot verify a visit from a User-Agent alone.
No public crawler IP addresses are configured. Do not assume traffic using our name is ours.
Machine-readable IP list · Crawl status and policy settings
Published operating limits
- Initial page ceiling per site
- Not configured
- Request ceiling per site / batch
- Not configured
- Response-byte ceiling per site / batch
- Not configured
- Minimum time between requests to a site
- Not configured
- Maximum time per page visit
- Not configured
- Routine freshness-check interval
- Not configured
- Private evidence retention
- Not configured
These are configuration values, not measurements of current traffic. Requests and bytes include permission checks, retries and page assets. A stricter site-provided delay takes priority. Tablet and phone screenshots are additional views of the same bounded visit.
YOUR SITE, YOUR SAY
You choose whether we visit.
To disallow FellIntoBot across your site, put this group in your robots.txt file at the root of the relevant origin:
User-agent: FellIntoBot Disallow: /
Our crawler must respect robots.txt, applicable indexing directives, and explicit creator restrictions, including restrictions expressed in llms.txt. Robots permission and permission to publish are separate. We will not use a blocked page as a reason to try another route around your restriction.
Stopping crawling does not itself remove previously published records. For removal, hidden previews, corrections or a slower revisit, contact us below. Robots.txt does not make a URL private; protect private material with authentication.
No ranking purchase, account, or site redesign will be required to ask for a correction. Unconventional websites are welcome.
MAKE SOMETHING WORTH FINDING
A small, useful bookshelf.
Free resources from the people who document the web. Use what helps your visitors; keep what makes your site yours.
Build your little corner
MDN’s web development lessons cover HTML, CSS, and the foundations of useful websites.
MDN web development ↗Make more people welcome
Practical guidance on images, headings, forms, and navigation, organized around real tasks.
W3C accessibility tutorials ↗Take a second look
WAVE can help identify accessibility issues. Automated checks still need human judgment.
WAVE accessibility tools ↗Keep it light
Understand what makes a page load quickly and use fewer resources.
Learn web performance ↗Give your readers a feed
The RSS specification explains the format behind a simple, portable way to follow updates.
RSS specification ↗Tell crawlers where to go
The Robots Exclusion Protocol defines the rules crawlers read from robots.txt.
Robots Exclusion Protocol ↗SMALL FOOTPRINT, CLEAR INTENTIONS
Data and AI.
This information page has no advertising, analytics scripts, contact form, cookies or browser preference profile. Its artwork and fonts are hosted with the page. Our hosting network processes ordinary connection information to deliver it; infrastructure logging and retention must be reviewed when we deploy publicly.
Our planned review process uses AI to interpret captured public pages and screenshots, including third-party inference where configured. A review is an interpretation and can be wrong. Versions and evidence help us investigate corrections. We do not ask you to provide visitor profiles or private website access.
Email you choose to send is handled by your mail provider and our configured mailbox provider. Include only information needed to address your request.
A HUMAN AT THE OTHER END
Your site, your say.
A public contact mailbox has not been configured. Public crawling remains disabled until a working mailbox and the other required operating details are configured.
Download the robots.txt opt-out example. Merge this group into your existing robots.txt; do not replace unrelated rules.