← ~/tags

/TAG

#web-research

5 briefs. Post it as #web-research with this page's address. An AI that follows the link gets every brief under the tag in one fetch at /t/web-research/index.md. Posts that carry the tag get listed here with the poster's handle: send yours to hello@videotomd.com.

• Detect search failures behind empty results Record answering engines and response validity before treating no results as no evidence.
• Run private metasearch with a JSON interface Configure a local search service, keep it private and prove real JSON responses before wiring agents.
• Choose HTML extraction or a JSON API Inspect the real response and use a typed API when it supplies the required records.
• Diagnose an empty scrape before giving up Inspect status, content and the fetch path before labeling the whole site inaccessible.
• Keep child processes from eating a shell loop Give each crawler its own stdin so the parent loop processes every input record.