Lab 2
Level 1 - Beginner
Robots.txt Discovery Lab
Level 1 Recon & Enumeration simulation: learn how public robots.txt entries can reveal sensitive directories during recon.
Beginner
Recon & Enumeration • 20 min
Learning Objectives
This lab is a controlled simulation only. No real backend or dangerous code execution is used.
Objective 1
Review how public index files can expose operational details during recon.
Objective 2
Identify sensitive paths hidden in robots.txt Disallow entries.
Objective 3
Understand why internal-looking routes should not be exposed through crawl hints.
Challenge Area
Use the input fields below to safely simulate the vulnerable behavior.
Hidden Path
Fake robots.txt
User-agent: *
Disallow: /admin-backup
Submitted path: (none yet)
Result Panel
Review the fake robots.txt content and extract the sensitive route that a recon workflow could spot from a public file.
Hints
Reveal them progressively if you get stuck.
Click the hint button to reveal progressive guidance.