URLies

URLies is a powerful, minimalistic passive recon tool that combines the strengths of tools like waybackurls, gauplus under one CLI interface. Built with concurrency, speed, and modular recon in mind.

Made by me for now...

---

Features

• Wayback Machine Recon (paged & concurrent)
• Search Engine scraping (Google-style)
• JS-based link extraction (headless recon)
• Fully customizable: --depth, output dir, and more

---

Installation

git clone https://github.com/black/urlies.git
cd urlies
go mod tidy
go build -o urlies main.go

---

Usage

./urlies -u https://example.com -m archive -o output/
./urlies -u https://target.com -m all --depth 10 -o output/

• -u: Target domain (required)
• -m: Mode — archive, engine, headless, or all
• -o: Output directory
• --depth: Page depth for archive crawling (default: 20)

---

Output Structure

Results are saved in:

output/
├── example.com-wayback.txt
├── example.com-engine.txt
├── example.com-headless.txt

---

🛠 Modules Overview

• archive/wayback.go – Wayback Machine, paged API
• engine/googlite.go – Google scraping with regex
• headless/jsfinder.go – JS + DOM link detection
• core/* – Shared tools (client, helpers, output)

---

Dependencies (A Friendly Guide)

If you're new to Go or never installed a CLI tool before, don’t worry — follow this and you’ll be running urlies in no time.

1. Make sure you have Go installed

go version

You should see something like go version go1.20.6 linux/amd64 → Install Go if needed

2. Clone the Repo

git clone https://github.com/black/urlies.git
cd urlies

3. Download the Dependencies

go mod tidy

This fetches the required packages:

• goquery – DOM parsing
• urfave/cli/v2 – CLI flag parsing
• cascadia – CSS selectors
• golang.org/x/net – HTTP extensions

4. Build the tool

go build -o urlies main.go

5. Run It!

./urlies -u https://example.com -m all --depth 15 -o output/

---

License

MIT License. See LICENSE for details.

---

Updates and Patches...

Well Dont Worry I'll take care... If there is any queries contact me on telegram...

---