Your browser does not seem to support CSS. If images appear below, please disregard them.
It appears that you're running an Ad-Blocker. This site is monetized by Advertising and by ">User Donations; we ask that if you find this site helpful that you whitelist us in your Ad-Blocker, or make a ">Donation to help aid in operating costs.
Previous Thread
Next Thread
Print Thread
Rate This Thread
#7612 - 02/24/03 09:02 AM URL Scanner?  
Joined: Feb 2003
Posts: 3
St4rCh1ld* Offline
Junior Member
St4rCh1ld*  Offline
Junior Member

Joined: Feb 2003
Posts: 3
Anyone know where to find a program that scans for anything on a website?

Ex: if that website got a subdomain called it would be listed...

Or anything reminding of such program.. Something that just scans the site for all information about the site.. html, htm, asp files aso...

Sponsored Links
#7613 - 02/24/03 04:51 PM Re: URL Scanner?  
Joined: Mar 2002
Posts: 1,136
pergesu Offline
UGN Elite Poster
pergesu  Offline
UGN Elite Poster

Joined: Mar 2002
Posts: 1,136
Pimpin the Colorizzle
As a matter of fact there is a tool that gives out as much information as possible. to get DNS Lookup, coded by our very own SilentRage. Someone asked about subdomains ( and SR informed us that there is nothing in the DNS protocol to allow for discovery of subdomains. So I think you're outta luck there. But as far as getting lots of info on a site, that tool will do the trick.

[Insert by SilentRage: I was wrong earlier, you CAN find subdomains for a given domain by doing DNS Transfers. If you want help on that, create a new topic asking how.]

#7614 - 02/24/03 11:19 PM Re: URL Scanner?  
Joined: Feb 2002
Posts: 7,202
Gremelin Offline
Community Owner
Gremelin  Offline

Community Owner

Joined: Feb 2002
Posts: 7,202
Likes: 11
Portland, OR; USA
Its impossible for a program to list hostnames from a url (as per your example) unless they were actually listed on the webpage...

The best thing that you can use is SR's DNS Lookup as pergesu listed, BUT it does not add the feature to list all hostnames associated with the domain since its ultimately impossible.

Donate to UGN Security here.
UGN Security, Back of the Web, and VNC Web Services Owner
#7615 - 02/25/03 10:10 AM Re: URL Scanner?  
Joined: Dec 2002
Posts: 3,255
§intå× Offline
§intå×  Offline

Joined: Dec 2002
Posts: 3,255
Likes: 3
He could code or download a web spider to craw the site for all links. Then alphbatise them, and delete dulitaces, then delete any that do not start with the first 3 characters of the domain you are intrested in.

Of course it would require some work, but I think it can be done. Anything can be done if a coder puts thier mind to it. Know any languages?

#7616 - 02/25/03 10:34 PM Re: URL Scanner?  
Joined: Mar 2002
Posts: 524
dashocker Offline
dashocker  Offline

Joined: Mar 2002
Posts: 524
Cornfields everywhere...
I believe he is asking for a web spider. Try searching for one that may or may not have the funcitionality you are asking for at

If you can't find one that has that functionality, use SR's little tool.

Sponsored Links

Member Spotlight
Portland, OR; USA
Posts: 7,202
Joined: February 2002
Show All Member Profiles 
Forum Statistics
Average Daily Posts1
Most Online1,567
Apr 25th, 2010
Latest Postings
Okay WTF?
by HenryMiring on 09/27/17 08:45 AM
The History Thread...
by Gremelin on 08/11/17 07:11 PM
my old account still exists!
by Gremelin on 08/11/17 07:02 PM
My friend NEEDS your HELP!
by Lena01 on 07/21/17 07:06 AM
I'm having fun with this guy.
by gabithompson730 on 07/20/17 08:50 AM
I want to upgrade my phone
by gabithompson730 on 07/20/17 08:49 AM
Newbie here
by gabithompson730 on 07/20/17 08:46 AM
by Gremelin on 01/14/17 07:03 PM
Top Posters(All Time)
UGN Security 41,392
Gremelin 7,202
§intå× 3,255
SilentRage 1,273
Ice 1,146
pergesu 1,136
Infinite 1,041
jonconley 955
Girlie 908
unreal 860
Top Liked Users (All Time)
§intå× Likes: 3
Black Beard Likes: 1
Cold Sunn Likes: 1
Crime Likes: 1
Cyrez Likes: 1
fleshwound Likes: 1
Ghost Likes: 2
Gremelin Likes: 12
Ice Likes: 1
ninjaneo Likes: 1
Top Liked Users (30 Days)
No Data Found