Site Statistics
 
Threads: 3,731
Posts: 16,743
Members: 2,845
Users Online: 12
Newest Member: gwein


Go Back   PC101 > The Internet, Web Design & Networking > Web Design and Development

Web Design and Development Design techniques, conepts, HTML, scripts, software, reviews, sponsors and affiliate programs.

Reply
 
LinkBack Thread Tools Display Modes
Old 06-24-2006, 01:21 AM   #1
Senior Member
 
dr911's Avatar
 
Join Date: Nov 2005
Location: Northern Arizona
Posts: 625
Rep Power: 3 dr911 is on a distinguished road
Thumbs up Wegt

Hey All,

I found a "neat little" tool that may be helpful for web-designers (such as myself )

Quote:
GNU Wget is a free software package for retrieving files using HTTP, HTTPS and FTP, the most widely-used Internet protocols. It is a non-interactive commandline tool, so it may easily be called from scripts, cron jobs, terminals without X-Windows support, etc.

GNU Wget has many features to make retrieving large files or mirroring entire web or FTP sites easy, including:

Can resume aborted downloads, using REST and RANGE


Can use filename wild cards and recursively mirror directories

NLS-based message files for many different languages

Optionally converts absolute links in downloaded documents to relative, so that downloaded documents may link to each other locally

Runs on most UNIX-like operating systems as well as Microsoft Windows

Supports HTTP and SOCKS proxies
Supports HTTP cookies
Supports persistent HTTP connections
Unattended / background operation
Uses local file timestamps to determine whether documents need to be re-downloaded when mirroring
GNU Wget is distributed under the GNU General Public License.
Once you have it, simply run:

CODE

And it will create a complete folder structure (on your local machine) with all the content.
What it does is read HTML pages and follows the images and links present in it.
The only tough part is if your site (or parts of it) has Javascript or is password protected.


http://www.gnu.org/software/wget/
__________________
May Your Wishes Come True !!

DR911

Goverment Grant & Loan Infomation


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

Last edited by dr911; 06-24-2006 at 01:23 AM.
dr911 is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 06-27-2006, 11:24 AM   #2
Senior Member
 
OulZac's Avatar
 
Join Date: Apr 2006
Location: Wilbur
Posts: 346
Rep Power: 3 OulZac is on a distinguished road
Nice, I have never used wget execpt on a ssh server level, ill have to try this.
__________________
In the beginning, the Universe was created. This made a lot of people angry, and has been widely regarded as a bad idea.


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
- Showing people there IP for no apparent reason!
OulZac is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On




Flex Development


Our partners:



All times are GMT -5. The time now is 03:11 PM.

Powered by vBulletin Version 3.7.0
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Search Engine Optimization by vBSEO 3.1.0
Design by vBSkinworks

Copyright © PC101 and PC101.com Computer Forum. All rights reserved.