1. Fetching datasets from the Internet
Downloading Datasets
Fetching datasets from the Internet

2. Let's Get Data

3. Downloading From The Web
$ man wget

4. Using wget to download PDB data-files
$ mkdir structures
$ cd structures
$ wget ftp://ftp.rcsb.org/pub/pdb/data/structures/all/pdb1m7t.ent.Z
$ wget ftp://ftp.rcsb.org/pub/pdb/data/structures/all/pdb1lqt.ent.Z
$ gzip -d pdb1m7t.ent.Z pdb1lqt.ent.Z

5. Mirroring a dataset
$ wget --mirror ftp://ftp.rcsb.org/pub/pdb/data/structures/all/pdb

6. Maxim 9.1
Only download a dataset when absolutely necessary. Consider the implications of doing so first

7. Smarter mirroring
structures/ftp.rcsb.org/pub/pdb/data/structures/all/pdb
$ wget --output-file=log --mirror --http-user=anonymous
--directory-prefix=structures/mmCIF
--no-host-directories
--cut-dirs=6 ftp://ftp.rcsb.org/pub/pdb/data/structures/all/pdb

8. Downloading a subset of a dataset
$ wget ftp://beta.rcsb.org/pub/pdb/uniformity/data/mmCIF/all/1ger.cif.Z

9. Where To From Here