Email:  Password:  
  Forgot Password?  Register Now
UCAR > NCAR > CISL
Go to Dataset: 
 
Home Software/Documentation Ancillary Services People
For Staff Contact Us
Search Datasets   Full Site for:  
 
   FAQs > Downloading Data


  • How do I download data I purchased?

      The specialist who prepared your order should have given you the name of a directory on our server which contains your files. Go to that directory to proceed.

    ^ Top

  • How do I get an account on an NCAR computer?
      Click here for information on how to request computing resources at NCAR.

    ^ Top

  • Can I use Wget to download data files?
      You can use Wget to download data files, but you must be a registered data user and you will need to authenticate first to obtain the necessary cookies to include in your wget command. Also, because simultaneous file downloads by a single user degrades the services for other users, you are allowed to download only one file at a time. We monitor our web logs and will block access to users that ignore this rule. Do NOT use the "-b" (or "--background") option on the Wget command line.

      See this for information on how to authenticate. Then, for each file you want to download, use the following Wget command:
        wget --load-cookies cookie_file_name URL_of_data_file



      ^ Top

    • Can I use Unix lynx to download data files?

        You can use Unix lynx to download data files, but you will need a version that allows you to specify the accept_all_cookies option on the command line and that supports connections to a secure server.

        To download a data file interactively, do the following:

           prompt>lynx -accept_all_cookies -dump -post_data dss.ucar.edu/cgi-bin/login
           stdin>do=login&email=your_email&passwd=your_password&url=url_of_data_file
           stdin>---
        
          where:
            prompt>          is your computer's system prompt
            stdin>           is the input lynx will need after you execute the command
            your_email       is the email address that you registered with
            your_password    is your sign-in password
            url_of_data_file is the URL of the data file you want to download
                             this must begin with a '/' and includes all of the
                             URL after "dss.ucar.edu"
        
          EXAMPLE:
            prompt>lynx -accept_all_cookies -dump -post_data dss.ucar.edu/cgi-bin/login
             stdin>do=login&email=dattore@ucar.edu&passwd=*****&url=/datasets/ds824.1/data/n_atl.txt
             stdin>---
        

        You can also use lynx within a script. Here is an example Unix shell script (some modifications may be required for other shells) that will download a data file to a local file:

           #! /bin/sh
           #
           # create the input file
           cat << ! > input
           do=login&email=dattore@ucar.edu&passwd=*****&url=/datasets/ds824.1/data/n_atl.txt
           ---
           !
           #
           # run the command and direct the output to a file
           lynx -accept_all cookies -dump -post_data dss.ucar.edu/cgi-bin/login < input > n_atl.txt
        


      ^ Top

    • How do I download an MSS file to an NCAR computer?
        Read about the msrcp command here. For further assistance with retrieving data files from within the NCAR system, please contact the SCD Technical Consulting Group . Include in the subject line something like "moving files between NCAR computers".

      ^ Top

    • How do I use SSH to move data from an NCAR computer to my non-NCAR computer?
        For assistance moving data to a non-NCAR computer, please contact the SCD Technical Consulting Group, and include in the subject line something like "moving files to a non-NCAR computer".

      ^ Top

    • When I click on a data file, my browser displays it. How do I download the file?
        To force your browser to download a data file:
        • PC users: hold the Shift key at the same time you click the link.
        • Mac users: hold the Alt/Option key at the same time you click the link.
        Depending on your system, you will either get a pop-up window that allows you to save the file on your computer, or the file will begin downloading immediately.

      ^ Top

    • I am trying to download a compressed file (.gz or .Z) and the progress monitor in the download pop-up window is behaving strangely. How do I download the file?
        Many browsers know how to handle .gz and .Z compressed files and will uncompress them as they are being downloaded to your computer. Since the browser can't know ahead of time what the uncompressed file size will be, the download progress monitor behaves strangely. For some browsers, it will show the file at 100% downloaded and then it will start over at 0%, doing this several times. Other browsers will show the file 100% downloaded but data are still being transferred. In all cases, as long as data appears to be transferring, you should leave the download process alone until it stops on its own.

      ^ Top

    • I downloaded a compressed file (.gz or .Z), but when I try to uncompress it on my computer, I get an error saying that it is not a compressed file. What is wrong?
        Many browsers know how to handle .gz and .Z compressed files and will uncompress them as they are being downloaded to your computer. If you get an error when you try to uncompress the file, check the file to make sure it was not uncompressed during the download.

      ^ Top

    • Wget complains about certificate verification. What do I do?
      • If you are using Wget 1.10 or higher, you will need to include the "--no-check-certificate" option on the Wget command line. If you downloaded a script from us with Wget commands, you can add "--no-check-certificate" to the opts variable once and it will apply to all of the Wget commands in the script.

      ^ Top

    • Why does Wget give me the error: "Unsupported scheme"?
      • You are using a version of Wget that was not compiled with SSL support. You will either need to recompile your Wget with SSL support turned on, or you will need to obtain an executable that was compiled with SSL.

      ^ Top

    • My version of Wget does not recognize the --post-data option. How do I authenticate?
      • You can use this form to authenticate and create the cookies file that Wget needs when you download data from our web server. Save the cookies file to your computer and then load it from your Wget commands that download the data files.


      ^ Top

    • I tried to download an online data file from RDA Server and the action finished while only partial data file is downloaded, about 4M. What can I do to get the whole data file?
      • This happens mostly to the users outside of US. There must be a problem at some gateway for limiting data traffic since we do not add any limit on our server.

        You can use the download scripts we genereated for you. The scripts call utility program 'wget' to download the data files. To create a download script you may select the data files you are inerested on any of the online data filelists and click the buttons 'Perl Download Sctipt' or 'Csh Download Script' to generate one.

        If you prefer to download a data file by clicking it directly you better install a download manager, which should help to have a full file download, as well as to speed it up. For PC users, click HERE for a free download manger and it works fine for many users have tested it.


      ^ Top


© 2009, UCAR  |  Privacy Policy  |  Terms of Use  |  Webmaster