When referring to downloading files, the first thing we can think of is the web browser. This is true up to a point. Because in the terminal we also have many options for downloading.

The Linux Terminal is a powerful tool so much so that it is the main working support for many servers. Therefore, the terminal is fast, secure, and efficient.

So, let’s talk about those tools.

Terminal Tools for Downloading Files

Several tools allow a download without major problems, but we will name the most familiar and easy to use.

1.- The great wget

GNU wget is a CLI (command-line interface) utility that allows you to download files from the internet if you know its link. It is very efficient in the management of computer resources because it is practically unnoticeable its use. In addition, this allows you to rename the downloaded files quickly.

On the other hand, although it is a program that is used in the terminal, it is quite complete. Here is a list of the main features of the application:

• Wget supports downloads through proxies
• IPv6 is fully supported by wget.
• It allows limiting the bandwidth used for downloads.
• Wget works with SSL/TSL to secure downloads.

But Wget has many configurations and work options. So many that we made a post about it:

The Wget Command

There you can learn even more about Wget and above all how to use it.

2.- cURL

Another veteran of our site is cURL.

CURL is a command line tool and library for transferring data with URLs. Many download scripts or file transfers use CURL as a means to achieve this. In addition, CURL supports FTP, FTPS, Gopher, HTTP, HTTPS, IMAP, IMAPS, LDAP and many other protocols quite popular on networks.

On the other hand, the use of CURL is not limited exclusively to computers but to other devices that use UNIX such as cell phones, cars and is the transfer backend of many of the most popular applications in the world.

Say that cURL is even more advanced than Wget but you also have other additional features.

So, if you want to learn more about it, check our post:

How to use CURL command on Linux?

3.- Terminal Tools for Downloading Files used on Scripts

It is also possible to find other tools that are in the main repositories of most Linux distributions. We are talking about tools like rsync or scp.

Rsync, remote synchronize is known as a remote synchronization function of the software, it synchronizes files at the same time, can maintain the original file permissions, time, hard and soft links and other additional information. it is a “sync algorithm” that provides a quick way to synchronize files between clients and remote file servers, and can also be transferred via SSH, which is also very confidential, supports breakpoint continuation, data can be pushed or pulled, and is free of chargeS.

Rsync advantages：

• Ability to update entire directories and trees and file systems;
• Selectively maintain symbolic links, hard links, file ownership, permissions, devices, and time for folders and files;
• For installation, there are no special permission requirements;
• For multiple files, the internal pipeline reduces the file wait delay;
• Can use RSH, SSH or direct port as the transfer port;
• Support anonymous Rsync synchronization files are the ideal mirror tool;

You can read:

Synchronous data Using rsync Command in Linux

Although it is true that with Rsync we do not make a download itself, it can help us to copy and synchronize files from a server. What in practice can be considered a download.

On the other hand, scp is a variation of the cp command that allows you to copy files over a network. As with Rsync it is not a download but in practice it allows us to do it. Especially when we have access to certain files from a given server.

Conclusion

The terminal is a marvel in Linux and so much so that you can download files from the internet or a network using commands. This is useful on servers or computers with ssh connections.

The post Terminal Tools for Downloading Files appeared first on Linux Windows and android Tutorials.

Download cURL for Windows.

The first thing we have to do is go to this website and download the corresponding version.

Then unzip it at the root of the Windows installation. Also, for ease of use assign a simple name to the folder. In my case, I chose curl:

Testing the installation.

The first thing you have to do is open a Command Prompt. With this intention press the Win+R combination and run cmd. Then navigate to the folder you unzipped by typing the following commands:

cd..
cd..
cd curl

To test the cURL installation please run the following command:

curl -V

Now let’s try a popular site, like google. With this in mind, please run the following command:

curl https://www.google.com

Adding the environment variable.

To be able to run curl, it is necessary to go to the program directory and from there run the commands. If we want to avoid this, it is necessary to edit the environment variables. In addition, add a new variable to the PATH environment. If you want to know how to do it, please see here. In this case, I only show you that the path you have to add is C:\curl

From now on we can run cURL from any Command Prompt. It is no longer necessary to scroll to the installation address.

In conclusion, we have seen how to install cURL on Windows. From now on you can use it to test HTTP requests. Also, as a programmer it is possible to use all the advantages it offers. All right, that’s it for now. Greetings!

The post How to install cURL in Windows. appeared first on Linux Windows and android Tutorials.

HTTPie is a command line HTTP client with an intuitive UI, JSON support, syntax highlighting, wget-like downloads, plugins, and more. Its goal is to make CLI interaction with web services as human-friendly as possible. In addition, HTTPie can be used for testing, debugging, and generally interacting with HTTP servers.

The mainly features are:

• Wget-like downloads.
• Python 2.7 and 3.x support.
• Linux, macOS and Windows support.
• Plugins.
• Sensible defaults.
• Expressive and intuitive command syntax.
• Colorized and formatted terminal output.
• Built-in JSON support.
• Persistent sessions.
• Forms and file uploads.

So, let us start.

Installing HTTPie

HTTPie is an application that is available in the main repositories of most Linux distributions. So, there is no major complication.

If you are using Debian, Ubuntu or derivates:

sudo apt install httpie

So, in case you are using Fedora:

sudo dnf install httpie

On CentOS / and RHEL:

sudo yum install httpie

Finally, if you are using Arch Linux o derivates:

sudo pacman -S httpie

Using HTTPie on Linux

HTTPie is not complicated to use. On the contrary, its syntax is quite simple to take advantage of. Its syntax is mainly like this:

http [flags] [METHOD] URL [ITEM [ITEM]]

However, if you run the following command, you will see all the options.

http --help

Let us see some examples.

Basic usage

The most basic way to use HTTPie is as follows:

http somepage.com

You can add th -v option to see other information about the site.

http -v somepage.com

Download a file with HTTPie

Similar to CURL with HTTPie it is possible to download a file. For this you can use this command:

http page.com/file > fileo

Where fileo is the name will be downloaded.

Or you can also use the wget way.

http --download page.com/file

So, this is how to download a file with HTTPie.

Upload a file

If you can download a file with HTTPie, obviously you can upload a file.

http example.com < file.odt

It is a very useful option to interact with servers, even homemade ones.

Submitting form

An interesting option is that you can interact with HTML forms. Imagine the possibilities. To do this, run this command.

http -f POST page.com input="value"

Basic authentication with HTTPie

Next, as part of the interaction with servers and applications, you can perform basic authentication from the console with HTTPie.

http -a username:password page.com

So, that’s all.

Conclusion

It’s good that sysadmin have CLI tools that facilitate some HTTP interaction processes. Therefore, HTTPie is presented as a great alternative to CURL and that’s why we win the users.

Please share this post with others.

The post Using HTTPie on Linux appeared first on Linux Windows and android Tutorials.

CURL is a command line tool and library for transferring data with URLs. Many download scripts or file transfers use CURL as a means to achieve this. In addition, CURL supports FTP, FTPS, Gopher, HTTP, HTTPS, IMAP, IMAPS, LDAP and many other protocols quite popular on networks.

On the other hand, the use of CURL is not limited exclusively to computers but to other devices that use UNIX such as cell phones, cars and is the transfer backend of many of the most popular applications in the world.

Using CURL command on Linux

The idea of this post is to show the use of CURL, not to do it in a theoretical way. The main idea is to do it through examples that demonstrate its use.

So, let’s start.

1. Install CURL

Obviously, the first step is to install CURL. It is really simple as it is available in the official repositories of most Linux distributions. So, its installation is limited to a single command.

For Debian, Ubuntu, Linux Mint and derivates

:~$ sudo apt install curl

If you use Fedora:

:~$ sudo dnf install curl

For CentOS and RHEL:

:~$ yum install curl

2. Check the CURL version

The second thing you should do is, check the CURL version. Important to know what news you have available. While it is not essential to have CURL updated to its latest version, it is also not crazy to do so.

:~$ curl --version

3. Display the content of an HTML

A simple way to display the source code of an HTML site from the terminal is with CURL.

:~$ curl http://website.com/page.html

Of course, it is necessary that you place the complete website of your preference.

4. Download a file with CURL

This is one of the most common uses we give to CURL. Downloading a file is a really simple task.

:~$ curl -O https://pixabay.com/en/photos/download/ocean-3605547_1280.jpg

You can use the -o option to specify the name of the downloaded file.

:~$ curl -o image.jpg https://pixabay.com/en/photos/download/ocean-3605547_1280.jpg

I remind you again that, I’m using test URLs, you have to enter yours.

5. Use a proxy

With CURL it is possible to make connections through a proxy. The proxy may or may not require authentication.

:~$ curl -x your-proxy:8080 -U user_password -O http://domain.com/file

In case the proxy server does not need authentication, you can omit the option -U.

6. Get HTTP header information from a website

There are occasions when it is necessary to know the information stored in the HTTP headers of some website. It is really easy to do it with CURL.

:~$ curl -I http://website.com

7. Limit download rate

If you are connected using mobile data or simply want to limit the CURL download rate, you can do it easily.

:~$ curl --limit-rate 100K -O http://domain.com/file.file

8. Download file from an FTP server

As I said at the beginning of this post, CURL supports many protocols, not only HTTP but also FTP. Now I will show you how to do it.

:~$ curl -u username:password -O ftp://ftpserver/file.zip

In case you do not need authentication, omit the option -u.

9. Upload Files to an FTP server

You can also upload files to an FTP server. The syntax is similar only this time, you should add the -T option.

:~$ curl -u username:password -T myfilepath.jpg ftp://ftpserver/file.zip

Note: I’m using false addresses and that’s why CURL can’t find them. But don’t worry that the commands are correct.

10. Check the CURL help

Of course, the use of the CURL command is very extensive and I only demonstrated some of its uses. For more information about the CURL command, it is convenient to consult its help from the terminal.

:~$ curl --help

And that’s it.

Conclusion

I hope this article has made clear to you the potential of CURL. There is so much potential that there is still so much to show, but I think the objective has been achieved.

CURL is widely used in script automation of content downloads and is not only used in computer equipment but in many others.

So, if you liked the article share it through your social networks.

The post How to use CURL command on Linux? appeared first on Linux Windows and android Tutorials.

When connecting to the server, the program sends a data like this – “Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:59.0) Gecko/20100101 Firefox/59.0”. The server identifies that you’re using Firefox (although you’re not). You can set out the option of your favorite browser as user-agent of the cURL tool.

Changing the user-agent

In cURL, the syntax for changing the user-agent follows this structure –

curl -A "user-agent-name-here" url
curl --user-agent "user-agent-name-here" url
curl -H "User-Agent: user-Agent-Name-Here"

The user agent also follows this structure –

Mozilla/[version] ([system and browser information]) [platform] ([platform details]) [extensions]

In this command line example, I’ll be using Firefox as the user-agent of cURL for connecting with OSRadar.

$ curl -A "Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:59.0) Gecko/20100101 Firefox/59.0" https://www.osradar.com/
$ curl -I -A "Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:59.0) Gecko/20100101 Firefox/59.0" https://www.osradar.com/

If you want to use your user-agent as Safari, use this command line –

curl -H "User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_1) AppleWebKit/537.36 (K HTML, like Gecko) Chrome/61.0.3163.100 Safari/537.36" https://www.osradar.com/

Enjoy cURL!

The post Change User Agent on cURL appeared first on Linux Windows and android Tutorials.