What is a virtual machine?

A virtual machine (VM) is a software implementation of a computer that runs on another computer. This way, allowing multiple operating systems to run on the same physical machine. It provides a virtualized environment for running applications, which are isolated from the host operating system and other VMs.

How a virtual machine works?

A virtual machine works by using a hypervisor, also known as a virtual machine monitor, to virtualize the underlying hardware of a physical computer. The hypervisor creates virtual devices and emulates their behavior. This way, it can to provide a virtual environment for the operating system and applications running within the VM. The VM communicates with the hypervisor, which in turn communicates with the physical hardware. So it allows the VM to access physical resources such as CPU, memory, and storage. This allows multiple VMs to run on the same physical machine. Also, each one with its own operating system and applications, without interfering with each other.

What are the advantages of using a virtual machine?

Some advantages of using a virtual machine include:

• Isolation: VMs provide a layer of isolation between the host operating system and applications. Therefore, reducing the risk of contamination or system instability.
• Cost-effectiveness: VMs can be a cost-effective solution for running multiple operating systems and applications on the same physical machine. This way reducing the need for multiple physical computers.
• Portability: VMs can be easily moved between physical machines, making it easier to migrate to new hardware or to recover from a failure.
• Compatibility: VMs can run older or incompatible applications, allowing them to continue to be used even on newer hardware or operating systems.
• Test environment: VMs are available to create a safe and controlled environment for testing new software or configurations without affecting the host operating system

Disadvantages of working with virtual machines

Some disadvantages of working with virtual machines include:

• Performance: VMs can have lower performance compared to running directly on physical hardware, as they must share the physical resources of the host machine.
• Resource utilization: Running multiple VMs on a single physical machine can consume a large amount of resources. Especially memory and storage.
• Complexity: Virtualization can introduce additional complexity to an IT environment, requiring specialized knowledge and skills to manage and maintain the virtual infrastructure.
• Licensing costs: Some virtualization platforms and operating systems have additional licensing costs that can add to the overall cost of implementing virtualization.
• Security: VMs can be vulnerable to security threats just like physical computers. Therefore, additional security measures may be required to secure the virtual environment.

What are the requirements for Windows to run virtual machines?

The requirements for Windows to run virtual machines are:

• A 64-bit processor with Second Level Address Translation (SLAT)
• At least 4 GB of RAM
• At least 64 GB of free hard disk space
• Hyper-V and Containers Windows features enabled
• Windows 10/11 Pro or Enterprise (64-bit) version 1909 or later
• A GPU with WDDM 2.0 driver for GPU acceleration (optional)

What is Hyper V, the virtualization module for windows?

Hyper-V is a native hypervisor from Microsoft that provides virtualization technology for creating and running virtual machines on Windows operating systems. It allows multiple operating systems to run on a single physical machine. In the same way, providing isolation and security for each virtual machine and enabling efficient utilization of hardware resources. With Hyper-V, users can create and manage virtual machines. Also configuring virtual switches, storage, and network interfaces, and monitor virtual machine performance and resource usage. It is available as a feature in Windows 10/11 Pro and Enterprise editions.

What are the most used virtualization software?

The most widely used virtualization software are:

• VMware vSphere
• Microsoft Hyper-V
• Citrix XenServer
• Oracle VirtualBox
• Red Hat Virtualization (RHV)
• Proxmox Virtual Environment
• KVM (Kernel-based Virtual Machine)
• AWS (Amazon Web Services)
• Google Compute Engine
• Alibaba Cloud Elastic Compute Service (ECS)

They are certainly the most popular. However, we will highlight those most commonly used in Windows environment. Previously, we talked about Hyper V. Therefore, we will start with Virtual Box.

Oracle Virtual Box

VirtualBox is a free and open-source virtualization software for x86 and AMD64/Intel64-based computers. It allows users to run multiple operating systems on a single physical machine. Also, each one in its own virtual environment. Moreover, providing isolation and security for each virtual machine. VirtualBox provides a user-friendly interface for creating, configuring and managing virtual machines.

In addition, including support for storage and network interfaces, and can be used for a wide range of purposes including software development, testing, and personal use. It can run on various host operating systems including Windows, macOS, Linux, and Solaris, and supports a wide range of guest operating systems including Windows, Linux, and BSD distributions.

VMware vSphere

VMware vSphere is a comprehensive enterprise-class virtualization platform. It provides a centralized management solution for virtual infrastructure. Moreover, it is used for creating, deploying and managing virtual machines, networks, and storage resources. With vSphere, IT organizations can pool and allocate shared resources to virtual machines and application. With this in mind, enabling efficient utilization of hardware resources, high availability, and disaster recovery.

vSphere includes features such as live migration of virtual machines, storage and network resource management, and multi-hypervisor support, as well as a robust security model and a powerful API for integration with other management tools. It is widely used in data centers and cloud environments for virtualizing business-critical applications, and is available as a standalone product or as part of the VMware Cloud Foundation, a unified SDDC platform for deploying and managing a hybrid cloud.

Very well, in this way we have seen what Virtual Machines are. We also check what are the advantages and disadvantages of using them. We also learned how they work. Furthermore, we saw which are the most used ones, plus what you need to run them on Windows.

The post What is a virtual machine? appeared first on Linux Windows and android Tutorials.

What is it?

According to the project’s website,

GoAccess is an open source real-time web log analyzer and interactive viewer that runs in a terminal in *nix systems or through your browser.

Also, “It provides fast and valuable HTTP statistics for system administrators that require a visual server report on the fly”.

Some features are:

• Fast, real-time, millisecond/second updates, written in C
• Only ncurses as a dependency
• Nearly all web log formats (Apache, Nginx, Amazon S3, Elastic Load Balancing, CloudFront, etc)
• Simply set the log format and run it against your log
• Beautiful terminal and bootstrap dashboards (Tailor GoAccess to suit your own color taste/schemes)
• and of course, Valgrind tested.

Installing GoAccess on Ubuntu 20.04 / Debian 10

GoAccess is available in the official Ubuntu repositories, so the installation is quite simple but it is convenient to have the latest version available. So, you have to add the GoAccess repository.

To do this, open a terminal and execute the following commands:

echo "deb http://deb.goaccess.io/ $(lsb_release -cs) main" | sudo tee -a /etc/apt/sources.list.d/goaccess.list
wget -O - https://deb.goaccess.io/gnugpg.key | sudo apt-key --keyring /etc/apt/trusted.gpg.d/goaccess.gpg add -

Now refresh the APT cache:

sudo apt update

And performs the installation running:

sudo apt install goaccess
Reading package lists… Done
 Building dependency tree       
 Reading state information… Done
 The following additional packages will be installed:
   libmaxminddb0 libncursesw5 libtinfo5
 Suggested packages:
   mmdb-bin
 Recommended packages:
   libgpm2
 The following NEW packages will be installed:
   goaccess libmaxminddb0 libncursesw5 libtinfo5
 0 upgraded, 4 newly installed, 0 to remove and 28 not upgraded.
 Need to get 833 kB of archives.
 After this operation, 2,025 kB of additional disk space will be used.
Do you want to continue? [Y/n]

If you want, you ca check the installed version:

goaccess --version
GoAccess - 1.4.6.
 For more details visit: https://goaccess.io/
 Copyright (C) 2009-2020 by Gerardo Orellana
And so you can get GoAccess, now let's use it a little.

Using GoAccess on Ubuntu 20.04 / Debian 10

The first thing you can do is check the help that the terminal gives us, for that you can run:

goaccess --help

On the other hand, the most basic way to use goaccess is simply by specifying a log file.

goaccess /var/log/apache2/access.log

Or you can select the log of your Virtualhost.

There you will be shown a screen in the terminal where you can choose the log output format.

In my case, I have chosen the third option (CLF).

And immediately it will start the analysis.

Note: I am working with a home test server. Therefore, there is not so much activity in the log.

But you can also specify a log format to make it work with, for example, squid. Although we recommend that you read the official documentation

A very interesting option is to display it directly on your web browser. I think this is the best possible option.

sudo goaccess /var/log/apache2/access.log --log-format=COMBINED -a -o /var/www/html/file.html

And this will generate a file that you can open from the browser. Remember to modify the name of the output file.

And this is the basic use of GoAccess as we see is a basic but very useful tool.

Conclusion

Having a program that can analyze logs graphically and interactively is an advantage for all of us who work on Linux. That’s why today we wanted to show you GoAccess.

So, share this post and join our Telegram channel and our Facebook page. Also, buy us a coffee 😉

The post Install GoAccess on Ubuntu 20.04 / Debian 10? appeared first on Linux Windows and android Tutorials.

According to the project website:

Apache Spark is a unified analytics engine for large-scale data processing.

Also, we can count on its maintenance and evolution to be carried out by prestigious working groups, and there will be great flexibility and interconnection with other Apache modules such as Hadoop, Hive, or Kafka.

Spark is used by a wide range of organizations to process large datasets. In fact, Since 2009, more than 1200 developers have contributed to Spark!

Learning Apache Spark is easy whether you come from a Java, Scala, Python, R, or SQL background.

Install Apache Spark on Debian 10

The installation of Apache Spark is quite simple and easier than you might think.

Install some required packages

So, connect via SSH to your server or open a terminal. To make sure there are no problems, update the distribution completely.

sudo apt update
sudo apt upgrade

After that, install Java on Debian 10.

sudo apt install default-jdk
Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following additional packages will be installed:
  ca-certificates-java default-jdk-headless default-jre default-jre-headless fontconfig-config fonts-dejavu-core java-common libasound2 libasound2-data
  libavahi-client3 libavahi-common-data libavahi-common3 libcups2 libdrm-amdgpu1 libdrm-common libdrm-intel1 libdrm-nouveau2 libdrm-radeon1 libdrm2 libfontconfig1
  libgif7 libgl1 libgl1-mesa-dri libglapi-mesa libglvnd0 libglx-mesa0 libglx0 libjpeg62-turbo liblcms2-2 libllvm7 libnspr4 libnss3 libpciaccess0 libpcsclite1
  libsensors-config libsensors5 libx11-6 libx11-data libx11-xcb1 libxau6 libxcb-dri2-0 libxcb-dri3-0 libxcb-glx0 libxcb-present0 libxcb-sync1 libxcb1 libxdamage1
  libxdmcp6 libxext6 libxfixes3 libxi6 libxrender1 libxshmfence1 libxtst6 libxxf86vm1 openjdk-11-jdk openjdk-11-jdk-headless openjdk-11-jre openjdk-11-jre-headless
  x11-common
Suggested packages:
  libasound2-plugins alsa-utils cups-common liblcms2-utils pciutils pcscd lm-sensors openjdk-11-demo openjdk-11-source visualvm libnss-mdns fonts-dejavu-extra
  fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei | fonts-wqy-zenhei fonts-indic
Recommended packages:
  libxt-dev libatk-wrapper-java-jni fonts-dejavu-extra
The following NEW packages will be installed:
  ca-certificates-java default-jdk default-jdk-headless default-jre default-jre-headless fontconfig-config fonts-dejavu-core java-common libasound2 libasound2-data
  libavahi-client3 libavahi-common-data libavahi-common3 libcups2 libdrm-amdgpu1 libdrm-common libdrm-intel1 libdrm-nouveau2 libdrm-radeon1 libdrm2 libfontconfig1
  libgif7 libgl1 libgl1-mesa-dri libglapi-mesa libglvnd0 libglx-mesa0 libglx0 libjpeg62-turbo liblcms2-2 libllvm7 libnspr4 libnss3 libpciaccess0 libpcsclite1
  libsensors-config libsensors5 libx11-6 libx11-data libx11-xcb1 libxau6 libxcb-dri2-0 libxcb-dri3-0 libxcb-glx0 libxcb-present0 libxcb-sync1 libxcb1 libxdamage1
  libxdmcp6 libxext6 libxfixes3 libxi6 libxrender1 libxshmfence1 libxtst6 libxxf86vm1 openjdk-11-jdk openjdk-11-jdk-headless openjdk-11-jre openjdk-11-jre-headless
  x11-common
0 upgraded, 61 newly installed, 0 to remove and 0 not upgraded.
Need to get 294 MB of archives.
After this operation, 642 MB of additional disk space will be used.
Do you want to continue? [Y/n]

And verify that everything went well by displaying the installed version.

java --version
openjdk 11.0.9.1 2020-11-04
OpenJDK Runtime Environment (build 11.0.9.1+1-post-Debian-1deb10u2)
OpenJDK 64-Bit Server VM (build 11.0.9.1+1-post-Debian-1deb10u2, mixed mode, sharing)

With Java running correctly, it’s time to install the Scala package on Debian 10.

sudo apt install scala

Check the version of Scala to make sure it was installed correctly.

scala -version
Scala code runner version 2.11.12 -- Copyright 2002-2017, LAMP/EPFL

With this, we are done with the Apache Spark dependencies.

Download and install Apache Spark on Debian 10

Now we can download the Apache Spark binary.

So, navigate to the /tmp/ folder and from there with the wget command to perform the download

cd /tmp
wget -c https://archive.apache.org/dist/spark/spark-3.0.2/spark-3.0.2-bin-hadoop2.7.tgz

then decompress it and move it to a safe location such as /opt/.

tar -xvzf spark-3.0.2-bin-hadoop2.7.tgz
sudo mv spark-3.0.2-bin-hadoop2.7/ /opt/spark

To use Apache Spark seamlessly from any location at the prompt, you need to add this path to the .bashrc file

nano ~/.bashrc

At the end of the file, add the following lines:

export SPARK_HOME=/opt/spark
export PATH=$PATH:$SPARK_HOME/bin:$SPARK_HOME/sbin

Save the changes and close the editor. To apply the changes run:

source ~/.bashrc

Now start Apache Spark with these commands, one of which is the master of the cluster

start-master.sh
starting org.apache.spark.deploy.master.Master, logging to /opt/spark/logs/spark-angelo-org.apache.spark.deploy.master.Master-1-osradar.out

And the slave, which in this case will be the same localhost, but you can replace it with the IP address or Domain of the computer.

start-slave.sh spark://localhost:7077
starting org.apache.spark.deploy.worker.Worker, logging to /opt/spark/logs/spark-angelo-org.apache.spark.deploy.worker.Worker-1-osradar.out

Now you can open a web browser and access the web interface via http://your-server:8080.

So, Apache Spark is working properly…

Conclusion

Apache Spark is easy to install on Debian 10 but so powerful that you can hardly believe it. With this tool, you can do a lot of things with a lot of data.

The post How to install Apache Spark on Debian 10 appeared first on Linux Windows and android Tutorials.

Step 1: Update Your System

First of all as usual we do, update your system to have the latest packages installed.

sudo apt update && sudo apt upgrade

Step 2: Install Java on Ubuntu 20.04

As Java is required for the graylog server so install it by visiting the below tutorial and proceed further.

How To Install Java On Ubuntu 20.04

Install the other required packages by typing

sudo apt install -y apt-transport-https openjdk-11-jre-headless uuid-runtime pwgen curl dirmngr

Verify the java version installed by hitting

java -version

Output:

sabi@sabi20:~$ java --version
openjdk 11.0.8 2020-07-14
OpenJDK Runtime Environment (build 11.0.8+10-post-Ubuntu-0ubuntu120.04)
OpenJDK 64-Bit Server VM (build 11.0.8+10-post-Ubuntu-0ubuntu120.04, mixed mode, sharing)

Step 3: Install Elasticsearch on Ubuntu 20.04

Now, install the elasticsearch as it provides the facility of storing the logs coming from the external sources so it is very useful to use with graylog. Install it by following the below steps.

Hit the below command to download and install the GPG signing key.

wget -qO - https://artifacts.elastic.co/GPG-KEY-elasticsearch | sudo apt-key add -

Then type the below command to add the Elasticsearch repository on your system.

echo "deb https://artifacts.elastic.co/packages/oss-6.x/apt stable main" | sudo tee -a /etc/apt/sources.list.d/elastic-6.x.list

Finally type the following command to install the Elasticsearch on Ubuntu 20.04.

sudo apt update
sudo apt install -y elasticsearch-oss

Step 4: Configure Elasticsearch with Graylog Server on Ubuntu 20.04

To configure the elasticsearch with graylog, edit the /etc/elasticsearch/elasticsearch.yml file and set up the cluster name as graylog.

cluster.name: graylog

Then add or uncomment the following line.

action.auto_create_index: false

After it reload the Elasticsearch services to take effect of updated configs.

sudo systemctl daemon-reload
sudo systemctl start elasticsearch
sudo systemctl enable elasticsearch

It’ll take maximum 1 minutes to start the services.

Elasticsearch listen to the port 9200. You can use the curl command to verify it.

curl -X GET http://localhost:9200

Output:

You’ll see the similar result. Make sure that the cluster name is graylog.

Step 5:Install MongoDB on Ubuntu 20.04

Install the MongoDB v3.6 by running the below commands in your terminal.

sudo apt update
sudo apt install -y mongodb-server

And start the MogoDB services.

sudo systemctl start mongodb
sudo systemctl enable mongodb

Step 6: Install Graylog Server on Ubuntu 20.04

As graylog gets data from the elasticsearch and show it on its web interface so it’s easy to read and go through.

Hit the below commands to add the repository of graylog and install it in Ubuntu 20.04.

wget https://packages.graylog2.org/repo/packages/graylog-3.3-repository_latest.deb
sudo dpkg -i graylog-3.3-repository_latest.deb
sudo apt update
sudo apt install -y graylog-server

As for security reasons, enable the secret to secure the user passwords. To do this hit the below command in your terminal.

pwgen -N 1 -s 96

Result:

sabi@sabi20:~$ pwgen -N 1 -s 96
LmnaUmCKUmBgA2mwYpPNoC9FQP8YVR1ijerL00W00oB3scJrwk4CCpIQo3uI2llBlqug5v13UVIx5kXSrvExZ28gGRZlRulC

Now, edit the server.conf file and paste the above secret as seen below:

sudo nano /etc/graylog/server/server.conf
password_secret = LmnaUmCKUmBgA2mwYpPNoC9FQP8YVR1ijerL00W00oB3scJrwk4CCpIQo3uI2llBlqug5v13UVIx5kXSrvExZ28gGRZlRulC

Then generate a hash password for the admin user of graylog that can be used to log in to web interface.

echo -n Your_Password | sha256sum

Replace Your_Password with your desired password.

Result:

99e87ec1196275a0c4ef6e5dd1cabd34f0c9a6ed680f24914b773295babd5da2 -

Now, edit the server.conf file and paste the hash password generated above.

root_password_sha2 = 99e87ec1196275a0c4ef6e5dd1cabd34f0c9a6ed680f24914b773295babd5da2 -

Step 7: Setup Graylog Web Interface on Ubuntu 20.04

To use the graylog web interface, enable it by editing server.conf file.

sudo nano /etc/graylog/server/server.conf

And replace the below line with your system IP.

http_bind_address = 192.168.0.10:9000

Finally start the graylog services by running below commands.

sudo systemctl daemon-reload
sudo systemctl start graylog-server
sudo systemctl enable graylog-server

If you got any error during the installation, you can follow up the graylog logs at startup by typing.

sudo tail -f /var/log/graylog-server/server.log

You’ll see the similar output upon successful installation.

2020-09-29T16:03:06.326-04:00 INFO [ServerBootstrap] Graylog server up and running.

Step 8: Access Graylog on Ubuntu 20.04

Type the IP:9000 in your browser to access graylog web interface.

Provide the credentials (username=”admin” and password=”root_password_sha2″ created earlier) to log in to the dashboard.

After the logged in, you’ll see the welcome page.

Then, navigate to the System>>Overview to see the status of graylog server.

So, this is how you can install Graylog on Ubuntu 20.04

The post How To Install Graylog On Ubuntu 20.04 appeared first on Linux Windows and android Tutorials.

Step 1: Update Your System

First of all before going to install any package, update your system with the command.

sudo apt update

Step 2: Install Pip for Python3 on Ubuntu 20.04

As Python3 is already installed on Ubuntu 20.04, to make sure verify the version by using the following command.

python3 --version

Output:

You’ll see the similar output.

sabi@Ubuntu:~$ python3 --version
 Python 3.8.2

After confirming that Python3 is present on your Ubuntu 20.04, move towards the installation of pip package for installing Python3 pip packages. Type the given command into your terminal.

sudo apt install -y python3-pip

Output:

Setting up python3-pip (20.0.2-5ubuntu1) ... Setting up libc6-dev:amd64 (2.31-0ubuntu9) ... Setting up binutils-x86-64-linux-gnu (2.34-6ubuntu1) ... Setting up libstdc++-9-dev:amd64 (9.3.0-10ubuntu2) ... Setting up binutils (2.34-6ubuntu1) ... Setting up dpkg-dev (1.19.7ubuntu3) ... Setting up libexpat1-dev:amd64 (2.2.9-1build1) ... Setting up libpython3.8-dev:amd64 (3.8.2-1ubuntu1.1) ... Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-2ubuntu1) ... Setting up gcc-9 (9.3.0-10ubuntu2) ... Setting up libpython3-dev:amd64 (3.8.2-0ubuntu2) ... Setting up gcc (4:9.3.0-1ubuntu2) ... Setting up g++-9 (9.3.0-10ubuntu2) ... Setting up python3.8-dev (3.8.2-1ubuntu1.1) ... Setting up g++ (4:9.3.0-1ubuntu2) ... update-alternatives: using /usr/bin/g++ to provide /usr/bin/c++ (c++) i n auto mode Setting up build-essential (12.8ubuntu1) ... Setting up python3-dev (3.8.2-0ubuntu2) ... Processing triggers for mime-support (3.64ubuntu1) ... Processing triggers for gnome-menus (3.36.0-1ubuntu1) ... Processing triggers for libc-bin (2.31-0ubuntu9) ... Processing triggers for man-db (2.9.1-1) ... Processing triggers for desktop-file-utils (0.24-1ubuntu2) ... 

After the installation completed, verify the version of pip using the following command.

pip3 --version

Output:

You’ll see the output similar to this one.

sabi@Ubuntu:~$ pip3 --version
pip 20.0.2 from /usr/lib/python3/dist-packages/pip (python 3.8)

So, as we’ve installed the pip successfully now we’ll learn that how we can use pip to get Python packages on Ubuntu 20.04.

Step 3: How To Use Pip on Ubuntu 20.04

Below is the format you can use in order to install the package with the help of Pip command.

pip3 install package-name

In this case I’m going to install IPython on my Ubuntu 20.04 system so the command will be like this.

pip3 install IPython

Successful output;

Successfully built backcall
 Installing collected packages: decorator, pygments, parso, jedi, pickleshare, wcwidth, prompt-toolkit, ipython-genutils, traitlets, backcall, IPython
   WARNING: The script pygmentize is installed in '/home/sabi/.local/bin' which is not on PATH.
   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
   WARNING: The scripts iptest, iptest3, ipython and ipython3 are installed in '/home/sabi/.local/bin' which is not on PATH.
   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
 Successfully installed IPython-7.13.0 backcall-0.1.0 decorator-4.4.2 ipython-genutils-0.2.0 jedi-0.17.0 parso-0.7.0 pickleshare-0.7.5 prompt-toolkit-3.0.5 pygments-2.6.1 traitlets-4.3.3 wcwidth-0.1.9

You can mention the version name if you want to install the specific version of the packages with the help of following command.

pip3 install IPython==6.0

Step 4: Find installed Pip Packages

Simply fire the follwoing command to get list of the installed packages using pip.

pip3 list

Result:

You’ll see the similar output.

abi@Ubuntu:~$ pip3 list
 Package                Version      
 
 apturl                 0.5.2        
 backcall               0.1.0        
 blinker                1.4          
 Brlapi                 0.7.0        
 certifi                2019.11.28   
 chardet                3.0.4        
 command-not-found      0.3          
 cryptography           2.8          
 cupshelpers            1.0          
 dbus-python            1.2.16       
 decorator              4.4.2        
 defer                  1.0.6        
 distro                 1.4.0        
 distro-info            0.23ubuntu1  
 entrypoints            0.3          
 httplib2               0.14.0                 

Step 5: How to Upgrade Packages with Pip

For upgrading of the installed package run the following command.

pip3 install --upgrade IPython

So, it will upgrade the package to latest one.

Step 6: How To Remove Packages using Pip

In order to remove any package installed with pip, hit the given command in your Ubuntu 20.04 terminal.

pip3 uninstall IPython

Step 7 How To Search Packages with Pip

With the help of Pip you can search the different packages for your convenience. It provides you the available packages from the PyPI. Run the command in similar way to search for packages.

pip3 search zabbix

Output:

abi@Ubuntu:~$ pip3 search zabbix
 zabbix (1.2.4)                            - Python module to work
                                             with zabbix.
 zabbix-tuner (0.2)                        - Zabbix Tuner
 zabbix-api (0.5.4)                        - Zabbix API
 zabbix-multisender (0.4.7)                - Zabbix MiltiSender
 zabbix-client (0.1.2)                     - Zabbix API wrapper
 zabbix-elasticsearch (0.4.0)              - Zabbix Monitoring for
                                             Elasticsearch
 flask-zabbix (0.1.1)                      - Zabbix API wrapper
 dbaas-zabbix (0.7.2)                      - A Zabbix Integration for
                                             DBaaS.
 waldur-zabbix (0.8.4)                     - Waldur Zabbix adds
                                             support for Zabbix
                                             monitoring server
                                             management
 nodeconductor-zabbix (0.6.0)              - NodeConductor Zabbix adds
                                             support for Zabbix

So, this is how you can install and use Pip on Ubuntu 20.04

The post How To Install Pip on Ubuntu 20.04 appeared first on Linux Windows and android Tutorials.

It is a network monitoring tool that helps you to monitor your network status.
Icinga gets data and after various performance give you status over Internet anywhere.

So, in this lecture we will cover the installation of Icinga 2.

First of all make sure you’ve root privileges.

$ sudo su –

As it depends upon other packages. So, configure EPEL repository on Centos 8 / RHEL 8.

rpm -ivh https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm

Also enable the optional & extra repositories.

subscription-manager repos –enable rhel-8-server-optional-rpms
subscription-manager repos –enable rhel-8-server-extras-rpms

Adding Icinga 2 Repository

Now, add Icinga 2 repository.

rpm –import https://package.icinga.com/icinga.key
yum install https://package.icinga.com/epel/icinga-rpm-release-8-latest.noarch.rpm

Installing Icinga 2

yum -y install icinga2

Start and enable Icinga Services.

systemctl start icinga2

systemctl enable icinga2

SELinux

Make sure you’ve installed SELinux.

Now install the given package for targeted policy.

yum install -y icinga2-selinux

Plugin is necessary for monitoring. So install Nagios Plugin.

Installing Nagios Plugin

yum -y install nagios-plugins-all

Configuring DB IDO MySQL

DB IDO helps to export all the configuration & status information to database. So, we must have DB server.

If you’ve already installed then skip the below step.

yum -y install mariadb-server mariadb

Now, start and enable MariaDB services.

systemctl start mariadb

systemctl enable mariadb

Make sure to Secure your MariaDB installation.

Installing IDO modules for MySQL

Now install IDO modules for MySQL

yum -y install icinga2-ido-mysql

Creating Database for Icinga2

Now create a Database after logging as a root user. It will help you to set up web interface.

mysql -u -root -p

CREATE DATABASE icinga2;

GRANT ALL PRIVILEGES ON icinga2.* to icinga2@localhost IDENTIFIED BY ‘icinga123’;
FLUSH PRIVILEGES;
quit

Now import the Icinga 2 IDO schema by running this command

mysql -u -root -p icinga2 < /usr/share/icinga2-ido-mysql/schema/mysql.sql

Enabling IDO MySQL Modules

Now, Enable IDO MYSQL modules.

icinga2 feature list

Output:

Disabled features: api command compatlog elasticsearch gelf graphite influxdb livestatus opentsdb perfdata statusdata syslog
Enabled features: checker ido-mysql mainlog notification

You can see that ido-mysql is already enabled.
If not enabled you can do it by this command.

icinga2 feature enable ido-mysql

For smooth performance, you can also enable command feature.

icinga2 feature enable command

Configuration of IDO DB MySQL module

After enabling IDO module icinga2 changes the file path to /etc/icinga2/features-enabled/ido-mysql.conf.
You can set up DB manually.

vi /etc/icinga2/features-enabled/ido-mysql.conf

Provide your details according to your own requirements.
Now restart icinga2 services.

systemctl restart icinga2

Make sure icinga2 is running.

systemctl status icinga2.

Firewall

If firewall blocks you, give permissions to disable it.

firewall-cmd –permanent –add-port=5665/tcp
firewall-cmd –reload You’ve all done we will cover the web configuration of Icinga 2 in next tutorial.
READ: How to Setup Icinga 2 Web interface on Centos / RHEL 8.

The post How to Install Icinga 2 on Centos / RHEL 8 appeared first on Linux Windows and android Tutorials.

ELK is the group of three open source projects in Linux.  Elastic Search, Logstash and Kibana respectively. Before going into depth let’s have a short definition about these:

Elasticsearch:

This is an open source distribution, reliable, scalable, easy to use and flexible Lucene library based search engine. It provides multitenant-capable text with an HTTP web interface.

Logstash:

It is an open source tool used to store data, collect information, and store it for further use. Kibana is used to retrieve the logs stored by Logstash.

Kibana:

Let’s you transform your data into your own format or specific shape like charts and graphs in Elasticsearch. 

So, in this article we will cover the following :

• How to Install Java on Centos 8

• How to add ELK repository to Centos 8

• How to install and Configure Elasticsearch 

• How to instaall and configure Kibana on Centos 8

• How to install and configure Logstash on Centos 8

• How to install other ELK tools(Optional)

Step 1: Install Java on Centos 8

Before installing Elasticsearch we must have java installed on our system as Elasticsearch depends on java.  So install it before further proceeding.

How to install Java 11 (OpenJdk 11 on RHEL / Centos 8

Step 2: Add ELK repository to Centos 8

After installing java, add ELK repository  to Centos 8 and run the following command as Sudo.

For Elasticsearch 7.x 

cat <<EOF | sudo tee /etc/yum.repos.d/elasticsearch.repo

[elasticsearch -7.x]

name=Elasticsearch repository for 7.x packages

baseurl=https://artifacts.elasticsearch.co/packages/7.x/yum

gpgcheck=1

gpgkey=https://artifacts.elastic.co/GPG-KEY-elasticse

enabled=1

autorefresh=1

type=rpm-md

EOF

For Elasticsearch 6.x

cat <<EOF | sudo tee /etc/yum.repos.d/elasticsearch.repo

[elasticsearch -6.x]

name=Elasticsearch repository for 6.x packages

baseurl=https://artifacts.elasticsearch.co/packages/6.x/yum

gpgcheck=1

gpgkey=https://artifacts.elastic.co/GPG-KEY-elasticse

enabled=1

autorefresh=1

type=rpm-md

EOF

For Elasticsearch 5.x

cat <<EOF | sudo tee /etc/yum.repos.d/elasticsearch.repo

[elasticsearch -5.x]

name=Elasticsearch repository for 5.x packages

baseurl=https://artifacts.elasticsearch.co/packages/5.x/yum

gpgcheck=1

gpgkey=https://artifacts.elastic.co/GPG-KEY-elasticse

enabled=1

autorefresh=1

type=rpm-md

EOF

After doing so, import GPG key

sudo rpm –import https://artifacts.elastic.co/GPG-KEY-elasticsearch

Now,  clear and update your YUM package index. 

sudo yum clean all

sudo yum makecache

Step 3: Install and Configure Elasticsearch

As we have done with Elasticsearch repository and now it’s ready to use. Now make sure to run this command to install Elasticsearch.

sudo yum -y install elasticsearch

Double-check that installation completed successfully. 

rpm -qi elasticsearch

Set up the JVM options like memory limits and others according to your own needs. For this edit the following file:

Here we have set up maximum size of total heap space.

/etc/elasticsearch/jvm.options

You can adjust according to your system requirements. 

Now,  start and enable the Elasticsearch services.

Make sure these are properly working. 

Let’s create a test index.

curl -X PUT “http://127.0.0.1:9200/mytest_index”

Step 4: Install / Configure Kibana on Centos 8

From added Elasticsearch repository download and install kibana. 

sudo yum -y install kibana

Configure it after installation completed. 

sudo vim /etc/kibana/kibana.yml
server.host: “0.0.0.0“
server.name: “kibana.example.com”
elasticsearch.url: “http://localhost:9200“

Set up other settings to your own requirements and start kibana services.

sudo systemctl enable –now kibana

Visit http://ip-address:5601 to open kibana dashboard 

If you have firewall service active make sure to allow TCP port 5601.

sudo firewall-cmd –add-port=5601/tcp –permanent
sudo firewall-cmd –reload

Step 4: Install / Configure Logstash on Centos 8

The last step is to install and configure Logstash which will act like a centralized logs server for your client systems and runs an agent like filebeat.

sudo yum -y install logstash

Customize settings under the following directory: /etc/logstash/conf.d/ For further information you can check out Logstash configuration manual. 

Step 5: Install other ELK tools – (optional) 

Some of these tools help you to work smoothly.

Filebeat:

It makes things simple by following lightweight way to forward and centralized logs and files. 

Metricbeat:

Helps you to send and collect metrics from your systems and services, from CPU to memory,  Redis to NGINX,  and many more.  It’s also a lightweight way to access system and services statistics.

Packetbeat:

Packetbeat provides a lightweight way for Network Data to increase performance.

Heartbeat:

Monitors the up time of Services. Helps you to know Availability of services. 

Auditbeat:

Useful for auditing the activities and processes on your system by users. The tools we have discussed so far can be installed with the give command one time or you can install individually by this command.

sudo yum install filebeat auditbeat metricbeat packetbeat heartbeat-elastic

These add-on tools help you better experience.To configure any tool you can check  official ELK stack documentation.

Hope you are all done!  If have any queries regarding this tutorial leave a comment!

The post How to Install ELK Stack on Centos 8? appeared first on Linux Windows and android Tutorials.

The Firewall on CentOS 8

CentOS firewall is firewalld. It is an application that allows trusting a firewall in a Linux system in a fast and easy way. It has the main advantage that it supports IPv4 and IPv6 in addition to being very stable and fast to set the rules.

Firewalld is configured as a system service. Therefore, we use systemctl as a command to manage it. By default, it is installed and active which makes CentOS a fairly stable and secure system.

In case you want to stop the service just apply this command:

:~# systemctl stop firewalld

Then, if you want to start it, just use this one:

:~# systemctl start firewalld

Or just restart it,

:~# systemctl restart firewalld

Finally, if you want to know the status of the service, the command would be as follows:

:~# systemctl status firewalld

so we manage the service on a basic basis.

The firewall zones on CentOS

Firewalld works with different zones that have a default configuration. There are many different zones. If we order them from greater restriction to lesser restriction, they would be as follows:

• Drop
• Block
• Public
• External
• Internal
• Dmz
• Work
• Home
• Trusted

Generally, the default zone in CentOS is public. It implies that the changes we make will be reflected in that zone. If you want to know the active zone, use this command:

:~# firewall-cmd --get-default-zone
public

Now let’s add service and open ports.

Adding service and ports

This firewall allows you to add services that contain configuration for the most common programs that use ports. To know what these services are, you can list them with the following command:

:~# firewall-cmd --get-services
RH-Satellite-6 amanda-client amanda-k5-client bacula bacula-client bitcoin bitcoin-rpc bitcoin-testnet bitcoin-testnet-rpc ceph ceph-mon cfengine condor-collector ctdb dhcp dhcpv6 dhcpv6-client dns docker-registry dropbox-lansync elasticsearch freeipa-ldap freeipa-ldaps freeipa-replication freeipa-trust ftp ganglia-client ganglia-master high-availability http https imap imaps ipp ipp-client ipsec iscsi-target kadmin kerberos kibana klogin kpasswd kshell ldap ldaps libvirt libvirt-tls managesieve mdns mosh mountd ms-wbt mssql mysql nfs nrpe ntp openvpn ovirt-imageio ovirt-storageconsole ovirt-vmconsole pmcd pmproxy pmwebapi pmwebapis pop3 pop3s postgresql privoxy proxy-dhcp ptp pulseaudio puppetmaster quassel radius rpc-bind rsh rsyncd samba samba-client sane sip sips smtp smtp-submission smtps snmp snmptrap spideroak-lansync squid ssh synergy syslog syslog-tls telnet tftp tftp-client tinc tor-socks transmission-client vdsm vnc-server wbem-https xmpp-bosh xmpp-client xmpp-local xmpp-server

As you can note are many, so it’s probably all there.

To add a service to the current zone, just use the following command:

:~# firewall-cmd --zone=public --add-service=http --permanent

We added the clause --permanent so that the changes are not temporary. In this way, we will be able to enjoy the service at all times.

Then list the active services in the current zone and you will see the changes.

:~# firewall-cmd --zone=public --list-services
dhcpv6-client http ssh

Finally, restart the firewall for the changes to take effect on the network.

:~# firewall-cmd --reload

In case you need to open a specific port, it can also be done with firewalld. To do this, use the following command:

:~#firewall-cmd --zone=public --permanent --add-port=[port]/[protocol]

The protocols can be TCP or UDP. For example:

:~#firewall-cmd --zone=public --permanent --add-port=5234/tcp

Now see the open ports in the firewall.

:~# firewall-cmd --zone=public --permanent --list-ports
5234/tcp

Finally, restart the firewall.

:~# firewall-cmd --reload

And that’s it.

Conclusion

With this little guide you will not be an expert in the use of CentOS 8 Firewall. But it does serve as the basis for most of the tutorials on our website. It is also necessary to know something about the basic use of the firewall in CentOS in order to perform better in the use of the system.

You can also learn to use the firewall in Ubuntu.

Please share this post and join our Telegram channel.

The post Basic use of the firewall on CentOS 8 appeared first on Linux Windows and android Tutorials.

Inventory File

In the example, I am going to deploy Three nodes of ElasticSearch – one represent MASTER role, while other two as DATA role.

[elastic_master]
es-0001 ansible_host=172.17.0.10

[elastic_data]
es-0002 ansible_host=172.17.0.11
es-0003 ansible_host=172.17.0.12

prod.yaml

- hosts: elastic_master <------------ following actions will be performed against any host listed in elastic_master alias which found to be in inventory file
  remote_user: root <---------------- to execute the command as root
  become: true
  pre_tasks:
    - name: "Installing basic packages"
      action: yum <---------------- calls the yum module and any key that goes with with_items will be installed
              name={{ item }}
              state=installed
      with_items:
        - unzip
      when: ansible_os_family == "RedHat" <---------------- a condition such that instruct the ansible pre_tasks should only suppose to be executed on a Fedora based distribution
  roles:
   - { role: elastic_master_install }


- hosts: elastic_data
  remote_user: root
  become: true
  pre_tasks:
    - name: "Installing basic packages"
      action: yum
              name={{ item }}
              state=installed
      with_items:
        - unzip
      when: ansible_os_family == "RedHat"
  roles:
   - { role: elastic_data_install }

Default File

As we already covered this variables will be used when files which are in Jinga format are being copied under the Template DIrectory.

# vim roles/elastic_master_install/defaults

cluster_name: clusterName
node_master_true: "true"
node_data_true: "false"
node_ingest_true: "false"
path_to_log: /data/elk/logs
path_to_data: /data/elk/data
http_port: 9200
transport_tcp_port: 9300
discovery_zen_ping_unicast_hosts: '["172.17.0.10"]'

### - jvm config
init_heap_size: "-Xms8g"
max_heap_size: "-Xmx8g"

Template file Example

This is how a basic elasticsearch.yaml looks like in Jinja fromat.

# vim roles/elastic_master_install/templates/elasticsearch.yml.j2

cluster.name: {{cluster_name}}
node.name: {{inventory_hostname}}
node.master: {{node_master_true}}
node.data: {{node_data_true}}
node.ingest: {{node_ingest_true}}
path.data: {{path_to_data}}
path.logs: {{path_to_log}}
network.host: {{ansible_host}}

Task File

This is where we can define all the task that are part of the respective role, in this case task that needed to execute setting up Elasticsearch

# vim roles/elastic_master_install/tasks/main.yml

- name: Creating elk user...
  user:
    name: elk
    comment: "elk User"
    createopt: yes
    opt: /opt/elk/
    uid: 1999
    shell: /bin/bash
  become: true

- name: Copying & untar ElasticSearch5.5..
  unarchive: 
    src: /root/Ansible/ElasticSearch5/roles/elastic_master_install/Files/elasticsearch-5.5.0.tar.gz
    dest: /opt/elk/
    owner: elk
    group: elk
    mode: 0755
  become: true

- name: Creating necessary directories..
  file:
    path: /data/elk/{{ item }}
    state: directory
    owner: elk
    group: elk
    mode: 0775
    recurse: yes
  with_items:
     - [data, logs, run]
  become: true

- name: Copying the main config file...
  template: src=elasticsearch.yml.j2 dest={{elasticsearch_config_dir}}/elasticsearch.yml owner=elk group=elk mode=0644 
  become: true

Please note that I have only added files for Role “elastic_master_install” => Task/Template/Default. However, as in the prod.yaml there is another role called “elastic_data_install” which you also need to work on as did in above last three steps.

When you have the Directory Structure ready, you can initiate the Ansible by;

# ansible-playbook -i inventory prod.yaml

“I hope this has been informative for you”

The post Install ElasticSearch via Ansible appeared first on Linux Windows and android Tutorials.

Wagtail is built with Python

We have talked about many CMS on this website. Some with very new features and others simpler and focused on a very specific audience. But Wagtail is something different.

Wagtail is an open source CMS that is built with Django and therefore in Python. This has many advantages in the execution of the application. Above all in issues of performance and clarity of code.

On the other hand, many well-known companies use Wagtail to build some websites, like Mozilla or BMW. So, we are in the presence of a quite powerful CMS.

Some of its main features focus on fast content editing using blocks; likewise, Wagtail has a form builder and integrates elasticsearch to do intelligent searches.

Finally, Wagtail wants the user not to waste too much time on configurations. He only spends time perfecting the website. That is to say, it is a CMS out the box. Everything is working for the first time.

So, let us install Wagtail.

First steps to install Wagtail

First, we need to update the system so that all the security patches are properly installed.

Open a terminal or connect to your SSH server and run the following:

:~$ sudo apt update
:~$ sudo apt upgrade

Then you need to install Python, Python PIP and the tool to create virtual environments with Python. So you have to run this command to do it.

:~$ sudo apt install python3 python3-pip python3-venv

Create a virtual environment for Wagtail

The next step is to create a virtual Python environment for Wagtail. This way we will be able to isolate the installation and create more security. Besides that, it will facilitate the installation together with PIP. First, install it.

:~$ sudo pip3 install virtualenv

Then, create a new user. And add it to the sudoers file.

:~$ sudo useradd -m -s /bin/bash wag
:~$ sudo passwd wag
passwd: password updated successfully
:~$ sudo nano /etc/sudoers
wag ALL=(ALL:ALL) ALL

Next, create a virtual environment.

:~$ su - wag
:~$ virtualenv wagtail

You can replace “wagtail” for any name what you want.

Install Wagtail

Now that we have the virtual environment created, we will be able to install Wagtail. However, first, we must activate it.

:~$ source ~/wagtail/bin/activate

Now, you can install Wagtail.

:~$ pip install wagtail

In this case, the command is PIP and not PIP3. This is because, in Python virtual environments, the PIP command does not distinguish from the version used. Therefore, it will always be PIP regardless of the version we have.

Now,  we can create a new project.

:~$ cd ~
:~$ wagtail start [project_name]

Then, after the project directory is created. You need to follow these commands to start the new project.

:~$ cd [project_name]
:~$ python manage.py migrate
:~$ python manage.py createsuperuser
:~$ python manage.py runserver 0.0.0.0:8000

Now, open your web browser and go to http://server-ip:8000. Remember to open the port on the firewall.

And you can go to the admin page on http://server-ip:8000/admin. You can log in with the super user previously created.

Install Gunicorn

Wagtail is an application built in Django. In that aspect, to deploy it is convenient to use a request manager that runs in Python. But ironically, Python is not the best for processing all requests. In this sense, I will use Gunicorn and link it to the project. Then, I’ll install Nginx.

:~$ pip install gunicorn
:~$ cd ~/wagproject
:~$ python manage.py collectstatic
:~$ deactivate
:~$ exit

Now, create a new systemd file to manage gunicorn like a service.

:~$ sudo nano /etc/systemd/system/gunicorn.service

And add the following:

[Unit]
Description=Gunicorn Daemon file
After=network.target

[Service]
User=wag
Group=www-data
WorkingDirectory=/home/wag/wagproject
ExecStart=/home/wag/wagtail/bin/gunicorn --access-logfile - --workers 3 --bind unix:/home/wag/wagproject.sock wagproject.wsgi:application

[Install]
WantedBy=multi-user.target

Remember, change the user name and the project name so that everything works well.

Press CTRL + O to save the changes and CTRL + X to close the file.

Next, reload all systemd daemon to apply the changes.

:~$ sudo systemctl daemon-reload

Then, start gunicorn.

:~$ sudo systemctl start gunicorn

Install Nginx

As I mentioned earlier, Python is not the best at processing requests. Then, with Nginx, we will be able to improve all that request flow. So let’s install it

:~$ sudo apt install nginx

Now let’s create a new Nginx server block file.

:~$ nano /etc/nginx/sites-enabled/your-domain.conf

Add the following:

server {
    listen 80;
    server_name your-domain.com;

    location = /favicon.ico { access_log off; log_not_found off; }
    location /static/ {
        root /home/wag/wagproject;
    }

    location / {
        proxy_set_header Host $http_host;
        proxy_set_header X-Real-IP $remote_addr;
        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
        proxy_set_header X-Forwarded-Proto $scheme;
        proxy_pass http://unix:/home/wag/wagproject.sock;
    }
}

Save the changes and close the file.

Then, assign permissions on the project folder and add the new user to the www-data group.

:~$ sudo usermod -aG www-data wag
:~$ sudo chmod -R 710 /home/wag

Finally, start and enable Nginx.

:~$ sudo systemctl enable nginx
:~$ sudo systemctl start nginx

Now, you can access to Wagtail using your web browser to your domain.

And that is it.

The post How to install Wagtail on Ubuntu 18.04? appeared first on Linux Windows and android Tutorials.