Hadoop , Docker , AWS Cloud, Ansible and LVM Automation using Python Program
What the World needs ?
The Answer to it is Automation
Here’s my Article on Automation using python . I created a Menu program which can automate Hadoop , Docker, Ansible, LVM , some services of AWS Cloud , Prediction automation using previous Data Set etc. Anyone can use this Menu Program without knowing the actual Linux command to set-up Hadoop cluster or Docker container or automating AWS cloud .
If you are a newbie and have no idea of those dark highlighted words above ,then lets give them some meaning first…
Hadoop
I have already created a blog on the same ,you can find the link below:
https://docs.google.com/document/d/1D1nuY0TwA-MgKsvl1DEw0AU15VKnhq-21n8ygb2lOzQ/edit?usp=sharing
Amazon Web Services in short AWS
I have already created a blog on the same ,you can find the link below:
Docker
Docker is a set of platform as a service products that use OS-level virtualization to deliver software in packages called containers. Containers are isolated from one another and bundle their own software, libraries and configuration files; they can communicate with each other through well-defined channels.
Ansible
Ansible is a software tool that provides simple but powerful automation for cross-platform computer support. It is primarily intended for IT professionals, who use it for application deployment, updates on workstations and servers, cloud provisioning, configuration management, intra-service orchestration, and nearly anything a systems administrator does on a weekly or daily basis. Ansible doesn’t depend on agent software and has no additional security infrastructure, so it’s easy to deploy.
So now that you are familiar with the topics in use ,Lets continue with showcase of our Menu Program…
My Main Menu Consists of following:
LVM, Webserver, AWS, Docker, Partitions, Hadoop, Anisible and SSHPass
Further Submenu are as follows :-
LVM:
In the LVM Submenu we have following Option:
- List Storage
- Format Drive
- Mount Drive
- Create Physical Volume
- Create Volume Group
- Create Logical Volume
- Extend Logical Volume Size
- Reduce Logical Volume Size
- List Physical Volume
- List Volume Groups
- List Logical Volume
Its Working
WebServer:
In the WebServer Submenu we have following Option:
- Installing Httpd Service
- Starting Service
- Stopping Service
- Status of Service
AWS Menu:
In the AWS submenu we have following Option:
- Login to AWS account
- Start your Instance
- Stop your Instance
- Launch Instance
- Create a New Instance
- Create a New Key
- Create a Security Group
- Creates an EBS Volume
- Attach Volume to Instance
- Create a S3 Bucket
- Upload an image file/file to Bucket
- Make your Bucket Public
- Create a Cloud Front Distribution
- Describe All Instances
Docker Menu:
In the Docker Submenu we have following Option:
- Install Docker
- Check the status of Docker
- Pull an Image
- Install and boot Up the Container
- Start and stop docker Container
- Log in to a Container
- See the Images Downloaded
- See all Container ID
- Remove a Container
- Remove a Container Forcefully
- Remove an Image
- Remove an Image forcefully
- Make the Docker service permanent
- Removes all the Containers
- View Logs of a Container
Partition Menu:
In the Partition Submenu we have following Option:
- Create Partition to disk.
- Format drive.
- Mount Drive.
- Unmount Drive.
- And many more..
Hadoop:
In the Hadoop Submenu we have following Option:
- Configure a Master Node
- Configure a Data Node
- Add a Data Node
- Setup a Client Node
- Check the Hadoop Report
- See the files in cluster
- Upload the files in Cluster
- Remove the files from the Cluster
- Read the files from the Cluster
- Upload the file with blocksize
Ansible Menu:
In the Ansible Submenu we have following Option:
- Install Ansible
- Make an Inventory
- Check the Connected Hosts
- Installing HTTPD on all Hosts
- Starting HTTPD Service on all Hosts
- Stopping HTTPD Service on all Hosts
The goal of this project is to automate different different technologies by using python-script and make it more user-friendly. Python scripts are more user-friendly , so user can easily interact with the technology.
In this automation we have integrated python with different technologies like Hadoop , AWS , Docker ,Ansible ,etc. and we can integrate many more technologies….
View Our Full Project on Github:
