DevOps_project.pdf
•
0 likes•30 views
The document outlines the steps to install various DevOps tools like AWS IAM, AWS CLI, EKSCTL, KUBECTL, Helm, Jenkins, Loki, Prometheus and Grafana on an EKS cluster. It includes creating an IAM user, configuring AWS CLI, installing EKSCTL to create an EKS cluster, installing KUBECTL to connect to the cluster, installing Helm for package management, deploying Jenkins using Helm charts, installing Loki and Grafana for log management and visualisation, and installing Prometheus for metrics collection and Grafana for visualisation.
Report
Share
More Related Content
Similar to DevOps_project.pdf
Similar to DevOps_project.pdf (20)
Recently uploaded
Recently uploaded (20)
DevOps_project.pdf
- 1. DevOps_Project -Prateek Srivastava AWS_IAM user creation Step 1: Login to AWS 1
- 2. DevOps_Project -Prateek Srivastava AWS_IAM user creation Step 1: Login to AWS 2
- 3. DevOps_Project -Prateek Srivastava AWS_IAM user creation Step 2: Go to IAM service 3
- 4. DevOps_Project -Prateek Srivastava AWS_IAM user creation Step 2: Login to AWS 4
- 5. DevOps_Project -Prateek Srivastava AWS_IAM user creation Step 3: Go to create user 5
- 6. DevOps_Project -Prateek Srivastava AWS_IAM user creation Step 4: Provide user name (here, i have mentioned as Prateek_demo_Project) and Click on Next Option 6
- 7. DevOps_Project -Prateek Srivastava AWS_IAM user creation Step 5: Set permissions (We can use anyone option from Add_user_to_group, Copy_permissions, Attach_policies_directly) In this case, we have choosen Copy_permissions and select AdministratorAccess permissions policy → Click on Next Option 7
- 8. DevOps_Project -Prateek Srivastava AWS_IAM user creation Step 6: Review details and click on Create_User option 8
- 9. DevOps_Project -Prateek Srivastava AWS_IAM user creation Step 6: User is Created 9
- 10. DevOps_Project -Prateek Srivastava AWS_IAM user creation Step 7: Click on - Create Access Key 1 10
- 11. DevOps_Project -Prateek Srivastava AWS_IAM user creation Step 8: Check on CLI → select Confirmation checkbox → Click Next option 11
- 12. DevOps_Project -Prateek Srivastava AWS_IAM user creation Step 9: Provide Description tag and click on Create_Access_key 12
- 13. DevOps_Project -Prateek Srivastava AWS_IAM user creation Step 10: Access key is created. Download the csv file 13
- 14. DevOps_Project -Prateek Srivastava CLI installation Step 11: Download AWS CLI software from using the below document https://docs.aws.amazon.com/cli/latest/userguide/getting-started-install.html 14
- 15. DevOps_Project -Prateek Srivastava CLI installation Step 12: I will download for Linux, Post downloading and installation of aws-cli as per the document, confirm the the installation as below (by aws --version command) Login to aws-cli using aws configure command, Providing the below details:- 1. AWS Access Key ID 2. AWS Secret Access Key 3. Default region name 4. Default output format 15
- 16. DevOps_Project -Prateek Srivastava eksctl installation Step 13: Download eksctk software from the below link as per your OS https://github.com/eksctl-io/eksctl/releases/tag/v0.161.0 Alternatively, If the above link doesn’t work, Follow below steps (https://sarvar04.medium.com/configure-eksctl-kubectl-aws-cli-on-amazon-linux-2-6efc3e166dbc) :- a. Go to below command to get the file sudo curl --silent --location "https://github.com/weaveworks/eksctl/releases/latest/download/eksctl_$(uname -s)_amd64.tar.gz" | tar xz -C /tmp b. Move the file to bin folder sudo mv /tmp/eksctl /usr/local/bin/eksctl c. verify by eksctl version command 16
- 17. DevOps_Project -Prateek Srivastava kubectl installation Step 14: Install kubectl to connect to kubernetes https://kubernetes.io/docs/tasks/tools/install-kubectl-linux/ Follow below steps:- a. Get kubectl curl -LO "https://dl.k8s.io/release/$(curl -L -s https://dl.k8s.io/release/stable.txt)/bin/linux/amd64/kubectl" b. Verify checksum curl -LO "https://dl.k8s.io/release/$(curl -L -s https://dl.k8s.io/release/stable.txt)/bin/linux/amd64/kubectl.sha256" c. Check cheksum echo "$(cat kubectl.sha256) kubectl" | sha256sum --check kubectl: OK (if valid) kubectl: FAILED (if checksum fails) sha256sum: WARNING: 1 computed checksum did NOT match 17
- 18. DevOps_Project -Prateek Srivastava kubectl installation Step 15: Install kubectl to connect to kubernetes https://kubernetes.io/docs/tasks/tools/install-kubectl-linux/ d. Install kubectl sudo install -o root -g root -m 0755 kubectl /usr/local/bin/kubectl e. Test to ensure the version you installed is up-to-date: kubectl version --client Or kubectl version --client --output=yaml 18
- 19. DevOps_Project -Prateek Srivastava cluster creation Step 16: Create cluster using eksctl create cluster --name <namespace_name> --region <region_name> E.g. eksctl create cluster --name prateeksri --region ap-south-1 It will take around 20 minutes to complete Screenshot of ongoing process- Cluster is created now. 19
- 20. DevOps_Project -Prateek Srivastava cluster creation Step 17: Verification of cluster created 20
- 21. DevOps_Project -Prateek Srivastava Tools for jenkins installation Step 18: Tools for helm kubectl create -f https://raw.githubusercontent.com/operator-framework/operator-lifecycle-manager/master/deploy/upstream/quickstart/crds.yaml kubectl create -f https://raw.githubusercontent.com/operator-framework/operator-lifecycle-manager/master/deploy/upstream/quickstart/olm.yaml 21
- 22. DevOps_Project -Prateek Srivastava Step 18: Tools for helm kubectl create -f https://raw.githubusercontent.com/operator-framework/operator-lifecycle-manager/master/deploy/upstream/quickstart/crds.yaml kubectl create -f https://raw.githubusercontent.com/operator-framework/operator-lifecycle-manager/master/deploy/upstream/quickstart/olm.yaml Or create yaml file and kubectl create -f <file name> Tools for jenkins installation 22
- 23. DevOps_Project -Prateek Srivastava Step 18: Tools for helm kubectl get catalogsources -n olm kubectl get packagemanifests -l catalog=operatorhubio-catalog -n olm Tools for jenkins installation 23
- 24. DevOps_Project -Prateek Srivastava helm installation Step 19: Install helm using https://github.com/helm/helm/releases To install helm go to below link and follow the steps:- https://devopscube.com/install-configure-helm-kubernetes/ a. Download the latest Helm installation script. curl -fsSL -o get_helm.sh https://raw.githubusercontent.com/helm/helm/master/scripts/get-helm-3 b. Add execute permissions to the downloaded script. chmod +x get_helm.sh c. Execute the installation script. This script will automatically find the right binary for your system. ./get_helm.sh d. Validate helm installation by executing the helm command and check version by helm version 24
- 25. DevOps_Project -Prateek Srivastava jenkins installation Step 20: Create namespace:- kubectl create namespace prateekjenkins 25
- 26. DevOps_Project -Prateek Srivastava jenkins installation Step 21: Add jenkins repo using helm repo add jenkins https://raw.githubusercontent.com/jenkinsci/kubernetesoperator/master/chart 26
- 27. DevOps_Project -Prateek Srivastava jenkins installation Step 22: Install jenkins repo using helm install my-jenkins-operator jenkins/jenkins-operator -n prateekjenkins --set jenkins.enabled=false 27
- 28. DevOps_Project -Prateek Srivastava jenkins installation Step 23: Create config file as vim jenkins_instance.yaml 28
- 29. DevOps_Project -Prateek Srivastava jenkins installation Step 23: Create config file as vim jenkins_instance.yaml apiVersion: jenkins.io/v1alpha2 kind: Jenkins metadata: name: example namespace: prateekjenkins spec: configurationAsCode: configurations: [] secret: name: "" groovyScripts: configurations: [] secret: name: "" jenkinsAPISettings: authorizationStrategy: createUser master: disableCSRFProtection: false containers: - name: jenkins-master image: jenkins/jenkins:lts imagePullPolicy: Always livenessProbe: failureThreshold: 12 httpGet: path: /login port: http scheme: HTTP initialDelaySeconds: 100 periodSeconds: 10 successThreshold: 1 timeoutSeconds: 5 readinessProbe: failureThreshold: 10 httpGet: path: /login port: http scheme: HTTP initialDelaySeconds: 80 periodSeconds: 10 successThreshold: 1 timeoutSeconds: 1 resources: limits: cpu: 1500m memory: 3Gi requests: cpu: "1" memory: 500Mi seedJobs: - id: jenkins-operator targets: "cicd/jobs/*.jenkins" description: "LW Jenkins Operator repository" repositoryBranch: master repositoryUrl: https://github.com/jenkinsci/kubernetes-operator.git 29
- 30. DevOps_Project -Prateek Srivastava jenkins installation Step 24: Add config file as :- kubectl create -f jenkins_instance.yaml Step 25: Check if pod is up and running:- kubectl get pods -n prateekjenkins -w 30
- 31. DevOps_Project -Prateek Srivastava Run jenkins Step 26: Fetch credentials:- User_name- kubectl --namespace prateekjenkins get secret jenkins-operator-credentials-example -o 'jsonpath= {.data.user}' | base64 -d Password- kubectl --namespace prateekjenkins get secret jenkins-operator-credentials-example -o 'jsonpath= {.data.password}' | base64 -d 31
- 32. DevOps_Project -Prateek Srivastava Step 27: Forward the jenkins port to 8080 :- kubectl --namespace prateekjenkins port-forward jenkins-example 8080:8080 Run jenkins 32
- 33. DevOps_Project -Prateek Srivastava Step 28: Run jenkins in local as localhost:8080 Run jenkins 33
- 34. DevOps_Project -Prateek Srivastava Step 29: Add credentials and sign-in Run jenkins 34
- 35. DevOps_Project -Prateek Srivastava Step 30: jenkins is running at local Run jenkins 35
- 36. DevOps_Project -Prateek Srivastava loki installation Step 31: Add loki repo as:- helm repo add grafana https://grafana.github.io/helm-charts 36
- 37. DevOps_Project -Prateek Srivastava Step 32: Update repo and Install loki as:- helm repo update helm upgrade --install loki grafana/loki-stack --set grafana.enabled=true,prometheus.enabled=true,prometheus.alertmanager.persistentVolume.enabled=false,prom etheus.server.persistentVolume.enabled=false loki installation 37
- 38. DevOps_Project -Prateek Srivastava Step 33: Patch loki as:- kubectl patch svc loki-grafana -p '{"spec": {"type": "LoadBalancer"}}' Fetch url as:- kubectl get svc loki-grafana -o jsonpath='{.status.loadBalancer.ingress[0].hostname}' loki installation 38
- 39. DevOps_Project -Prateek Srivastava Step 34: Fetch username and password with the link provided:- kubectl get secret loki-grafana -o go-template='{{range $k,$v := .data}}{{printf "%s: " $k}}{{if not $v}}{{$v}}{{else}}{{$v | base64decode}}{{end}}{{"n"}}{{end}}' loki installation 39
- 40. DevOps_Project -Prateek Srivastava run loki/grafana Step 35: Run the url and you will have the below screen of grafana 40
- 41. DevOps_Project -Prateek Srivastava Step 34: Add credentials run loki/grafana 41
- 42. DevOps_Project -Prateek Srivastava Step 35: Grafana is running run loki/grafana 42
- 43. DevOps_Project -Prateek Srivastava Step 36: Load dashboard which fetches data from loki from below url and paste here:- https://grafana.com/grafana/dashboards/15141-kubernetes-service-logs/ run loki/grafana 43
- 44. DevOps_Project -Prateek Srivastava Step 37: Select data-source as Loki and click on Import option run loki/grafana 44
- 45. DevOps_Project -Prateek Srivastava Step 38: Dashboard looks like as below:- run loki/grafana 45
- 46. DevOps_Project -Prateek Srivastava prom installation Step 39: Add repo of prom and stable from below link as :- https://www.geeksforgeeks.org/working-with-prometheus-and-grafana-using-helm/ helm repo add prometheus-community https://prometheus-community.github.io/helm-charts helm repo add stable https://charts.helm.sh/stable 46
- 47. DevOps_Project -Prateek Srivastava Step 40: Install Prometheus Kubernetes helm install prometheus prometheus-community/kube-prometheus-stack prom installation 47
- 48. DevOps_Project -Prateek Srivastava Step 41: Run forward port prom/grafana to 3000 as:- kubectl port-forward deployment/prometheus-grafana 3000 Run prom/grafana 48
- 49. DevOps_Project -Prateek Srivastava Step 42: Run it in local as localhost:3000 and credentials and sign-in Run prom/grafana 49
- 50. DevOps_Project -Prateek Srivastava Step 43: It will be shown as below:- Run prom/grafana 50
- 51. DevOps_Project -Prateek Srivastava Step 44: Load dashboard which fetches data from prom from below url and paste here:- https://grafana.com/grafana/dashboards/315-kubernetes-cluster-monitoring-via-prometheus/ Run prom/grafana 51
- 52. DevOps_Project -Prateek Srivastava Step 45: Select data-source as Prometheus and click on Import option Run prom/grafana 52
- 53. DevOps_Project -Prateek Srivastava Step 46: Dashboard looks like as below:- Run prom/grafana 53
- 55. DevOps_Project -Prateek Srivastava kubectl get nodes -n prateekjenkin -w kubectl get pod -n prateekjenkins -w Extra 55