ELK introduction and installation

I. Introduction ELK is the abbreviation of three open source software, which respectively means: elastic search, logstash, kibana 1. Elasticsearch is an open source distributed search engine, which provides three functions of data collection, analysis and storage. Its features include: distributed, zero ...

Posted on Wed, 12 Feb 2020 04:27:27 -0800 by php4hosting

[monitoring system] ELK log collection and analysis platform

ELK centralized log collection and analysis platform Official station: https://www.elastic.co/products ELK consists of elastic search, Logstash and Kiabana Elasticsearch is an open source distributed search engine. Its characteristics are: distributed, zero configuration, dynamic discovery, index dyn ...

Posted on Wed, 12 Feb 2020 03:10:37 -0800 by bubazoo

Using Logstash to synchronize Mysql and ElasticSearch data

Preface This article is used to record an operation of synchronizing Mysql data to ElasticSearch in case of forgetting The concept of incremental synchronization Logstash has its own timing task. By default, it moves data from Mysql to ElasticSearch every minute. However, the amount of data in MySQL ...

Posted on Sun, 26 Jan 2020 00:31:09 -0800 by ekalath

[Elasticsearch source] CCR source analysis

Next: [Elasticsearch source] CCR source analysis (1). The sendShardChangesRequest method finally enters shardchangesaction.transportaction ා shardoperation. According to the read request above, obtain all operations within the SEQ ﹣ no range of the Shard from the tralog, and return the latest operat ...

Posted on Tue, 21 Jan 2020 04:05:16 -0800 by superjoe30

Elasticsearch Outbox Guide

Content Summary Essential introduction to ES, with emphasis on the core concepts. Basic API practice operations. 1. Basic Introduction Elasticsearch (ES) is a database that provides distributed, quasi real-time search and analysis. Based on Apache Lucene, you can manipulate structured, unstru ...

Posted on Sat, 18 Jan 2020 18:50:15 -0800 by ierpe

ES2.3 cloud real record based on snapshot migration

Background: 1. According to the company's cloud plan, N sets of ES2.3 clusters in the current production environment need to be moved to the Alibaba cloud ES environment. However, due to the limited disk space in the production environment, the "source" is not enabled, so data migration cannot be performed through reindex. Here, you ...

Posted on Thu, 16 Jan 2020 09:04:05 -0800 by plouka

springboot+logback+logstash log collection

Intended for Operation and maintenance personnel Skilled in docker operation and people with basic knowledge of elk Because this article involves a lot of knowledge, and does not describe it, so Xiaobai carefully looks The operation steps are as follows Deploy logstash Introduce net.logstash.logback: logstash logback encoder package into sp ...

Posted on Fri, 10 Jan 2020 11:01:26 -0800 by Xproterg^vi

ElasticSearch version conflicts with Jar package

I built es2.4 locally before, and then used spring data es to create elastic search template for crud operation. These are all right. However, all the problems broke out after I connected to the company's es. Question 1: Spring data es does not support version 5. *, so errors will be reported naturally. Question 2: even if y ...

Posted on Sun, 05 Jan 2020 01:17:38 -0800 by vinod79

centos7 virtual machine installation elastic search 5.0. X - Installation

Please pre install jdk Create a new user (non root) elasticsearch can only be started with non root. Here I create a user named seven [root@localhost ~]# useradd seven [root@localhost ~]# passwd seven 1 2 Download elastic search [root@localhost ~]# su seven [seven@localhost root]$ cd /home/seven [seven@localhost ~]$ mkdir downloa ...

Posted on Fri, 03 Jan 2020 10:26:24 -0800 by leequalls

How to install blue whale's GSE agent when ssh is not the default 22 port?

How to install blue whale's GSE agent when ssh is not the default 22 port? How to install blue whale's GSE agent? q. Prerequisite knowledge: This article is based on "how to install blue whale's fta when ssh is not the default 22 port? "https://blog.csdn.net/haoding205/article/details/82781482 1. introduction: In ...

Posted on Sun, 29 Dec 2019 12:36:11 -0800 by autumn