Spring cloud: spring cloud bus message bus (refresh configuration service)

Bus message bus: OK, now let's continue with the last essay. As we mentioned in the previous article, if we want to update the configuration of all microservices, we can only rely on spring cloud config to update the configuration without restarting. However, we need to send post requests from one service to another, Can we take it? This is m ...

Posted on Wed, 13 Nov 2019 01:51:41 -0800 by harvillo

Use of flume value kafkachannel

1. Install flume 2. Install kafka 3. Test whether kafka topic can deliver messages normally 4. After they are all ready, they start to connect kafkachannel. There is a question. I used to make kafka pure channel before. There are sources and sink, but the experiment is not successful. It is doubted that kafka can't just do c ...

Posted on Sun, 10 Nov 2019 12:06:19 -0800 by smook

My big data Tour - Kafka environment construction

  Environmental preparation: Three CentOS virtual machines with JDK and Zookeeper installed   Environment building   1) download the compressed package https://www.apache.org/dyn/closer.cgi?path=/kafka/2.2.0/kafka_2.12-2.2.0.tgz 2) decompression: [feng@hadoop129 software]$ ls kafka_2.11-2.2.0.tgz [feng@hadoop129 software ...

Posted on Tue, 05 Nov 2019 10:31:51 -0800 by Xorandnotor

I. Flume -- basic principle and use of data collector

I. overview 1. What is flume 1) Flume provides a distributed and reliable service for efficient collection, aggregation and movement of logs with large amount of data. Flume can only run in Linux environment.2) Flume is based on flow architecture, with strong fault tolerance, flexibility and simplicity.3) Flume and Kafka are used for real-time ...

Posted on Tue, 05 Nov 2019 10:15:32 -0800 by menriquez

Spring boot + Kafka + elk + docker + docker compose + CentOS to build a log collection system

On the Internet, I used the log collection system built by many netizens for reference, and then built it. In the process of building, I encountered many problems. Finally, after various attempts to build it successfully, I shared the building process with you. This build is based on docker and docker compose. 1. vmware creates two virtual mac ...

Posted on Sun, 03 Nov 2019 02:25:51 -0800 by barkster

Knowledge: message push based on Alibaba cloud Kafka

The support for Kafka event source has been provided in knight. So how to implement message push based on Kafka on Alibaba cloud? This article will unlock this new gesture for you. background Message queuing for Apache Kafka is a distributed, high throughput and scalable Message Queuing service provided by alicloud. Message queuing for Apach ...

Posted on Mon, 21 Oct 2019 01:53:02 -0700 by steve012345

RocketMQ Master-Slave Synchronization Source Code Analysis

Wechat Public Number "Back-end Advancement" focuses on back-end technology sharing: Java, Golang, WEB framework, distributed middleware, service governance and so on. A previous article on the difference between RocketMQ queues and Kafka partitioned replicas mentioned that RocketMQ message redundancy is mainly achieved through master- ...

Posted on Mon, 14 Oct 2019 05:11:02 -0700 by brewmiser

Tens of thousands of server equipment monitoring system--optimization of falcon secondary development module

The company's monitoring system mainly uses millet open source falcon, tens of thousands of physical machines, virtual machines, and containers, which pose a great challenge to the storage and performance of the monitoring system. Opentsdb is selected in the bottom storage layer. At the same time, a tsdb-proxy module is developed to write data ...

Posted on Sun, 13 Oct 2019 13:22:04 -0700 by brainstem

Mainstream Process Analysis of Spark sql Streaming Processing

Spark sql supports streaming processing, which includes Source and Sink. Source defines the source of the stream, Sink defines the destination of the stream, and the execution of the stream is triggered from Sink. The writeStream of Dataset defines the destination of the stream and triggers the real execution of the stream, so the analysis beg ...

Posted on Sun, 13 Oct 2019 00:55:35 -0700 by BlueKai

Can Kafka asynchronous messages also block? Record a Dubbo Frequent Overtime Investigation Process

On-line service A calls service B interface to complete a transaction. After a production change in the evening, system monitoring finds that service B interface frequently timeouts, and then even returns Thread pool is EXHAUSTED, which is a thread pool depletion error. Because service B relies on external interfaces, it was initially mistaken ...

Posted on Tue, 08 Oct 2019 16:08:59 -0700 by jestercobblepot