Analysis of spark checkpoint principle and source code

I. overview What is Checkpoint? Spark often faces a lot of RDDS of Tranformation in the production environment (for example, a Job contains 10000 RDDS), or the calculation of RDDS generated by specific Tranformation is particularly complex and time-consuming (for example, the calculation often exce ...

Posted on Sat, 15 Feb 2020 21:22:45 -0800 by jf3000

Grabbing the final sql with the mybatis plug-in

Summary of pain points When we are de bug ging and need to see the complete sql, we can get the sql as shown in the figure in the console Then manually replace the question mark placeholders one by one and go to MySQL to see if there is any problem with sql. If the sql is simple, it's easier to say. If it's a complex sql, manually replace N qu ...

Posted on Sat, 15 Feb 2020 08:17:40 -0800 by nilansanjaya

Remove accents / diacritics from strings in JavaScript

How do I remove accents from a string? Especially in IE6, I have the following similar contents: accentsTidy = function(s){ var r=s.toLowerCase(); r = r.replace(new RegExp(/\s/g),""); r = r.replace(new RegExp(/[àáâãäå]/g),"a"); r = r.replace(new RegExp(/æ/g),"ae"); r = r.replace(new RegExp(/ç/g),"c"); r = r.replace(ne ...

Posted on Fri, 14 Feb 2020 08:01:03 -0800 by mayfair

Get the background user name and password of the website by detecting sql injection vulnerability through sqlnamp

lnmp environment needs to be built in advance Install sqlmapproject sqlmap [root@ localhost ~]# tar -xvzf sqlmapproject-sqlmap-1.0.9-87-g7eab1bc.tar.gz [root@ localhost ~]# cd sqlmapproject-sqlmap-7eab1bc/ [root@ localhost sqlmapproject-sqlmap-7eab1bc]# python sqlmap.py Unzip DVWA master to the r ...

Posted on Fri, 14 Feb 2020 06:39:42 -0800 by Valdoua

Trust all certificates using HttpClient over HTTPS

Recently in Https Questions about HttpClient published on Find it here ).I have made some progress, but I have encountered new problems.Like my last question, I don't seem to find any examples that work for me.Basically, I want my client to accept any certificate (because I only point to one server) ...

Posted on Wed, 12 Feb 2020 19:10:51 -0800 by demouser

Request Zuul gateway error

I started the eureka, config, zuul, a microservice, and used postman to test whether the gateway worked. com.netflix.zuul.exception.ZuulException: at org.springframework.cloud.netflix.zuul.filters.post.SendErrorFilter.findZuulException(SendErrorFilter.java:118) ~[spring-cloud-netflix-zuul-2.2.1.RE ...

Posted on Wed, 12 Feb 2020 07:59:26 -0800 by dsartain

Python full stack Web security attack and Defense 2. Information collection and sqlmap introduction

Article directory 1, Real IP address collection 1.CDN introduction 2. Judge whether there is CDN (i.e. whether it is a real IP) 3. bypass CDN 2, shodan introduction and search 1. Information collection method 2. Introduction to Shodan search engine 3.shodan registration, login and search 3, Intro ...

Posted on Wed, 12 Feb 2020 07:54:56 -0800 by faheemhameed

apache configuration file httpd.conf security related configuration

1, Configure virtual host httpd.conf two required options (centos 6.9) LoadModule vhost_alias_module modules/mod_vhost_alias.so #Open module, default is on NameVirtualHost *:80 #Open NameVirtualHost, default is off 1. Based on ip address Configure a new ip address for eth0 [root@redwand conf]# ...

Posted on Tue, 11 Feb 2020 04:25:07 -0800 by vamosbenedikt

OpenSSL and implementation of private CA to realize certificate application issuing

2 OpenSSL OpenSSL is an open source software library package, which can be used by applications to communicate securely, avoid eavesdropping, and confirm the identity of the other end of the connection. This package is widely used in web servers on the Internet The main library is written in C language ...

Posted on Mon, 10 Feb 2020 04:33:27 -0800 by Thoughtless

Encapsulate POI excel export and realize export by configuring xml template

In business system development, business data is usually exported to excel. If only one or two business functions are exported, we can directly write code to realize it. However, if there are many different business data to be exported, if we build workbook s, sheet s, row s and cell s through code, i ...

Posted on Mon, 10 Feb 2020 00:12:56 -0800 by ngu_tri