Python Crawler Introduction Tutorial [15]: Fried Egg Web XXOO Picture Grabbing

Today, I wrote an egg-frying website http://jandan.net/ooxx, which is a favorite website of crawler enthusiasts. In fact, this website is a little interesting. Many people have written more than N tutorials on the website. There are all kinds of ways. Of course, the website itself is constantly improvin ...

Posted on Mon, 14 Oct 2019 08:46:26 -0700 by metallord

Validation of selenium + chrome driver common slider

target Using selenium to realize automatic login Tidy up your ideasGet the ID of the password input box of the account - > fill in the account - > fill in the password - > appear a slider - > slide over the slider - > Click login process The process of getting the input box id ...

Posted on Thu, 10 Oct 2019 03:22:13 -0700 by skylark2

Python: Selenium Chrome Bulletless Window + property/attribute/text

When we use Selenium to write automation programs, we don't want the program to play Chrome window all the time during the actual operation. At this time, we need to let Chrome open silently, read data automatically, and then close silently. The following is a method for chrome to open in a non-interfac ...

Posted on Fri, 04 Oct 2019 11:21:31 -0700 by spaggle

Python Selenium Automatically Configure zabbix Mailbox Alarm Function

Introduction: In the last blog, I wrote about zabbix configuration mailbox alarm function, but because the configuration process is very cumbersome, here I wrote a script for automatic configuration (python selenium module). Running scripts directly improves efficiency! The experimental environment: 1.python3.72.selenium module3.PyCharm Dev ...

Posted on Thu, 03 Oct 2019 23:22:16 -0700 by ukalpa

Selenium + Headless Chrome crawls Bing image search results

Bing image search results are loaded dynamically. If we use requests directly to access the page to crawl data, we can only get very few images. So we use Selenium + Headless Chrome to crawl search results. Before we start, we need to introduce xpath. XPath XPath is XML Path Language (XML Path Language) is a language used to locate a part of ...

Posted on Thu, 03 Oct 2019 19:39:41 -0700 by enchance

selenium handles page common problems: cookie login

A common use of selenium is to skip login through cookie s and to verify images / text messages / validation codes, etc., to be in the login state directly. It seems simple, but there are always problems with cookie s. First of all, we tested it with bean flakes. The whole idea is: 1. First use se ...

Posted on Sat, 21 Sep 2019 01:12:51 -0700 by dubrubru

python dynamic video downloader

Here you can share some applications of python crawlers, which are mainly downloaders of videos, music and stories using crawlers with a simple GUI interface.Today, I'll show you how to implement a dynamic video downloader.   Crawl Movie Paradise Video The first introduction is python's video crawling the movie paradise website (including mo ...

Posted on Sun, 15 Sep 2019 10:41:45 -0700 by skurai

java selenium div embedded scrollbar page long screenshot to send mail

java selenium web page embedded scrollbar screenshot to send mail Main problems Let's start with the following Because the company requires an interface, requesting this interface for web page screenshots and sending mail function, originally w ...

Posted on Wed, 11 Sep 2019 01:35:17 -0700 by js_280

selenium2java writes a script to set second-rate

When I use selenium for testing, sometimes I need to go to the background management interface to set some test data, so I wrote some scripts, which is representative because the setup buttons and course details are not on one page, but on the list page.So it's more troublesome to find.Share the code for your reference. Let's start with the bac ...

Posted on Thu, 05 Sep 2019 20:06:51 -0700 by programguru

linux Installation browser and driver

linux Installation browser and driver 1. Firefox Browser and Driver-centos6 64 Firefox Browser - Comes with CentOS 6.10, and the browser version is 52 Download the corresponding Firefox driver, version 52 - version 0.17- View Address Add to ...

Posted on Wed, 04 Sep 2019 19:48:27 -0700 by xSN1PERxEL1TEx