52 results about "Headless browser" patented technology

In an embodiment, a method comprises intercepting, from a server computer, a first set of instructions that define a user interface; executing, using a headless browser, the first set of instructions without presenting the user interface; rendering a second set of instructions, which when executed by a client application on a client computer, cause the client computer to present the user interface, wherein the second set of instructions are different than the first set of instructions; sending the second set of instructions to the client computer.

Computer systems and methods in various embodiments are configured for improving the security and efficiency of server computers interacting through an intermediary computer with client computers that may be executing malicious and / or autonomous headless browsers or “bots”. In an embodiment, a computer system comprises a memory; one or more processors coupled to the memory; a processor logic coupled to the memory and the one or more processors, and configured to: intercept, from a server computer, one or more original instructions to be sent to a browser of a client computer; send the one or more original instructions to the browser and one or more telemetry instructions, wherein the telemetry instructions are configured, when executed, to generate a set of telemetry data indicating one or more objects that were referenced by the browser and to send the set of telemetry data to the intermediary computer; receive the set of telemetry data and determine whether the browser is legitimate or illegitimate based on the set of telemetry data.

A technique allows a client computing system with a browser to automatically transmit user credentials to a web account on a web site. The transmitted information may be entered into form fields in a standard browser or a headless browser. The client computing system may also determine whether automatic login of user credentials has succeeded in logging the user to the web account by determining, in some embodiment, “logout” buttons, or other information in web pages that may be received from the web site. Other embodiments include determining whether a landing or redirect web page is received in response to transmitting of the user credentials to the web site.

A system for flexible and scalable automated end-to-end chat-based contact center testing, having a test case management platform, a chat cruncher, a contact center manager, a chat classifier, a desktop automation engine, and headless browser-based virtual agents and customers. The test case management platform allows a user to configure operation of the system. The chat cruncher operates a plurality of virtual customers. The contact center manager operates a plurality of virtual agents to participate in chat session with virtual customers.

The invention discloses a webpage screenshot system and method, and the system comprises a client and a server, the client is used for enabling a user to input a webpage URL needing screenshot and other configuration parameters, and sending an HTTP request to a server API interface through a webpage browser, a command line tool or a programming language program; the server is provided with a network information acquisition interface, a picture acquisition interface and a Puppteer headless browser; and the server side receives the parameters sent by the client side, accesses the Internet through the Puppteer headless browser, performs data processing on the returned result in each interface module through a built-in method in the Puppteer headless browser, and finally returns the data to the client side. According to the method, screenshot operation is carried out through the API, interaction with other programs can be effectively carried out, the purpose of automatic batch screenshot is achieved, and the full-screen or fixed-length and fixed-width screenshot effect can be achieved by transmitting parameters.

The invention discloses a hidden hyperlink detection method based on a stack. The method comprises the steps of 1, defining a hidden hyperlink in advance; 2, sending an HTTP request to a to-be-detected Web server, capturing a to-be-detected Web page by use of a multi-thread web crawler technology, and returning page data by the to-be-detected Web page; 3, rendering the page data by use of a non-interface browser, thereby obtaining the rendered Web page, wherein the rendering is specifically finished by performing JS and CSS codes on the page; 4, detecting hyperlinks in the page based on the stack; and 5, obtaining page hidden hyperlink data by directly checking a hidden hyperlink keyword feature library. According to the method, the location of the possible hidden hyperlink is rapidly and accurately detected and located through adoption of a stack data structure and a headless browser page rendering mode; the operation is more simple and clear; and the hidden hyperlink after a hacker intrudes into a network or the hidden hyperlink imbedded by a web application development manufacturer can be detected.

The embodiment of the invention provides a webpage data capturing method and device, a storage medium and equipment. The method comprises the steps that after a target webpage is successfully logged in through a headless browser, if the headless browser monitors an AJAX request of the target webpage, authorization authentication information carried in the monitored AJAX request is stored in a cache through the headless browser; the authorization authentication information is read from the cache through the data capture script, and the read authorization authentication information is added intoan access request for capturing webpage data; and webpage data returned by the server is captured after passing the authentication based on the authorization authentication information through the data capture script and based on the access request containing the authorization authentication information. Therefore, the webpage data can be effectively captured.

The invention discloses a browser-based headless mode testing method, system and device and a medium. The testing method comprises: calling a starting interface of the headless browser is called to start the headless browser; calling a client configuration interface, and configuring parameters of the configuration interface according to the client type; setting test parameters according to a preset test case; and calling a page test interface, the page test interface being used for opening a preset page of the headless browser according to the parameters of the configuration interface, and performing a corresponding test on the preset page according to the test parameters. According to the browser, the display page is started and operated in the headless operation mode, the rendering timeof the display page is shortened, the response time of the whole display page is shorted by 100% or above compared with the response time of a display page of a conventional automatic test, and the test efficiency of the display page test is greatly improved.

The invention relates to the technical field of data acquisition, and provides a search engine optimization method and device, a terminal and a storage medium. The method comprises the following steps: configuring an Nginx agent in a server, and starting a Node service; receiving an access request and sending the access request to a port of the Node service; judging whether the access request comes from a crawler spider or not through the Node service and judging whether an accessed target page needs to be subjected to search engine optimization processing or not through the Node service according to the access request; when it is determined that the access request comes from a crawler spider and it is determined that the accessed target page needs to be subjected to search engine optimization processing, starting a headless browser through the Node service, and accessing the target page through the headless browser; and returning the target page to a search engine through the Node service. According to the method, an SEO operation can be added without any change, zero learning cost and zero code change are realized, and the development efficiency and the development experience aregreatly improved.

The embodiment of the invention discloses a webpage content obtaining method and a device, a storage medium and equipment. The method comprises the following steps: obtaining a first network resourceaddress, and using a preset headless browser to obtain a corresponding webpage source file according to the first network resource address, sending a target network request for a target project in thewebpage source file through the preset headless browser, the target project is generated in a dynamic loading mode, and target content corresponding to the target project is obtained according to thetarget network request. According to the method provided by the embodiment of the invention, the dynamically generated items in the page can be accessed by utilizing the headless browser, so that thewebpage content can be more comprehensively acquired.

The invention discloses a method and device for generating a video, an electronic device and a medium. The method is applied to a Headless browser. According to the invention, display data in generation data is received and extracted in the Headless browser, a to-be-processed video is generated according to visual data and audio data in the display data, and a display video is generated based on the to-be-processed video and a preset video frame. The generation data uploaded by a user terminal can be generated into the display video in the Headless browser by applying the method and device forgenerating a video, the electronic device and the medium of the invention, thereby solving the disadvantage of computational resource and network bandwidth consumption caused by the problem that datainformation can be uploaded only after video data is encoded when a user uploads the data information during the course of teaching.

The invention relates to the field of data processing, discloses a chart generation method, device and equipment and a storage medium, and is used for automatically generating a chart picture according to data input by a user. The chart generation method comprises the steps of obtaining a to-be-generated chart type and a chart file format; generating a corresponding chart data sheet according to the chart type, and pushing the chart data sheet to the user for filling; extracting the filled chart data sheet to obtain chart data; inputting the chart data into a preset headless browser, and performing chart rendering through the headless browser according to the chart type to obtain a chart picture; and performing format conversion on the chart picture according to the chart file format to generate a chart file. According to the chart generation method, the chart file is generated by utilizing the server through the headless browser, the generation speed is high, and the generated chart file can be directly used, and is simple and convenient. In addition, the invention also relates to a blockchain technology, and chart related data information can be stored in the blockchain.

The invention discloses a webpage screenshot method and device, a storage medium and electronic equipment, and is applied to the technical field of computers. The method comprises the following steps:in response to a screenshot request, calling a preset headless browser to access a target webpage, and determining each webpage element required for access; judging whether the loading request corresponding to each webpage element comprises a to-be-matched item or not; adding a matching parameter into the loading request containing the to-be-matched item, and sending the loading request added with the matching parameter to a corresponding server, so that the server returns the webpage element in response to the matching parameter, and completing loading of the webpage element; and after eachwebpage element is loaded, carrying out screenshot on the target webpage. By applying the method, the matching parameter is added to the loading request containing the to-be-matched item, so that whenthe server receives the loading request, the server responds according to the matching parameter and returns the webpage element, and the integrity and correctness of the screenshot picture are ensured after the target webpage is subjected to screenshot.

The invention discloses a security verification code generation method and system based on track drawing interaction and a medium. The method comprises the steps of formulating a security rule; enabling the client to request the server for identity authentication; enabling the server to generate a data token, a verification code question and a picture, and storing the related information into a database; adding the interference to the generated picture, and transmitting the picture to a client; enabling the client to recover and display the disordered verification code picture; recording track information drawn by a user, encrypting track information data and a data token, and transmitting the data and the data token to a server; and enabling the server side to judge the track information and return a result to the client side. According to the invention, the transmitted data is encrypted using an RC4 encryption algorithm; when the headless browser is detected in the JavaScript, the verification is rejected; the machine behavior is judged by using an algorithm for extracting human drawing trajectory feature design, the safety and correctness are improved by the technical means, and the cracking of an OCR picture recognition technology and the behavior of generating a trajectory by machine simulation can be effectively prevented.

Disclosed are systems and methods for using automated browsing to retrieve a protected key based on a single input data entry. For example, a method may include receiving an input at a first user interface, creating a headless browser that configures the a processor to automatically browse web pages without loading any graphical user interface, identifying credential data input fields on a first set of web pages, identifying a corresponding authentication credential for each of the one or more credential data input fields, automatically entering the identified corresponding authentication credentials into the credential data input fields in the first set of web pages, determining a unique identifier, based on the input from the first user interface, entering a web interface based on the unique identifier, retrieving a secured key from the web interface, and outputting the secured key at the first user interface.

The invention provides a crawler system based on HTTP proxy and an implementation method thereof. The system comprises a crawler task creation module, a crawler feature processing module, a crawler task execution module, an information storage module and a browser. The crawler task creating module is used for determining a crawler task according to the crawler task seed information and constructing a corresponding url; the crawler task execution module is used for acquiring and executing crawler tasks and extracting website page information; the crawler feature processing module is used for modifying request header information when the browser sends a request to the website server; and the information storage module is used for storing the extracted website page information. According to the method, important information in the HTTP request header can be modified, the characteristics of the third-party headless browser can be hidden when the third-party headless browser is used, the third-party headless browser is prevented from being detected by a website, the concealment of a browser crawler is further improved, browser operation can be simplified, and the method is suitable for crawling data on a large scale.

The invention provides a method and device for achieving WEB application automatic testing. The method comprises the steps that editing operation of a user on a test case file of a WEB application is received; in response to the editing operation, calling an instruction adding function of playwright, and adding a screenshot instruction and / or an assertion instruction at a target test operation position in a test case file to obtain an edited test case file; the edited test case file is executed by calling a headless browser function of the playwright, an execution result is generated, and when the edited test case file is executed, a screenshot instruction and / or an assertion instruction are / is executed at a target test operation position; and generating a test report according to the execution result. According to the method, the browser can be not called when the test case is executed by calling the Playwright function, the test case can be executed on the server, and one-key assertion increase and screenshot comparison are supported.

The invention provides a webpage automatic regression test method and system, a medium and electronic equipment. The method comprises the following steps: recording a test case operation step througha headless browser plug-in, and generating a test case code; adding the test case code to a test system; adjusting the execution sequence of the test case codes in a test system; executing the test case codes through playback of the headless browser, and recording the state and prompt of each test case; and counting success rate headless browser plug-ins of all test cases in the project. Accordingto the method, the compiling efficiency and the testing accuracy of the test case can be improved, so that the product quality and the development efficiency of the webpage are improved on the whole.

Disclosed is phishing classifier that classifies a URL and content page accessed via the URL as phishing or not is disclosed, with URL feature hasher that parses and hashes the URL to produce feature hashes, and headless browser to access and internally render a content page at the URL, extract HTML tokens, and capture an image of the rendering. Also disclosed are an HTML encoder, trained on HTML tokens extracted from pages at URLs, encoded, then decoded to reproduce images captured from rendering, that produces an HTML encoding of the tokens extracted, and an image embedder, pretrained on images, that produces an image embedding of the image captured. Further, phishing classifier layers, trained on the feature hashes, the HTML encoding, and the image embedding, process the URL feature hashes, HTML encoding and image embeddings to produce a likelihood score that the URL and the page accessed presents a phishing risk.

A method includes receiving an input media stream at a hardware encoder. The method also includes executing, at a processor of the hardware encoder, a headless browser to retrieve an instance of a dynamic web page that includes additional content. The method also includes storing the additional content at a memory that is accessible to the processor and encoding circuitry of the hardware encoder. The method further includes retrieving, at the encoding circuitry, the additional content from the memory and encoding the input media stream to generate an output media stream. At least one frame of the output media stream includes at least a portion of the additional content in conjunction with at least a portion of a corresponding frame of the input media stream.

The invention relates to a method for regularly generating a disaster map based on NodeJs. The method comprises steps of a built-in timer regularly generating a thematic task, meanwhile, an external request being received, whether a picture exists or not being judged, if yes, a disaster picture being returned to the request, and if not, a custom task being created; all the tasks being transmittedinto a task scheduling queue and processed according to priorities; creating a sub-thread for each task by the main thread, starting a headless browser in the sub-thread, creating a map canvas, and zooming a map to a task specified level; reading related data in the database, drawing a graph, and loading the graph to the canvas; reading a related basic layer from a file system and loading the related basic layer to the canvas; reading a related online service layer from the online map service and loading the related online service layer to the canvas; intercepting a task drawing area, and generating a disaster picture; saving the disaster picture to a file system; and returning the disaster picture to the external request. The method is beneficial to providing disaster pictures for users,has low requirements on user networks and equipment, and is easy to operate and use.

The invention provides a resource link acquisition method and device, electronic equipment and a storage medium. The method comprises the steps of obtaining a to-be-processed webpage corresponding to an access link; searching for events existing in all document nodes in the to-be-processed webpage, and storing the events existing in the document nodes into a to-be-processed queue; simulating and triggering events in the to-be-processed queue in a multi-thread manner by using a headless browser; intercepting a resource request generated by the event in the to-be-processed queue in the triggering process, and obtaining a resource link in the resource request. In the implementation process, the events existing in the webpage are stored in the to-be-processed queue, and then the events in the to-be-processed queue are triggered and intercepted, so that the situations that the webpage jumps for multiple times, the page is rendered again, a new page pops up for multiple times and the like are effectively avoided; and meanwhile, excessive consumption of computing resources and bandwidth resources caused by the conditions is avoided, so that the computing resources and the bandwidth resources are effectively saved.

The invention provides an APP data acquisition method and system. The method comprises the following steps: (1) acquiring a keyword of user task data and an entry address of a target APP; (2) creatinga headless browser, carrying basic information required by authentication to initiate an http request, and accessing an APP entry address; (3) judging whether task data exists in the skipped displaypage or not according to the keyword, and if yes, generating a crawler script according to the request address and the parent-child level relationship in combination with a default crawler script template; and (4) automatically and periodically executing the crawler script to obtain task data. According to the APP data acquisition method and system provided by the invention, all pages or requestsof the APP can be automatically and deeply traversed according to the entry address of the APP, the to-be-acquired data is searched, the concise script is generated, and the successful script is periodically executed to acquire the required information.

The embodiment of the invention provides a new media content publishing method and device, a storage medium and electronic equipment, and the method comprises the steps: responding to the publishing operation of a user on new media content, and determining a plurality of platform accounts corresponding to the user; determining each publishing account corresponding to the new media content in the plurality of platform accounts; determining account information, a new media platform and a publishing strategy corresponding to each publishing account; based on the account information corresponding to each published account, generating a login request corresponding to each published account; and for each publishing account, logging in a new media platform corresponding to the publishing account based on the login request corresponding to the publishing account and a preset headless browser, and publishing new media contents in the new media platform according to a publishing strategy corresponding to the publishing account, thereby completing a publishing process corresponding to the publishing account. By applying the method provided by the invention, the new media content can be published in batches based on a plurality of accounts, the workload of workers can be reduced, and the publishing efficiency is improved.

The invention discloses a website monitoring system and method. According to the webpage link path deep filtering link and deep recursive traversal method, the inspection range of the webpage link inthe website is controlled in the horizontal and vertical directions, and the webpage is analyzed by the headless browser, so that the website monitoring is flexible, efficient and accurate, and the problem of infinite loop link in the website is avoided by limiting the recursive depth parameter value. The website monitoring system comprises a front-end subsystem, a database and a rear-end subsystem, and the front-end subsystem and the rear-end subsystem are connected with the database through a mapping relation. The front-end subsystem is used for setting system parameters and detecting task operation input instructions, writing the instructions into a database, calling the instructions to execute feedback by the rear-end subsystem, and displaying historical detection records and information stored in the database to a user; and the rear-end subsystem is used for inputting the home page address of the checked website, checking related parameters and outputting check information and alarm information which are stored in the relational database.

The invention relates to a real-time information crawler method and device based on intelligent page analysis and computer equipment. The method comprises the following steps: analyzing a URL of a detail page according to XPath configuration of each website, and logging a queue to be crawled into a table of a database through an SQL query component; crawling a URL of the detail page by utilizing a crawler assembly line; performing page rendering through a preset automatic page analysis algorithm or by calling a headless browser; extracting an HTML document of the detail page to obtain a text title, a source and release time of an article of the detail page; calculating MD5 of the detail page article and writing the MD5 into a database, where the text titles, the sources and the release time of the detail page articles and the MD5 of the detail page articles form crawler moment page snapshots; and polling the crawled detail pages according to a preset timed task and a crawler moment page snapshot to obtain a changed article list. By adopting the method, the crawler accuracy can be improved.

Associating a website with a credential manager includes identifying the launch of a first instance of a website to be associated with a credential manager in a web browser, displaying, along with the first instance of the website in the web browser, an overlay prompting a user to enter login data for the website, receiving, through the overlay in the web browser, the login data for the website, accessing a second instance of the website in a headless browser, utilizing the login data to attempt gain access to the second instance of the website, and in response to gaining access to the second instance of the website utilizing the login data, storing the login data in secure storage.