opportus/web-scraper

A web scraper taking as arguments a list of URIs and a list of XPath queries to perform on each document. Returns an instance of DataInterface.

Maintainers

Details

github.com/opportus/web-scraper

Source

Issues

Installs: 4

Dependents: 0

Suggesters: 0

Security: 0

Stars: 1

Watchers: 1

Forks: 0

Open Issues: 0

pkg:composer/opportus/web-scraper

v2.0.0 2018-12-29 11:08 UTC

Requires

MIT 62be5445a73e1bfd310ca101fa5fca78429ec3d4

  • opportus <opportus.woop@gmail.com>

This package is auto-updated.

Last update: 2025-09-29 02:02:48 UTC

README

A web scraper taking as arguments a list of URIs and a list of XPath queries to perform on each document. Returns an instance of DataInterface.

Installation

$ composer require opportus/web-scraper

Usage

Use Opportus\WebScraper\WebScraper;

$uris = [
    'https://en.wikipedia.org/wiki/Web_scraping',
    'https://en.wikipedia.org/wiki/XPath',
];

$queries = [
    '//p[1][node()]',
    '//div[@id="mw-normal-catlinks"]/ul//li[node()]',
];

$scraper = new WebScraper();

$data = $scraper->scrap($uris, $queries); // @see https://github.com/opportus/web-scraper/blob/master/src/DataInterface.php