ajbdev/scraper

Scrape websites and extract specific information in various format (HTML, JSON, etc) from different sources

dev-master 2015-01-26 04:35 UTC

Requires

• php: >=5.5.9
• fzaninotto/faker: dev-master
• guzzlehttp/guzzle: 5.0.*
• peekmo/jsonpath: dev-master
• symfony/css-selector: 2.3.*@dev

MIT

• Andy Baird

README

Quickly and easily scrape data from external sources with simple query strings.

use Scraper\Scraper;
use Scraper\Source\Source;

$scraper = new Scraper();

$source = Source::create('https://news.ycombinator.com');
$source->setFakeIdentity(true);

$result = $scraper->scrape($source, 'td.title a');

foreach ($result as $node) {
    echo $node->nodeValue . PHP_EOL;
}

// IBM to cut 111,800 people from its workforce
// Chess: Who will win in this riveting game of Math.random() vs. Math.random()?
// First U.S. Bitcoin Exchange Set to Open
// ...