diggin/diggin-scraper

web-sraping component, inspired by Perl’s Web::Scraper. It provides a DSL-ish interface for traversing HTML documents and returning a neatly arranged PHP ‘s multidimensional array

v0.9.2 2015-12-24 16:17 UTC

Requires

• diggin/diggin-http-charset: ~0.8
• diggin/diggin-scraper-adapter-htmlscraping: ~0.9
• zendframework/zend-dom: ~2.3
• zendframework/zend-http: ~2.3

Requires (Dev)

• zendframework/zend-filter: ~2.3

BSD-3-Clause

• sasezaki

README

web-sraping component, inspired by Perl’s Web::Scraper. It provides a DSL-ish interface for traversing HTML documents and returning a neatly arranged PHP's multidimensional array.

#CHANGELOG for 0.9.0 change behavior when extracting target is not found #1

if you want throw exception for v0.8 compatibility, please use throwTargetExceptionsOn method.

$scraper->throwTargetExceptionsOn(true);

Feature

• into multidimensional array
• Handle CSS Selector or XPath expression
• Automatically convert to UTF-8
• based on Diggin_Http_Charset
• Beautify ugly HTML into XHTML automatically
• based on Diggin_Scraper_Adapter_Htmlscraping & tidy
• convert relative path into absolute URL automatically ("a href" & "img src")
• Enable change Strategy (xpath or regex) & Enable change pretreat converting HTML

Requirements

• PHP 5.3.3 or over
• Zend Framework 2
• Diggin components
• Diggin_Http_Charset
• Diggin_Scraper_Adapter_Htmlscraping