getdkan/socrata_harvest

Optional DKAN module to harvest from Socrata catalogs.

Installs: 19

Dependents: 0

Suggesters: 0

Security: 0

Stars: 0

Watchers: 3

Forks: 0

Open Issues: 2

Type:drupal-module

1.0.1 2020-07-17 18:54 UTC

This package is auto-updated.

Last update: 2024-10-16 22:35:26 UTC


README

This module will fill in required POD values if they are missing when harvesting from a Socrata data catalog. Ideally these values should be replaced with useful information from the data provider.

Install

composer require 'getdkan/socrata_harvest'
drush en socrata_harvest

Harvest

Register the harvest, replace the uri value with the data.json url of your source:

drush dkan:harvest:register '{"identifier":"socrata","extract":{"type":"\\Harvest\\ETL\\Extract\\DataJson","uri":"https://YOUR-SOURCE/data.json"},"transforms":["\\Drupal\\socrata_harvest\\Harvest\\Transform\\Socrata", "\\Drupal\\harvest\\Transform\\ResourceImporter"],"load":{"type":"\\Drupal\\harvest\\Load\\Dataset"}}'

Run the harvest:

drush dkan:harvest:run socrata