lyseontech/scielo-scraping

SciELO webscraping

v1.0.0 2022-10-12 19:19 UTC

Requires

• guzzlehttp/promises: ^1.4
• lyseontech/ojs-sdk: ^0.1.3
• monolog/monolog: ^2.2
• nyholm/psr7: ^1.3
• php-http/httplug: ^2.2
• symfony/browser-kit: ^5.2
• symfony/console: ^5.2
• symfony/css-selector: ^5.2
• symfony/finder: ^5.2
• symfony/http-client: ^5.2

Requires (Dev)

• phpunit/phpunit: ^9.5
• squizlabs/php_codesniffer: ^3.5

AGPL-3.0+

• webscraping
• SciELO

README

Scielo Scraping

Run web scraping in a specific SciELO journal and download all publications.

Install

To install with composer:

composer require librecodecoop/scielo-scraping

How to use?

Run the follow command to see commands list:

php bin/scielo

The main command:

php bin/scielo scielo:download-all --help
Usage:
  scielo:download-all [options] [--] <slug>

Arguments:
  slug                     Slug of journal

Options:
      --year[=YEAR]        Year of journal (multiple values allowed)
      --volume[=VOLUME]    Volume number (multiple values allowed)
      --issue[=ISSUE]      Issue name (multiple values allowed)
      --article[=ARTICLE]  Article name
      --output[=OUTPUT]    Output directory [default: "output"]
      --assets[=ASSETS]    Assets directory [default: "assets"]

All commands:

 ojs
  ojs:import-issue          
  ojs:setup-ojs             Setup OJS, only use if you don't have OJS installed.
 scielo
  scielo:download-all       
  scielo:download-binary    
  scielo:download-metadata