oshomo / csv-utils
A CSV utility to read, validate and write data to multiple format including JSON, XML etc.
Installs: 78 022
Dependents: 0
Suggesters: 0
Security: 0
Stars: 19
Watchers: 1
Forks: 7
Open Issues: 1
Requires
- php: >7.1.3
- ext-dom: *
- ext-json: *
- ext-mbstring: *
- ext-simplexml: *
Requires (Dev)
- friendsofphp/php-cs-fixer: ^2.19 || ^3.0
- phpunit/phpunit: ^5.7 || ^6.5 || ^7.0 || ^8.0
README
CSVUtils
Make sure you use a tagged version when requiring this package.
Table of Content
- Current Stable Versions
- How to Run
- Implementation
- Documentation
- Running Tests
- Contributing to this Repo
Current Stable Versions
How to Run
I have added a sample index.php
file for a quick test of how to use the package. To run the sample; from the package root, run composer install
then using php built in server run php -S localhost:8000
, this would start the server at localhost:8000
. Visit the URL from your browser and you should see the generated files in the sample
folder at the root of the package.
Implementation
The Validator
expects a valid file path, the CSV delimiter, an array of validation rule(s) and an optional message(s) array to over-write the default messages of the validator.
Documentation
Initializing a Validator
Set a valid csv file path, pass the CSV delimiter and pass in your validation rules.
use Oshomo\CsvUtils\Validator\Validator; $validator = new Validator( "some/valid/file_path", [ "name" => ["ascii_only"], "uri" => ["url"], "stars" => ["between:0,5"] ] );
Validating the CSV
Now we are ready to validate the CSV. The validator provides a validate
method that can be called like so: $validator->validate();
. The validate
method returns an array of the invalid rows if validation fails. If the validation passes the validate
method returns the CSV data as an array
A better implementation:
use Oshomo\CsvUtils\Validator\Validator; $validator = new Validator( "some/valid/file_path", [ 'title' => ["ascii_only", "url"] ] ); if ($validator->fails()) { // Do something when validation fails $errors = $validator->errors(); }
Error messages
To get the rows with validation errors and their errors. The validator expose errors
method that can be used like so $validator->errors()
.
You can also customize the error messages for different validation rules and different attributes by passing a message array to the validator like so:
use Oshomo\CsvUtils\Validator\Validator; $validator = new Validator( "some/valid/file_path", ['title' => ["ascii_only", "url"]], [ 'ascii_only' => 'The :value supplied for :attribute attribute is invalid on line :line of the CSV.', // This specifies a custom message for a given attribute. 'hotel_link:url' => 'The :attribute must be a valid link. This error occured on line :line of the CSV.', ] );
In this above example:
The :attribute
place-holder will be replaced by the actual name of the field under validation.
The :value
place-holder will be replaced with value being validated.
The :line
place-holder will also be replaced with the row/line number in the CSV in which the error happened.
You may also utilize other place-holders in validation messages. For example the between
rule exposes two other placeholder min
and max
. Find more about this in the available rules section
Available rules
between:min,max
:
Validates that a cell value is between a :min and :max. The rule exposes the :min and :max placeholder for inline messages
ascii_only
:
Validates that a cell value does not contain a non-ascii character
url
:
Validates that a cell value is a valid URL. By valid URL we mean
(#protocol)
(#basic auth)
(#a domain name or #an IP address or #an IPv6 address)
(#a port(optional)) then
(#a /, nothing, a / with something, a query or a fragment)
Writing CSV Output Data
The output of the CSV file can be written into any format. The currently suported format is xml
and json
. The validator exposes a write
method to write the output data into the same folder as the CSV. Find example implementation below:
use Oshomo\CsvUtils\Validator\Validator; use Oshomo\CsvUtils\Converter\JsonConverter; use Oshomo\CsvUtils\Converter\XmlConverter; $validator = new Validator( 'some/valid/file_path', [ "stars" => ["between:0,5"], "name" => ["ascii_only"], "uri" => ["url"], ] ); if(!$validator->fails()) { $validator->write(new JsonConverter()); $validator->write(new XmlConverter("hotel")); } else { print_r($validator->errors()); }
The JsonConverter
simply writes the output data as JSON. The XmlConverter
converter writes the data as XML. XmlConverter
takes an optional parameter for setting the XML records element. If non is supplied it defaults to item
e.g $validator->write(new XmlConverter("hotel"));
would write the below:
<?xml version="1.0"?>
<data>
<hotel>
<name>Beni Gold Hotel and Apartments</name>
<stars>5</stars>
<uri>https://hotels.ng/hotel/86784-benigold-hotel-lagos</uri>
</hotel>
<hotel>
<name>Hotel Ibis Lagos Ikeja</name>
<stars>4</stars>
<uri>https://hotels.ng/hotel/52497-hotel-ibis-lagos-ikeja-lagos</uri>
</hotel>
</data>
NOTE: Either validation passes or fails, you can always write the CSV output data to the available formats. In cases where validation fails there would be an extra error property in the written data.
Passing Custom Rules to Validator Using Rule Object
Passing a custom rule to the validator is easy. Create a CustomRule class the implements Oshomo\CsvUtils\Contracts\ValidationRuleInterface
interface. And pass that class to the rule array, easy. E.g:
use Oshomo\CsvUtils\Validator\Validator; $validator = new Validator( 'some/valid/file_path', ["name" => ["ascii_only", new UppercaseRule]] );
The class definition for UppercaseRule
. Follow the same approach if you want to create your own rule.
use Oshomo\CsvUtils\Contracts\ValidationRuleInterface; class UppercaseRule implements ValidationRuleInterface { /** * Determines if the validation rule passes. This is where we do the * actual validation. If the validation passes return true else false * * @param mixed $value * @param $parameters * @return bool */ public function passes($value, array $parameters): bool { return strtoupper($value) === $value; } /** * Get the validation error message. Specify the message that should * be returned if the validation fails. You can make use of the * :attribute and :value placeholders in the message string * * @return string */ public function message(): string { return "The :attribute value :value must be uppercase on line :line."; } }
If the CustomRule accepts parameters like the between
rule, then your CustomRule class must implement both Oshomo\CsvUtils\Contracts\ValidationRuleInterface
and Oshomo\CsvUtils\Contracts\ParameterizedRuleInterface
. See Oshomo\CsvUtils\Rules\Between
as an example.
Passing Custom Rules to Validator Using Closure
If you only need the functionality of a custom rule once throughout your application, you may use a Closure instead of a rule object. The Closure receives the attribute's value, and a $fail
callback that should be called if validation fails:
use Oshomo\CsvUtils\Validator\Validator; $validator = new Validator( "some/valid/file_path", [ "uri" => ["url", function($value, $fail) { if (strpos($value, "https://") !== 0) { return $fail('The URL passed must be https i.e it must start with https://'); } }] ]);
Writing CSV Output Data to Other Formats
Writing the CSV output data to other format is also very easy. Create a CustomConverter class the implements Oshomo\CsvUtils\Contracts\ConverterHandlerInterface
interface. And pass that class to the write
method of the validator, easy. Below is an sample implementation of a JSON converter
use Oshomo\CsvUtils\Contracts\ConverterHandlerInterface; class JsonConverter implements ConverterHandlerInterface { const FILE_EXTENSION = "json"; /** * The converted data * * @var string */ protected $data; /** * @return string */ public function getExtension(): string { return JsonConverter::FILE_EXTENSION; } /** * @param array $data * @return $this|mixed */ public function convert(array $data): ConverterHandlerInterface { $this->data = json_encode($data, JSON_PRETTY_PRINT | JSON_NUMERIC_CHECK | JSON_UNESCAPED_SLASHES | JSON_UNESCAPED_UNICODE ); return $this; } /** * @param string $filename * @return bool */ public function write(string $filename): bool { return (file_put_contents($filename, $this->data)) ? true : false; } } ////////////////////////////////////////////////////// // To use the converter above. ////////////////////////////////////////////////////// $validator->write(new JsonConverter());
Running Tests
Run composer test
from the root of the Package.
Contributing to this Repo
Feel free to submit a pull request for a feature or bug fix. However, do note that before your pull request can be merged it must have test written or updated as the case maybe. The project run's automatic checks to make sure that the Symfony code standards are met using php-cs-fixer.
So, before pushing or making any pull request run the below command:
composer test
: For running testcomposer fix-lint
: For running php-cs-fixer to fix linting errors