icecave/duct

An incremental streaming JSON parser.

2.0.2 2015-04-23 00:16 UTC

Requires

• php: >=5.4
• eloquent/enumeration: ~5
• evenement/evenement: ~2

Requires (Dev)

• athletic/athletic: ~0.1
• icecave/archer: ~1

MIT

• James Harris

• json
• event
• stream
• parser
• parse
• react
• evented

README

Duct is a PHP library for incrementally parsing continuous streams of JSON values.

composer require icecave/duct

Duct is designed to parse sequential JSON values from data streams, without framing or demarcation outside of the JSON specification.

Examples

Simple parsing

Duct can be used to parse multiple JSON documents in a single call to Parser::parse(). The JSON string given must contain complete values.

use Icecave\Duct\Parser;

$parser = new Parser;
$values = $parser->parse('[ 1, 2, 3 ] [ 4, 5, 6 ]');

assert($values[0] === [1, 2, 3]);
assert($values[1] === [4, 5, 6]);

Incremental parsing

Asynchronous, incremental parsing is also possible using the Parser::feed(), values() and finalize() methods.

use Icecave\Duct\Parser;

$parser = new Parser;

// JSON data can be fed to the parser incrementally.
$parser->feed('[ 1, ');

// An array of completed values can be retreived using the values() method.
// At this point no complete object has been parsed so the array is empty.
$values = $parser->values();
assert(0 === count($values));

// As more data is fed to the parser, we now have one value available, an array
// of elements 1, 2, 3.
$parser->feed('2, 3 ][ 4, 5');
$values = $parser->values();
assert(1 === count($values));
assert($values[0] == [1, 2, 3]);

// Note that calling values() is destructive, in that any complete objects are
// removed from the parser and will not be returned by future calls to values().
$values = $parser->values();
assert(0 === count($values));

// Finally we feed the remaining part of the second object to the parser and the
// second value becomes available.
$parser->feed(', 6 ]');
$values = $parser->values();
assert(1 === count($values));
assert($values[0] == [4, 5, 6]);

// At the end of the JSON stream, finalize is called to parse any data remaining
// in the buffer. An exception is thrown if the buffer contains an incomplete
// value.
$parser->finalize();

// In this case there were no additional values.
$values = $parser->values();
assert(0 === count($values));

Event-based parsing

Duct also provides EventedParser, an event-based incremental parser similar to the Clarinet library for JavaScript. Event management is provided by Événement, a popular PHP event library.

As per the example above the feed() and finalize() methods are used, however there is no values() method. Instead, the following events are emitted as the buffer is parsed.

• document-open: emitted when a JSON document is begun
• document-close: emitted after an entire JSON document has been parsed
• array-open: emitted when an array open bracket is encountered
• array-close: emitted when an array closing bracket is encountered
• object-open: emitted when an object open brace is encountered
• object-close: emitted when an object closing brace is encountered
• object-key (string $key): emitted when an object key is encountered
• value (mixed $value): emitted whenever a scalar or null is encountered, including inside objects and arrays
• error (Exception $error): emitted when a syntax error is encountered