awesome/simdutf

Unicode (UTF8, UTF16, UTF32) and Base64 processing at billions of characters per second in PHP using the simdutf library.

1.0.0 2025-04-14 20:01 UTC

Requires

• php: ^8.1

Apache-2.0, MIT

• Don MacAskill

• utf8
• base64
• unicode
• utf16
• simd
• utf32

README

Unicode and Base64 routines at billions of characters per second in PHP using the simdutf library.

Accelerates Unicode routines (UTF8, UTF16, UTF32) and Base64 using SSE2, AVX2, NEON, AVX-512, RISC-V Vector Extension, LoongArch64, etc.

The simdutf library is already part of Node.js, Bun, WebKit, Chromium, Cloudflare Workers, and more. Now it can be used with PHP.

Related SIMD-accelerated PHP extensions

• crc_fast PHP extension for SIMD-accelerated CRC calculations at >100GiB/s.
• simdjson_plus PHP extension for parsing gigabytes of JSON per second using the simdjson project.

Changes

See the change log.

Installing

Use Composer to install this library using PIE:

composer install awesome/simdutf

Building

Like most PHP extensions, you can also build yourself:

$ phpize
$ ./configure
$ make
$ make test
$ make install

And add the following line to your php.ini:

extension=simdutf.so

Usage

Supplies all the simdutf API functions as PHP functions in the SimdUtf namespace (e.g., simdutf::validate_utf8() becomes \SimdUtf\validate_utf8()).

See the stubs file for a complete list of functions.

References

• simdutf the simdutf library
• simdutf-rs the Rust bindings for simdutf