alexvergara/laravel-aws-timestream

Fork from Norbybaru - Library to interact with AWS Timestream service via API - Downgrade for Laravel6 + PHP7 - Fixes for AWS Config

v0.0.1 2022-09-29 21:58 UTC

Requires

• php: ^7.2
• aws/aws-sdk-php: ^3.209
• illuminate/support: 5.6.*

Requires (Dev)

• guzzlehttp/guzzle: ^7.5
• vlucas/phpdotenv: ^5.4

MIT

• Alex Vergara

• aws timestream
• laravel aws timestream
• laravel timeseries db
• timeseries db

README

AWS Timestream is a fast, scalable, and serverless time series database service. This package is an opinionated implementation to query timestream and ingest data into timestream.

It provides a query builder class which has common timeseries sql function. This was inspired by Laravel Eloquent ORM. See supported query functions AlexVergara\AwsTimestream\Contract\QueryBuilderContract

It also provide a payload builder class to format your data correctly to ingest into timestream. See AlexVergara\AwsTimestream\Contract\PayloadBuilderContract

Install

composer require norbybaru/laravel-aws-timestream

Configuration

• Publish config

php artisan vendor:publish --provider="AlexVergara\AwsTimestream\TimestreamServiceProvider" --tag="timestream-config"

• Open timestream.php config file and setup your databse name and tables
• Setup you AWS Timestream keys and permissions with the following enviroment variable

AWS_TIMESTREAM_KEY=
AWS_TIMESTREAM_SECRET=
AWS_TIMESTREAM_PROFILE=
AWS_TIMESTREAM_VERSION=
AWS_TIMESTREAM_REGION=

Basic Usage

Query Timestream

Using TimestreamBuilder::query() will give autocomplete of all available functions

1. Using TimestreamBuilder to build query to be passed onto TimestreamReaderDto which generate am object that can be consumed by TimestreamService query function

<?php

use AlexVergara\AwsTimestream\TimestreamService;
use AlexVergara\AwsTimestream\TimestreamBuilder;
use AlexVergara\AwsTimestream\Dto\TimestreamReaderDto;

public function overview(TimestreamService $timestreamService)
{
    $queryBuilder = TimestreamBuilder::query()
        ->select('*')
        ->from("database-name", 'table-name')
        ->whereAgo('time', '24h', '>=')
        ->whereNotIn('measure_value::varchar', ['reviewer', 'open', 'closed'])
        ->orderBy('time', 'desc');

    TimestreamReaderDto::make($queryBuilder);

    // response from Aws timestream
    return $timestreamService->query($timestreamReader)
}

1. Use TimestreamReaderDto to inject from query with default database name and on demand table name. NB. No need to add ->from() query on your query builder.

<?php

use AlexVergara\AwsTimestream\TimestreamService;
use AlexVergara\AwsTimestream\TimestreamBuilder;
use AlexVergara\AwsTimestream\Dto\TimestreamReaderDto;

public function overview(TimestreamService $timestreamService)
{
   $queryBuilder = TimestreamBuilder::query()
       ->select('*')
       ->whereAgo('time', '24h', '>=')
       ->whereNotIn('measure_value::varchar', ['reviewer', 'open', 'closed'])
       ->orderBy('time', 'desc');

   TimestreamReaderDto::make($queryBuilder, 'table-name');

   // response from Aws timestream
   return $timestreamService->query($timestreamReader)
}

Timestream Ingestion

We need to build our payload that Timestream will accept for ingestion.

1. Use TimestreamBuilder to build ingestion payload

<?php

use AlexVergara\AwsTimestream\TimestreamService;
use AlexVergara\AwsTimestream\Dto\TimestreamWriterDto;
use AlexVergara\AwsTimestream\TimestreamBuilder;

public function ingest(TimestreamService $timestreamService)
{
    $metrics = [
        'measure_name' => 'cpu_usage',
        'measure_value' => 80,
        'time' => Carbon::now(),
        'dimensions' => [
            'mac_address' => 'randomstring',
            'ref' => 'refs',
        ],
    ];

    $payload = TimestreamBuilder::payload(
        $metrics['measure_name'],
        $metrics['measure_value'],
        $metrics['time'],
        'VARCHAR',
        $metrics['dimensions'],
    )->toArray();

    $timestreamWriter = TimestreamWriterDto::make($payload)->forTable('table-name');
    return $timestreamService->write($timestreamWriter);
}

1. Ingestion data in batch using Common Attributes to reduce ingestion cost with Timestream

<?php

use AlexVergara\AwsTimestream\TimestreamService;
use AlexVergara\AwsTimestream\Dto\TimestreamWriterDto;
use AlexVergara\AwsTimestream\Support\TimestreamPayloadBuilder;

public function ingest(TimestreamService $timestreamService)
{
    $metrics = [
        [
            'measure_name' => 'cpu_usage',
            'measure_value' => 80,
            'time' => Carbon::now(),
            'dimensions' => [
                'ref' => 'ref_1',
            ],
        ],
        [
            'measure_name' => 'memory_usage',
            'measure_value' => 20,
            'time' => Carbon::now(),
            'dimensions' => [
                'ref' => 'ref_2',
            ],
        ]
    ];

    $commonAttributes['device_name'] = 'device_1';
    $commonAttributes['mac_address'] = 'randomstring';

    $payload = TimestreamBuilder::batchPayload($metrics);

    $common = TimestreamBuilder::commonAttributes($commonAttributes);

    $timestreamWriter = TimestreamWriterDto::make($payload, $common, 'table-name');
    return $timestreamService->write($timestreamWriter);
}

Online Resources

• https://docs.aws.amazon.com/timestream/latest/developerguide/what-is-timestream.html