AWS - How to setup Kinesis Firehose & Elastic Search - Implementation - part 5 - Do it Yourself

AWS – How to setup Kinesis Firehose & Elastic Search – Implementation – part 5 – Do it Yourself



Download the scripts from here:
AWS – How to setup Kinesis Firehose & Elastic Search – Implementation – 5
AWS – How to setup Kinesis Streams & Data Analytics – Implementation – 4
AWS – How to setup Webclickstream data on EC2 Cluster – Implementation – 3
AWS – How to create EC2 Cluster – Approach & Implementation – part 2
AWS – How to ingest Realtime Data – Approach & Implementation – Do it yourself
Amazon Web Service – Cloud Solution approach

High level architecture approach and hands on to ingest realtime data

Bharati DW Consultancy
cell: +1-562-646-6746
email: [email protected]
website:

Twitter: @BharatDWCons
Youtube: BharatiDWConsultancy
Whatsapp: +1-562-646-6746 (+1-56-COGNOS-46)

2 thoughts on “AWS – How to setup Kinesis Firehose & Elastic Search – Implementation – part 5 – Do it Yourself

  1. this the SQL
    create or replace stream "destination_sql_stream"
    (
    CUSTOMER_ID INTEGER,
    IP_ADDRESS VARCHAR(16),
    DEVICE_TYPE VARCHAR(8),
    ROUTER_MAC_ADDRESS VARCHAR(32),
    DEVICE_NAME VARCHAR(16),
    IP_BROWSER VARCHAR(16),
    WEBSITE_URL VARCHAR(256),
    APP_NAME VARCHAR(8),
    IS_APP_FLAG VARCHAR(4),
    IS_DOWNLOADED_FLAG VARCHAR(4),
    DATA_SIZE INTEGER,
    IS_LIVE_STREAMING VARCHAR(4),
    COL_DATE VARCHAR(16),
    COL_TIME VARCHAR(32)
    );

    create or replace pump "stream_pump" as
    INSERT into "destination_sql_stream"
    select
    "customer_id",
    "ip_address",
    "device_type",
    "router_mac_address",
    "device_name",
    "ip_browser",
    "website_url",
    "app_name",
    "is_app_flag",
    "is_downloaded_flag",
    "data_size",
    "is_live_streaming",
    "COL_date",
    "COL_time"
    from "SOURCE_SQL_STREAM_001";

Leave a Reply

Your email address will not be published. Required fields are marked *