Integrating Amazon Simple Queue Service (SQS) with SAP HANA

Introduction

Amazon Simple Queue Service (SQS) is a fully managed message queuing service that enables you to decouple and scale microservices, distributed systems, and serverless applications. To integrate SQS with a HANA database, Advantco developed an adapter SQS for SAP Smart Data Integration(SDI). The adapter enables bi-directional data exchanges between HANA databases and AWS SQS. This blog details the steps required to replicate data from a SQS queue to a HANA real table.

Integrating Amazon Simple Queue Service (SQS) with SAP HANA

Steps to configure and use the Advantco SQS adapter for SDI.

 

Deploy the Advantco SQS adapter for SDI, this is done on the DP Agent system.

Integrating Amazon Simple Queue Service (SQS) with SAP HANA

Define the structure of the message in the SQS queue. This structure will define the scheme for the table in HANA.

Integrating Amazon Simple Queue Service (SQS) with SAP HANA

Integrating Amazon Simple Queue Service (SQS) with SAP HANA

Create Remote Source, the source should refer to the DP agent where the adapter was deployed.

Integrating Amazon Simple Queue Service (SQS) with SAP HANA

Integrating Amazon Simple Queue Service (SQS) with SAP HANA

Define the replication task to create virtual and real tables. The replication behavior can be initial and/or realtime load.

Integrating Amazon Simple Queue Service (SQS) with SAP HANA

Integrating Amazon Simple Queue Service (SQS) with SAP HANA

Query the virtual and real tables. The virtual is a realtime connection to the SQS queue, querying the virtual does not remove the messages from the SQS queue. The real table contains the polled data from the SQS queue, these messages are no longer available in the queue.

Integrating Amazon Simple Queue Service (SQS) with SAP HANA

Integrating Amazon Simple Queue Service (SQS) with SAP HANA

Insert into the virtual table result into publishing a message to the SQS queue.

Integrating Amazon Simple Queue Service (SQS) with SAP HANA

Conclusion

The Advantco SQS adapter for SDI provides a solution to replicate data from a Amazon SQS queue to HANA with minimal setup. The adapter provides bi-directional data synchronization between Amazon SQS queues and HANA tables.

Source:

    https://advantco.com/products/cloud-integration-solutions

    https://aws.amazon.com/sqs/
    
    https://help.sap.com/viewer/product/HANA_SMART_DATA_INTEGRATION/2.0_SPS04/en-US

Please reach out to our sales team at sales@advantco.com if you have any questions.