SAP Cloud Integration for Data Services was previously known as SAP Cloud Platform Integration for Data Services(CPI-DS). It is a cloud-based integration tool offered by SAP. It allows extracting, transforming and loading (ETL) large amounts of data from one system to another both on-premises and in the cloud.
SAP Cloud Integration for Data Services is exclusive to select Neo-based data centers. CPI-DS is mainly used for loading data into cloud-based SAP applications such as SAP IBP (Integrated Business Planning). The integration tool required for SAP IBP is included with the application license and it is provided as SAP Cloud Platform Integration for Data Services (CPI-DS).
However, it also offers connectivity to various other cloud applications through industry-standard protocols such as SOAP, REST or OData.
How it works?
The process begins with SAP Cloud Platform Integration interacting with your local SAP landscape via the SAP Data Services Agent, establishing secure HTTPS and RFC connections. To connect your system to an on-premise source, the SAP Data Services Agent is essential.
It is used to establish a connection with SAP Cloud Integration for data services and facilitates secure data transfer from your on-premise sources to your cloud-based target application.
What is SAP Data Services Agent?
Sap Data Services Agent helps in establishing connectivity between your local sap system and on-premise system.
In order to start the data transfer you must download and install the agent. First you should create a new agent.
Steps to Create a New Agent
- Select Agents tab -> Click on New Agent.
- Enter the Name of the Agent.
- Enter the Description for the Agent (It is optional).
- Select the Agent Group (It is the collection of agents that are logically grouped). You can either add the agent to an existing group or create a new group. This is required.
- Press the Save button.
The list of agents displays. The list of agents is organized in alphabetical order based on the group names.
After the installation is done it is essential to configure the SAP Data Services Agent. This configuration allows you to utilize the agent for secure transfer of your on-premise data with SAP Cloud Integration for data services.
Steps to configure SAP Data Services Agent
- Register the agent in the SAP(CPI-DS) web interface.
- Download the configuration file (AgentConfig.txt)
- Click the Save button and Save the configuration file in your local system where you want to install the agent and press the Close button.
- Now you can see the Agent Information under the group “GBOBBILI”
What is Datastores?
The connection between SAP Cloud Integration for data services and your cloud and on-premise applications and database is established through an object called Datastores.
The connection enables the SAP Cloud Integration for data services to access metadata and perform read and write operations on your applications and databases.
Datastores allows SAP Cloud Integration for data services to efficiently retrieve valuable information and data manipulation within your applications and databases.
Steps to create Datastores:
- Select the Datastores tab in the web UI.
- In the upper left corner, Press the + icon to create the New Datastore.
- In the New Datastore dialog, configure the necessary fields.
- The configuration options change according to the datastore type you select. For a detailed description of all possible Datastore types and their properties, see the corresponding topics under Datastore Types and Their Properties.
- Click the Save button to create the Datastore.
Select the Test Connection button to verify the connection between SAP Cloud Integration for data services and the Datastore's database or application
Once the connection is established successfully, you have the capability to import metadata objects from the database or application directly into the Datastore. This functionality allows for seamless integration and access to metadata, enhancing the flexibility and versatility of data management within the Datastore.
Limitation:
- The main drawback of CPI-DS is its lack of real-time data integration capabilities and a limited set of transformation functionalities.
- CPI-DS is not currently available in all of the rapidly expanding datacenters where SAP Cloud Platform is being deployed, whereas SDI (Smart Data Integration) is consistently available wherever HANA is present.
Features:
Some key features of CPI-DS to smoothly handle various data integration scenarios are as follows:
Data Extraction:
CPI-DS enables data extraction from various sources including on-premise SAP systems, on-premise non- SAP system or cloud-based SAP applications. It supports both batch and real-time data extraction methods.
Data Transformation:
It provides data transformation techniques that have been optimized for cloud applications, such as a graphical mapping tool and built-in functions.
Data Loading:
With CPI-DS, you can load transformed data into into cloud-based SAP applications such as SAP Integrated Business Planning. It supports various loading techniques, including bulk loading and real-time data streaming.
Data Synchronization:
CPI-DS enables you to synchronize data between different systems, ensuring that changes made in one system are propagated to other systems in a consistent and timely manner.
Connectivity and Adapters:
CPI-DS provides pre-built connectors and adapters to connect with a wide range of systems and applications, including SAP and non-SAP systems. These adapters facilitate seamless data integration across diverse landscapes.
Monitoring and Administration:
The platform offers monitoring and administration capabilities to track the performance and health of integration processes. It provides dashboards, alerts, and logging mechanisms to ensure the smooth operation of data integration scenarios.
Summary:
CPI-DS is part of the SAP Cloud Platform Integration suite, which also includes other integration tools such as SAP Cloud Platform Integration (CPI) and SAP API Management. It can be used standalone or in combination with other SAP products to achieve comprehensive integration capabilities across the enterprise landscape.
CPI-DS involves the extraction, transformation, and loading (ETL) of substantial volumes of data from one system to another. This process typically occurs in bulk, enabling transformations on the entire dataset, such as aggregation, sorting, or duplicate identification.