SAP Cloud Platform Integration for Data Services

SAP Cloud Platform Integration for data services allows you to efficiently and securely use ETL (extract, transform, load) tasks to move data between on premise systems and the cloud. With SAP CPI for DS you can replicate the data and define how the data is mapped to your database schema.

SAP public cloud application like SAP S&OP use SAP CPI for DS to integrate with the on premise SAP system. We can monitor SAP CPI for DS using a SOAP API to extract exceptions.

Technical Prerequisites

The following technical prerequisites have to be met in order to monitor this scenario:

  • Requires at least SAP Solution Manager 7.2 SP03
  • Import Cloud Service SSL Certificate into SAP Solution Manager

Import Cloud Service SSL Certificate

In the context of Hybrid Scenarios, data collectors are connecting from Solution Manager to the Cloud Service provider, in order to collect exceptions and/or statistical data. To allow this outgoing connection from Solution Manager, the SSL Certificate of the Cloud Service provider has to be imported in Trust Manager (STRUST).

  1. Open the cloud service URL in a browser
  2. Click 'View' → 'Security Report' or click the padlock next to the URL in the address input field
  3. Click 'View certificates'
  4. Switch to the 'Details' tab and click 'Copy to File...'
  5. Export the certificate in 'Base-64 encoded X.509 (.CER)' format
  6. Log on to SAP Solution Manager and go to transaction STRUST
  7. Import the certificate to 'SSL client SSL Client (Anonymous)'

Available Monitoring Content

SAP Cloud Platform Integration for data services represents the integration layer of a hybrid scenario. Monitoring it is relevant for all hybrid scenarios using this integration form.

For the SAP Cloud Platform Integration for data services scenario the following monitoring content is relevant:

Scenario Component Monitoring Object Description Monitoring Template Since SP
Integration Exceptions in SAP CPI for DS  Errors in tasks in SAP Cloud Platform Integration for data services Cloud (SAP HCI DS)  7.2 SP03 

Monitoring Template: Cloud (SAP HCI DS)

Metric Name Description MAI Category Since SP

Number of erroneous tasks in SAP HCI DS (Delta)

Number of erroneous iFlows detected in SAP HANA Cloud Integration for data services since the last data collection. The exceptions are retrieved from HCI via the central Exception Management in Solution Manager.

Exceptions

7.2 SP03

Number of erroneous tasks in SAP HCI DS (last 24h)

Number of erroneous iFlows detected in SAP HANA Cloud Integration for data services during the last 24h. The exceptions are retrieved from HCI via the central Exception Management in Solution Manager.

Exceptions

7.2 SP03

Configuration

Step 1: Define Cloud Service in SAP Solution Manager

You need the following information to create the SAP Cloud Platform Integration for data services service:

  • User
  • Password
  • Root URL (e.g. https://<myhost>.hana.ondemand.com)

SAP CPI for DS User Credentials

The user will be maintained in the HTTP endpoint and must be must have the role Production Operator to be able to monitor running and finished tasks and processes.

For more information about default role assignments, please refer to SAP Cloud Platform Integration for data services security guide: https://help.sap.com/viewer/f9f202d1c5924753833b487ac9306384/latest/en-US/d627c9c23a1c4311bd0f88a611ac2aa6.html

The Cloud Services configuration is now accessible from the SAP Solution Manager Configuration (SOLMAN_SETUP) → Managed Systems Configuration → Tab 'Cloud Services'.

Create Cloud Service:

  1. Select 'Cloud Service Operations' → Create Cloud Service
  2. Select Service Type: 'SAP Cloud Platform for data services' from the drop-down list.
  3. Define Service:
    • Organization name: The SAP HCI for Data Services organization name
  4. Define Root URL: Enter the <Main URL> as Root URL.
    • You can also adjust the extended service ID (The ID used as SID in LMDB) here.
  5. Confirmation: Check your input values and click 'Finish'

The second step is to create the end-point for the cloud service.

Create the End-Point:

  1. Select your SAP Cloud Platform cloud service from the list and click 'Configure Cloud Service' 
  2. Configure Endpoints: Click the 'Add' button on the 'HTTP Endpoints' tab.
  3. Enter the following information:
    • Description: A meaningful description
    • Repository: Select if this end-point points to the 'Production' or 'Sandbox' repository
    • User: <User>
    • Password: <Password>
    • If necessary add proxy information to connect to SAP Cloud Platform Integration for data services

Step 2: Configure Exception Management

After the basic configuration you now have to configure Exception Management, as the exceptions collected via Exception Management and stored in the central exception store are the basis for the Integration Monitoring data collection.

Configuration for SAP CPI for data services

To access the Exception Management setup please go to transaction SOLMAN_SETUP → Application Operations → Exception Management 

  1. In the step 'Define Scope' select the tab 'Cloud Services' and your SAP CPI for DS service. If you didn't configure the system before make sure to select 'All Cloud Services' in the view drop-down. Click on 'Configure' or click 'Next' two times. You will enter the step 'Exception Configuration'.
  2. Click 'Add / Configure Log Store'. Select 'Errors from SAP HANA Cloud Integration for data services'. Select the correct end-point for the SAP CPI for DS if you have more than one.
  3. Select the fields for filtering for your log store. The following filter fields are available:
    • ProjectName: Name of the workflow project
    • TaskName: Name of the project task
  4. Maintain the filter values for the fields in the Filter Definition panel under the log stores table. You can also add, remove or change filter fields and values later on in the area. You can use different operators for your filter value. You can add more than one filter filed combination per log store. To add an additional filter field combination click on the button 'Add Filter' in the 'Configured Log Stores' panel.
  5. Once you are done with the Log Store setup click 'Next' to go to the alert configuration. The alert configuration is done in the 'Interface and Connection Monitoring' described in the next section.

Step 3: Configure Interface and Connection Monitoring

The last step is the configuration of Interface and Connection Monitoring. The Interface and Connection Monitoring setup can be accessed via SAP Solution Manager Configuration (SOLMAN_SETUP). 

Configuration for Monitoring Template: Cloud (SAP HCI DS)

To access the Integration Monitoring setup please go to SAP Solution Manager Configuration (SOLMAN_SETUP) → Application Operations → Integration Monitoring → Interface and Connections.

Note: If you didn't perform the infrastructure configuration yet, please follow the Interface and Connection Monitoring Setup with SAP Solution Manager 7.2.

Navigate to the step 'Define Scope'. You can create a new scenario for the SAP CPI for DS monitoring or use an existing one. Make sure the on premise system for the SAP CPI for DS scenario and the Cloud Service created for SAP CPI for DS is part of the Interface and Connection Monitoring scenario. 

Create the Interface Channel:

  1. Select the scenario and click 'Next'
  2. In step 'Preparation' perform all relevant manual activities and run all automatic activities.
  3. In step 'Configuration' click the 'Add' button.
    • Channel Name: Enter a meaning full name (max. 30 characters)
    • Type: Select 'Cloud'
    • Monitoring Template: Select 'Cloud (SAP HCI DS)'
    • Description: Enter a description for the channel
  4. Click Next.
  5. Source type:
    • If the source system is the on premise system, please select 'Technical System'
    • If the source system is the SAP CPI for DS system please select 'External Service'
  6. Source: Select the on premise system resp. the SAP CPI for DS Cloud Service from the drop-down list
  7. Target Type:
    • If the target system is the on premise system, please select 'Technical System'
    • If the target system is the SAP CPI for DS system please select 'External Service'
  8. Target: Select the on premise system resp. the SAP CPI for DS Cloud Service from the drop-down list
  9. The measuring point is selected automatically
  10. If more than one client are connected for the on premise system please select the correct client for the monitoring
  11. Click Next.
  12. Click Finish.

Maintain the Interface:

  1. Select the interface channel you created
  2. On the 'Interfaces' tab click the 'Add' button.
  3. Provide the following information:
    • Interface name: Enter a name for the interface

    • Project Name: Name of the workflow project. This field accepts wildcards.

    • Task name (mandatory): Name of the project task. This field accepts wildcards.

If you didn't perform the infrastructure configuration yet, please follow the Interface and Connection Monitoring Setup.

Navigate to the step 'Define Scope'. You can create a new scenario for the SAP CPI for DS monitoring or use an existing one. Make sure the on premise system for the SAP CPI for DS scenario and the Cloud Service created for SAP CPI for DS is part of the Interface and Connection Monitoring scenario.

Create the Interface Channel:

  1. Select the scenario and click 'Next'
  2. In step 'Preparation' perform all relevant manual activities and run all automatic activities.
  3. In step 'Configuration' click the 'Add' button.
    • Channel Name: Enter a meaning full name (max. 30 characters)
    • Type: Select 'Cloud'
    • Monitoring Template: Select 'Cloud (SAP HCI DS)'
    • Description: Enter a description for the channel
  4. Click Next.
  5. Source type:
    • If the source system is the on premise system, please select 'Technical System'
    • If the source system is the SAP CPI for DS system please select 'External Service'
  6. Source: Select the on premise system resp. the SAP CPI for DS Cloud Service from the drop-down list
  7. Target Type:
    • If the target system is the on premise system, please select 'Technical System'
    • If the target system is the SAP CPI for DS system please select 'External Service'
  8. Target: Select the on premise system resp. the SAP CPI for DS Cloud Service from the drop-down list
  9. The measuring point is selected automatically
  10. If more than one client are connected for the on premise system please select the correct client for the monitoring
  11. Click Next.
  12. Click Finish.

Maintain the Interface:

  1. Select the interface channel you created
  2. On the 'Interfaces' tab click the 'Add' button.
  3. Provide the following information:
    • Interface name: Enter a name for the interface

    • Project Name: Name of the workflow project. This field accepts wildcards.

    • Task name (mandatory): Name of the project task. This field accepts wildcards.

The errors in the Cloud Platform Integration for data services are collected by Exception Management in SAP Solution Manager. In Exception Management you could already enter restricting parameters for the messages you want to monitor, e.g. for the message status and the user. Below the metrics selection in ICMon you can restrict the messages additionally.

Select Metrics:

  1. On the tab 'Metrics' select the metrics you want to monitor

  2. Save your interface channel by clicking on the 'Save' button. 

You can maintain attributes as described in the Interface and Connection Monitoring Setup on the tab 'Attributes'.

Thresholds and the collection schedule are maintained in the next step of the guided procedure. Once you have maintained all your channels, click 'Next' in the main guided procedure to move to the step 'Activation'.

Maintain Thresholds and Schedule:

  1. Select the Alert for the interface channel (the alert is the line with the red flash icon next to it)
    • On alert level you can maintain notification and incident message creation
    • Do not remove the flag for 'Do not Group Individual Occurrences' as this flag ensures that an alert is created for each exception
  2. Select the Metrics
    • You can adjust the thresholds on the tab Thresholds.
    • Do not change the data collector type or data collector name on the tab 'Data Collection' as the monitor will not work anymore if this is changed.
    • Only change the collection interval if you know what you do or if advised to do this by SAP.
  3. Click 'Apply and Activate' → <Choose one option> to activate the monitoring