-
Request for existing cases, user IDs, Portal navigation support and more
Extractor Framework Troubleshooting
Extractor Errors
The EFWK admin UI offers a lot of information that help with the analysis of extractor errors. It tells you the status of the last extractor run, the status of the single phases and the application area of the extractor. Best case you even get a meaningful error message that tells you what is wrong.
Error is the phases Extractor, Postprocessor or Dataloader are most likely not related to the Extractor Framework but have to be solved by the corresponding application area.
If the error happens in the phase Main Extractor, please check, which main extractor is used in this extractor. You find this information on the Extractor Detail tab.
If the extractor uses one of the following generic main extractors, the error is in EFWK responsibility. The other MEs are not in EFWK responsibility.
Generic main extractors are:
- E2E_ME_RFC_ASYNC
- E2E_ME_STAPI_ASYNC (using required records algorithm)
- E2E_ME_RFC_ASYNC_NO_RR
- E2E_ME_RFC_ASYNC_NO_RR_255
- E2E_ME_ST_API_ASYNC_NO_RR
For each phase you also have a return code. The following two tables show the most common error codes that can be found in the Extractor log.
Extractor
Error codes are defined by the the extractor. Common error codes are:
96 Communication Failure
97 System Failure (there will be most likely a corresponding dump in the managed system)
Data Loader
0 Infocube not found
2 Illegal input
3 Rollback error
4 Duplicate records
5 Request locked
6 Infocube not transactional
7 Write others
8 Target data error
9 DDIC component not found
10 Others
11 Create data error
96 Communication Failure
97 System Failure
Also not all Data Loaders are in the responsibility of the EFWK. Only the data loaders SMD_DATA_LOADER100 and SMD_BI_DATALOADER (Twin Cubes) are in the responsibility of EFWK. All others are in the responsibility of the application.
The following database tables contain the logging and status information for the EFWK:
- E2E_EFWK_STATUS: Current Status, Priority
- E2E_EFWK_LOG: Logging Table
The extractors in the table E2E_EFWK_STATUS can have the following status:
Status | Name | Description | Instance |
---|---|---|---|
Q | Queued | Set when extractor is taken into global worklist |
Resource Manager |
S | Started | Initialization of Mainextractor |
Worklist API |
R | Running | Initialization of Mainextractor |
Worklist API |
M | Banned | Set in case timeout / exception occurred |
Worklist API |
N | Inconsistent | Set in case of wrong configuration | EFWK Housekeeper / Worklist API |
and priorities:
Priority | Description |
---|---|
0 | Normal Extractor |
100 | Extractor in „time based chunk“ mode |
999 | MAI Extraktors |
N+1 | RMGR was not able to inject WLI during runtime |
All extractors started by the EFWK always run under the user SM_EFWK or SOLMAN_BTC. If you experience problems in the EFWK you should also check for dumps (ST22) for these two users and if they are related to the EFWK.
The dump details tell you if the dump is related to the extractor or to the EFWK Resource Manager.
Last but not least you can check the tab “Exceptions” or the application log (SGL1) directly for errors in extractors. On the tab exceptions the entries from the application log are pre-filtered.
If you want to use SLG1 directly please use the Object E2E_ALERTING and the sub-object EFWK (for EFWK runtime log entries) and EFWK_SETUP (for EFWK setup log entries). The setup log entries tell you important EFWK Setup information, like which content was supplied (System / PPMS IDs), which implementation / setup type is executed (RCA, CCDB, …) and were there any errors.
Inconsistent Extractors
Every time the EFWK Housekeeping runs and also during the runtime of an extractor the consistency of an extractor is verified. Extractors are scheduled for a specific technical system and for a specific Product / Software Component Version. Mismatches with LMDB information will lead to inconsistencies. The most common inconsistencies are listed below.
Message: PPMS Modelling is not valid. Check PPMS Keys.
This inconsistency usually occurs if the managed system is upgraded without rerunning the managed system setup. The consistency of the PPMS keys is evaluated by the EFWK housekeeper, that checks the PPMS keys maintained in the extractor versus the ones known in the landscape browser.
Please note, that PPMS modelling differs among the different extractors, i.e, extractors can be modelled, e.g., in the context of a software component version only, others might run in the context of a specific product instance and some extractors do not require a PPMS modelling at all. For comparison with information in the landscape browser all maintained PPMS keys need to be considered.
Message: RFC Destination not maintained/invalid
The RFC destination is evaluated during the runtime or from the housekeeper. Check if the RFC destination maintained on tab “Configuration” of the Extractor details.
Message: Technical System not found in Landscape
In this case the extractor is scheduled for a system that does not longer exist with the Long SID. These inconsistencies can arise, when systems are deleted from LMDB without de-scheduling the extractors or if the Long-SID is changed. Check if the systems exist in the Landscape Browser. If not you can delete the extractor.
Message: Technical System not Diagnostic Relevant
This means that the system is not marked as diagnostics relevant. If all systems for which extractors are scheduled are diagnostics relevant is checked by the EFWK housekeeper.
Check in the Landscape Browser if the system is marked as Diagnostics Relevant.
If not make sure to mark it as diagnostics relevant and rerun the Managed Systems Setup for the system.
Depending on the outcome of the analysis you can either release inconsistent or you can delete them. After deleting an inconsistent extractor you'll have to reschedule them. For RCA extractors this is done by rerunning the Managed System Setup, for all other extractors this is done by running the respective setup scenario depending on the setup type.
Banned Extractors
Banning extractors is a safety mode of the EFWK to make sure that an extractor that blocks resources for a very long time cannot cause harm to the managed system or hinder other extractors. Usually extractors are banned if there are multiple very long runs and a specific time interval. Technically it is banned if it causes the RFC exception SYSTEM_ERROR (RC = 97) for several times.
To analyze the banned extractor check the log for RC 97:
Most likely you will find also a corresponding dump in the managed system. The error message in the Extractor Log and the dump should help you identify and solve the problem.
After you have solved the issues you can release the banned extractor.
Extractors with Backlog (Time Based Chunks)
Sometimes you will find the message like “Info: Time based chunks. Retrieving 2014012105. Extractor will be registered again”. This means this extractor is working on reducing a backlog. This is a normal procedure of the EFWK and in general no need to worry. But you might want to consider some tuning in the EFWK to prevent future backlogs.
The timestamp tells you how big the backlog is. You will always notice that this extractor is scheduled more often, than its scheduling period.
The scheduling period can be found in the table E2E_ACTIVE_WLI in the field DTRUN.
To find the right entry in this table use the Worklist ID that you can find on the Extractor Detail information.