CICS错误定位与分析解读课件.ppt

1、IBM Software Group TXSeries for Multiplatforms 2006 IBM CorporationVersion 112-May-2006错误定位刘睿IBM Software Group TXSeries for Multiplatforms概要 错误日志分类4Console文件4Symrecs文件4CSMT.out文件 Dump和Traceback文件4CICS Dump4Traceback文件 可用的系统工具 综合分析IBM Software Group TXSeries for Multiplatforms 2006 IBM CorporationVe

2、rsion 112-May-2006错误日志分类IBM Software Group TXSeries for Multiplatforms错误日志文件 CONSOLE文件CICS Region Startup, Shutdown ,Transaction Error/Failure SYMRECS文件CICS Error Conditions, Symptom Records and Stack trace. TRACEBACK文件stack information when an Exception occurs in CICS. (Illegal address or Illegal i

3、nstruction) CSMT.out文件Transaction Error Messages, Communication Errors .env文件 Dump文件 XA Log文件 CICS TraceIBM Software Group TXSeries for MultiplatformsConsole文件 Console.nnnnnn 位于 /var/cics_regions/ 最大长度取决于RD:MaxConsoleSize。 如果写信息到stderr的话，就会写入Console文件。 信息分类：4Information消息例：ERZ010054I/0205 2006-07-24

4、 11:34:48.827332000 CICSNT01 3264/0001 : CICS 自相一致性检查完成4Warning消息例：ERZ016050W/0234 2006-07-24 11:36:53.175833000 CICSNT01 2260/0001 : 事务处理 CRTE 的逻辑工作单元已被逆序（现场）恢复；分布式事务处理服务 (TRAN) 原因 ENC-tra-1025: 客户机（不是事务服务）异常中止4Error消息例：ERZ058009E/0020 2006-07-24 11:36:55.629361000 CICSNT01 2260/0001 : 代码页IBM-1381和

5、代码页IBM-850之间的数据转换例程不可用，错误号为 2IBM Software Group TXSeries for MultiplatformsConsole信息举例ERZ010054I/0205 2006-07-24 11:34:48.827332000 CICSNT01 3264/0001 : CICS 自相一致性检查完成ERZ014040E/0107 2006-07-24 11:36:29.011086000 CICSNT01 2260/0001 AB34: 在程序DFHCEMT中事务CEMT发生首次异常结束A28BERZ014016E/0028 2006-07-24 11:36:

6、29.071172000 CICSNT01 2260/0001 AB34: 事务处理 CEMT，在 AB34 异常终止A147。SERVICE_MESSAGE 2006-07-24 11:36:29.101216000 CICSNT01 2260/0001 : Abend A147 (first abend A28B) is reported as transaction CEMT is force-purged.ERZ058009E/0020 2006-07-24 11:36:53.075689000 CICSNT01 2260/0001 : 代码页IBM-1381和代码页IBM-850之间

7、的数据转换例程不可用，错误号为 2ERZ014010E/0012 2006-07-24 11:36:53.105732000 CICSNT01 2260/0001 : 不能初始化远程系统的通信以运行事务处理 CRTE。ERZ014016E/0036 2006-07-24 11:36:53.135776000 CICSNT01 2260/0001 : 事务处理 CRTE，在 ? 异常终止A28D。ERZ016050W/0234 2006-07-24 11:36:53.175833000 CICSNT01 2260/0001 : 事务处理 CRTE 的逻辑工作单元已被逆序（现场）恢复；分布式事务处

8、理服务 (TRAN) 原因 ENC-tra-1025: 客户机（不是事务服务）异常中止ERZ058009E/0020 2006-07-24 11:36:55.629361000 CICSNT01 2260/0001 : 代码页IBM-1381和代码页IBM-850之间的数据转换例程不可用，错误号为 2ERZ014010E/0012 2006-07-24 11:36:55.659404000 CICSNT01 2260/0001 : 不能初始化远程系统的通信以运行事务处理 CRTE。ERZ014016E/0036 2006-07-24 11:36:55.699462000 CICSNT01 22

9、60/0001 : 事务处理 CRTE，在 ? 异常终止A28D。ERZ034114E/0731 2006-07-24 11:36:55.699505000 CICSNT01 3884/0001 : 从运行时数据库中尝试卸装条目 1AN 失败。条目标记为使用。ERZ016050W/0234 2006-07-24 11:36:55.729505000 CICSNT01 2260/0001 : 事务处理 CRTE 的逻辑工作单元已被逆序（现场）恢复；分布式事务处理服务 (TRAN) 原因 ENC-tra-1025: 客户机（不是事务服务）异常中止IBM Software Group TXSerie

10、s for MultiplatformsSymrecs文件 symrecs.nnnnnn 位于 /var/cics_regions/ Symrecs记录的格式：SYMPTOMS = primarysymptom dataSECONDARY SYMPTOMS = secondary symptom dataIBM Software Group TXSeries for MultiplatformsSymrecs记录举例SYMPTOMS = PIDS/5765E2820 LVLS/430 PTFS/ RIDS/TasLU_UpdateTidState LINE/-1 MS/016001 MSN/6

11、3 SRC/11 PRCS/2097152 AB/U1601 PID/40608 TID/1 TIME/030112052304 ISTSECONDARY SYMPTOMS = PostMortem (Error Path is offset x594 in TasLU_UpdateTidStateTasLU_ISyncpointTasLU_SyncpointPinCA_RouteCICSAPIE) logging where error occurredIBM Software Group TXSeries for MultiplatformsCSMT.out文件 位置：/var/cics_

12、regions/data 也可以写应用信息到CSMT.out文件：EXEC CICS WRITEQ TD QUEUE(CSMT) FROM(debug-data) TXSeries v6.2以后可以限制文件的最大长度为：TDD:CSMT:MaxSize。IBM Software Group TXSeries for MultiplatformsCSMT.out信息举例ERZ015033E/0003 03/10/03 09:35:09 CICSMAIN UHHP: Transaction QA55 attempts to run program QA55SUB which is not defi

13、ned in the databaseERZ015033E/0003 03/10/03 09:36:52 CICSMAIN YHHP: Transaction QA55 attempts to run program QA55SUB which is not defined in the databaseIBM Software Group TXSeries for MultiplatformsCSMT.out信息举例 ERZ028001E/6212 01/28/03 15:19:45 CICSPROD PS12: The connection to the remote system HOS

14、T cannot be started. Communications error 15a00002/15a00102 ERZ042028I/0159 01/28/03 15:19:56 CICSPROD : Terminal PS12 with NETNAME PS12 has been uninstalled. ERZ042043I/0802 01/28/03 15:20:00 CICSPROD : Waiting for tasks to finish with CD entry 04PS for remote system PS04 ERZ016050W/0234 01/28/03 1

15、5:23:26 CICSPROD : Logical unit of work for transaction TPSL has been backed out; Distributed Transaction Service (TRAN) reason ENC-tra-1025: A client (not the transaction service) abortedIBM Software Group TXSeries for Multiplatforms一些Communications error code的含义15a00002/15a001024 原因之一：远端域宕机，或者网络不通

16、4 原因之二：在本地TD:timeout超时，远端交易还在队列4 LINK返回SysIdErr15a00007/a00001004 Connection failed4 原因之一：在本地TD:timeout超时，远端交易还在运行4 LINK返回TermErr4 #注：在cics_eci.h中说明了所有主码为15a00007的解释。15a00007/84b60314 Transaction unavailable4 原因之一：RD:MaxTClassLim引起的Reject4 LINK返回TermErr15a00007/86400004 Remote Transaction Abend4 引发本

17、地交易肯定AbendIBM Software Group TXSeries for Multiplatforms.env示例示例IBM Software Group TXSeries for Multiplatforms 2006 IBM CorporationVersion 112-May-2006Dump和Traceback文件IBM Software Group TXSeries for MultiplatformsCICS Dump 内容 Transaction Dump4将内存写入 Dump 文件中 System Dump4上一次 CICS 命令执行的细节4每一笔交易的执行细节4Re

18、gion 的在 Dump 当时的配置4非交易类进程的情况, 例如 recovery server4Encina Client 的信息4所有 Enabled CICS Trace 信息IBM Software Group TXSeries for MultiplatformsCICS Dump 文件 目录4RD.DumpName缺省为 dumps4RD.CoreDumpName缺省为 dir1 文件名4AAAANNNN.dmpmm AAAA - ASRA, ASRB, SYSA, SHUT, SNAP, dump code, abend code NNNN 序列号 mm 文件序号, 如果文件太大

19、, 自动被切成多个, 用 01, 02 标记IBM Software Group TXSeries for MultiplatformsCICS Dump 设置方法nono不生成任何 Dumpnoyes在以下情况异常终止异常shutdownCEMT PERFORM SNAP生成 System Dumpyesnonono仅生成 Transaction Dump, 不含 ASRA 和 ASRByesno为 ASRA 生成 Transaction Dumpyesno为 ASRB 生成 Transaction Dumpyesyesyes为 ASRA 生成 System Dumpyesyesyes为 A

20、SRB 生成 System DumpIBM Software Group TXSeries for MultiplatformsCICS Dump 的设置 离线设置4TD.TransDump4RD.SysDump4RD.PCDump4RD.ABDump 在线设置4CEMT INQUIRE/SET DUMP4CEMT INQUIRE/SET DUMPOPTIONs User Exit4Dump Request User Exit (UE052017)IBM Software Group TXSeries for Multiplatforms生成 CICS Dump Transaction Dum

21、p4 EXEC CICS DUMP4 EXEC CICS ABEND4 CECI DUMP4 CECI ABEND4 交易异常终止, 包含 ASRA 和 ASRB System Dump4 系统异常终止4 CICS shutdown4 CEMT PERFORM SNAP4 ASRA4 ASRBIBM Software Group TXSeries for MultiplatformsCICS Dump 转换工具IBM Software Group TXSeries for MultiplatformsCICS Dump 格式Dump Start Message* CICS DUMP DETAI

22、LS (InfDU) *HeaderDump File Name= SNAP0001.dmpDump Reason = CEMT PERFORM SNAP issuedDate dump created= 12/08/01Time dump created= 20:23:16Module Service Levels(#)super, 16:08:18, Dec 15 1999, s430-L991025-I(#)conco, 15:40:00, Dec 15 1999, s430-L991025-I(#)conti, 15:43:14, Dec 15 1999, s430-L991025-I

23、(#)comrl, 15:52:50, Dec 15 1999, s430-L991025-IDetail For Each ModuleRegion configurationRegion Pool StorageRegion Control AreaInterval Control AreaCICS Module Control AreaCICS TraceRD.TransDumpTrace = yesDump Complete Message* CICS DUMP COMPLETE (InfDU) *IBM Software Group TXSeries for Multiplatfor

24、msCICS Dump Region Config RD* DATABASE CLASS MODULE (RegDC) *DUMP START FOR CLASS RERuntime database for Class RDBuffer Address = 0 x38e153f4.RegRE IEntry: .Name of the default user identifier = CICSUSER CICS Release Number = 0430 Region system identifier (short name) = ISC0 Region application ident

25、ifier (long name) = CICSRGN Minimum number of Application Servers to maintain = 1Maximum number of Application Servers to maintain = 5Region Pool Storage Size (bytes) = 2097152Task-private Storage Size (bytes) = 1048576Task Shared Pool Storage Size (bytes) = 1048576Threshold for Region Pool short on

26、 storage (%age) = 90Threshold for TSH Pool short on storage (%age) = 90Number of Task Shared Pool Address Hash Buckets = 512 .IBM Software Group TXSeries for MultiplatformsCICS Dump Region Config TD* DATABASE CLASS MODULE (RegDC) *DUMP START FOR CLASS TRRuntime database for Class TDBuffer Address =

27、0 x38e15400.RegTR IEntry: .Resource key buffer = THLOGroup to which resource belongs = SamplesActivate the resource at cold start? = yesResource description = Transaction DefinitionType of RSL Checks = noneType of TSL Checks = internalFirst program name = PHELLO .IBM Software Group TXSeries for Mult

28、iplatformsCICS Dump Region Config PD* DATABASE CLASS MODULE (RegDC) *DUMP START FOR CLASS PRRuntime database for Class PDBuffer Address = 0 x38e153f0.RegPR IEntry: .Resource key buffer = PHELLO Group to which resource belongs = Samples Activate resource at cold start? = yesResource description = Pro

29、gram Definition Number of updates = 0Protect resource from modifications? = FALSEProgram path name = E:TXSeriesCICS_SamplesExercise_BMS/HelloProgram type = program .IBM Software Group TXSeries for MultiplatformsCICS Dump Region Config UD* DATABASE CLASS MODULE (RegDC) *DUMP START FOR CLASS USRuntime

30、 database for Class UDBuffer Address = 0 x38e1540c.RegUS IEntry:Resource key buffer = CICSUSER Transaction Level Security Key List = 0000000100000000Resource Level Security Key List = 00000000DCE principal of the user = CICSUSER User priority = 0Encrypted password = .RegUS IEntry:Resource key buffer

31、 = TESTUSER Transaction Level Security Key List = 0000000100000000Resource Level Security Key List = 00000000DCE principal of the user = TESTUSER User priority = 0Encrypted password = SgJAEYVDLJQIBM Software Group TXSeries for MultiplatformsCICS Dump Transaction Scheduler* SCHEDULER MODULE (ConTS) *

32、ConTS private RCA Data:Class Table:Class 0 tasks: waiting = 0active = 1max,lim = n/a,n/aClass 1 tasks: waiting = 0active = 0max,lim = 1,0Class 2 tasks: waiting = 0active = 0max,lim = 1,0.Application Servers: Min = 1, Current = 3, Max = 5Server Idle Time (seconds) = 3600Idle Application Server Queue:

33、Anchor = 0 x70000994, First = 0 x700a62fc, Last = 0 x700a62a0Waiting Tasks Queue:Anchor = 0 x70000828, First = 0 x70000828, Last = 0 x70000828Running Tasks Queue:Anchor = 0 x70000820, First = 0 x700a21bc, Last = 0 x700a21bcList of idle application servers:Server Number 102.Server Number 101.List of

34、Running transactions:Task No = 71, Tran Id = CEMT, User Id = , Device Id = App Server = 105, State = Running, Class = 0, Priority = 255IBM Software Group TXSeries for MultiplatformsCICS Dump Task Control AreaTask Control Area Header:AIX process ID= 2520Application Server ID= 105.Task Control Area Ta

35、sk specific part:User Name= CICSUSERTCA Force Purge flag ?= FALSETCA Purge flag ?= FALSEReturnTran ?= FALSEUserMode ?= FALSE(若 TRUE, 出错一定在用户代码中, 需要进一步调试程序)(若 FALSE, 出错可能是应用程序调用 CICS API 不当引起).EXEC Interface Block:= CICS EIB structure =EIBTIME : Time task started = Ox0202308CEIBDATE : Date task start

36、ed= Ox0101224CEIBTRNID : Transaction ID= CEMTEIBRCODE : Response Code= Ox000000000000.IBM Software Group TXSeries for MultiplatformsCICS Dump Control ModuleProgram Control Information:Program Name= DFHCEMTValue of Resident attribute= NoProgram full path name= C:optcicsbinDFHCEMT.dllProgram Data:Buff

37、er Address= 0 x3815e000Offset 0 1 2 3 4 5 6 7 8 9 A B C D E F ASCII EBCDIC - -0000 00000000 00000000 6300FFFF 00000000 .c. .0010 00000000 00000020 01000100 00000000 . . . 00000000 . 4 lines of zeros suppressed.EXEC CICS command string:Buffer Address = 0 x127044EXEC CICS GETMAINSET (X00128110)FLENGTH

38、 (9200)INITIMG (0)NOHANDLEIBM Software Group TXSeries for Multiplatforms通过 Dump 寻找应用错误 (AIX Only) 加编译开关4cicstcl s或CCFLAGS = “-qlist”4会在编译后生成 *.lst 文件 设置 RD 属性4RD.ABDump = no或： CEMT SET DUMPOPTIONS NOABABEND4RD.PCDump = no或：CEMT SET DUMPOPTIONS NOPCABEND 设置 TD属性4TD.TransDump = yes 交易出错时生成 Transaction

39、 Dump4/var/cics_regions/region/dumps/dir1/AAAANNNN.dmpmm4/var/cics_regions/region/dumps/dir1/cicsASPID.tracebackIBM Software Group TXSeries for Multiplatforms通过 Dump 寻找应用错误 (AIX Only) 格式化 Dump 文件4cicsdfmt r AAAANNNN.dmpmm AAAANNNN.dmpmm.txt4注意, 不同平台上的 Dump 文件不一定可以相互做格式化 例如 AIX 上的 Dump 文件在 NT 上不能做 ci

40、csdfmt 在 txt 中查找调用堆栈, 找到出错点 对照 *.lst 文件, 找到出错代码行 对照 *.c 文件, 找到出错代码IBM Software Group TXSeries for Multiplatforms寻找错误 (AIX Only) SampleERZ052004I/0602 09/05/01 04:44:12 CICSRGN GPAC: Dump to ASRA0006.dmp started.ERZ052007I/0604 09/05/01 04:44:12 CICSRGN GPAC: Dump to ASRA0006.dmp completed.ERZ014016E

41、/0028 09/05/01 04:44:12 CICSRGN GPAC: Transaction TDPU, Abend ASRA, at GPAC.ERZ015028W/0154 09/05/01 04:44:12 CICSRGN GPAC: Exception in user application code - exception string is: exc_e_illaddrERZ016050W/0234 09/05/01 04:44:12 CICSRGN GPAC: Logical unit of work for transaction TDPU has been backed

42、 out; Distributed Transaction Service (TRAN) reason ENC-tra-1025: A client (not the transaction service) abortedIBM Software Group TXSeries for Multiplatforms寻找错误 (AIX Only) Sample* START OF TRANSACTION DUMP * Application Server id = 102 Transaction Id = TDPU User Name = CICSUSERDetails of function

43、being executed: 0 x2ff1e8c0 Function Name = main Service Level = Offset of current instruction = 0 x1e8 Called by function = PinCA_StartC from offset = 0 x148 Called by function = TasPR_CallApplication from offset = 0 x404 Called by function = TasPR_RunProgram from offset = 0 x11d8.IBM Software Grou

44、p TXSeries for Multiplatforms寻找错误 (AIX Only) Sample. 79 | CL.2: 84 | 0001CC lwz 8062000C 1 L4A gr3=._iob(gr2,0) 84 | 0001D0 addi 38630040 2 AI gr3=gr3,64 84 | 0001D4 addi 389F0064 1 AI gr4=gr31,100 84 | 0001D8 bl 4BFFFE29 0 CALL gr3=fprintf,2,gr3,gr4,fprintf,. 84 | 0001DC ori 60000000 1 86 | 0001E0

45、lwz 8061004C 0 L4A gr3=pStringBuffer(gr1,76) 86 | 0001E4 addi 389F0078 1 AI gr4=gr31,120 86 | 0001E8 lswi 7CA4F4AA 4 LSI gr5-gr12=+CONSTANT_AREA(gr4,0), 30 86 | 0001EC stswi 7CA3F5AA 4 STSI #MEMORY(gr3,0)=30,gr5-gr12,mq 87 | 0001F0 lwz 80610048 1 L4A gr3=pCommArea(gr1,72) 87 | 0001F4 lwz 8081004C 0

46、L4A gr4=pStringBuffer(gr1,76) 87 | 0001F8 bl 4BFFFE09 0 CALLN gr3,#MEMORY=strcpy,. 87 | 0001FC ori 60000000 1 92 | 000200 lwz 83C20008 0 L4A gr30=.$STATIC_BSS(gr2,0) 92 | 000204 addis 3C602000 1 LIU gr3=8192IBM Software Group TXSeries for Multiplatforms寻找错误 (AIX Only) Sample21 void main ()22 24 long

47、 lRespCode;25 char * pCommArea;26 char * pStringBuffer = 0;29 EXEC CICS ADDRESS EIB (dfheiptr) RESP (lRespCode); .57 EXEC CICS ADDRESS COMMAREA (pCommArea) RESP (lRespCode); .84 fprintf (stderr, CommArea = %sn);8586 strcpy (pStringBuffer, Transaction Dump in USER code);87 strcpy (pCommArea, pStringB

48、uffer);90 EXEC CICS RETURN;98 IBM Software Group TXSeries for MultiplatformsTraceback文件 CICS produces traceback files when an application or CICS internal code raises an illegal exception (SigSEGV, SigILL). Traceback Files are generated under the directory /var/cics_regions/dumps/dir1 The generated

49、traceback file will have a filename cics.traceback where : pid is the process id which has generated traceback.IBM Software Group TXSeries for MultiplatformsTraceback文件信息举例-Stack Traceback- PID = 32782, TID = 19 - Function strlen Offset = 00948 - Function main Offset = 01047 - Function PinCA_StartC

50、Offset = 01D06 - Function TasPR_CallApplication Offset = 05085 - Function TasPR_RunProgram Offset = 14D84 - Function TasPR_IRun Offset = 1FEC3 - Function TasTA_Exec Offset = 1CA02 - Function TasTA_Run Offset = 1C281 - Function main Offset = 0B680 - Function _start Offset = 0088 IBM Software Group TX