Presentation is loading. Please wait.

Presentation is loading. Please wait.

B7: Caring for an Ailing AppServer Diego Canziani Senior Technical Support Engineer.

Similar presentations


Presentation on theme: "B7: Caring for an Ailing AppServer Diego Canziani Senior Technical Support Engineer."— Presentation transcript:

1 B7: Caring for an Ailing AppServer Diego Canziani Senior Technical Support Engineer

2 © 2008 Progress Software Corporation 2 Agenda Anatomy of the AppServer Diagnosing Problems Help Treating your AppServer AppServer Broker ClientsClients AgentsAgents Agent clien t Listening Port

3 © 2008 Progress Software Corporation 3 Anatomy of the AppServer What is the OpenEdge ® AppServer?

4 © 2008 Progress Software Corporation 4 Anatomy of the AppServer Broker Java TM process Handles communication from clients to agents Manages client and agent pools Writes to.broker.log Or What is the Progress ® AppServer?.broker.log

5 © 2008 Progress Software Corporation 5 Anatomy of the AppServer Agent C process Handles requests and replies to the clients Communicates STATUS to broker Writes to.server.log Or What is the Progress AppServer?.server.log

6 © 2008 Progress Software Corporation 6 Anatomy of the AppServer State-aware State-reset Stateless State-free 4 Operating Modes One to one Many to few - Default

7 © 2008 Progress Software Corporation 7 Anatomy of the AppServer Client to Broker gets redirected to Agent State-aware State-reset Client to Agent through the Broker Stateless State-free 2 Connection Models

8 © 2008 Progress Software Corporation 8 Anatomy of the AppServer 2 Connection Models State-aware State-reset clien t AppServer Broker Agent 2 Connection Models Stateless State-free

9 © 2008 Progress Software Corporation 9 Anatomy of the AppServer AppServer Broker Thread Pools AppServer Broker Listening Thread L-3090 Client Threads C-0001 C-0002 C-0003 C-0004 C-0005 C-0006 … Server Threads S-0001 S-0002 S-0003 S-0004 S-0005

10 © 2008 Progress Software Corporation 10 Anatomy of the AppServer Broker communication with Agents Broker starts agent and waits for agent to respond, status set to: STARTING Once started the agent reports to broker and broker sets status to: AVAILABLE Client request agent, is redirected to agent port, broker sets status to: CONNECTING Client connects to agent, agent reports to broker, broker sets status to: CONNECTED Agent completes request, notifies broker, broker sets status to: AVAILABLE

11 © 2008 Progress Software Corporation 11 Anatomy of the AppServer P T AS AS Application Server connected with connection id: ::asbroker1::3090::b0d80cae72::1191a17d1f0:-7ffc. (8358) P T AS 4GLTRACE Run performCardAuth "John Doe Visa -H localhost -S 6789" [Main Block - authcard.p] P T AS 4GLTRACE Run connectAuthSvc "-H localhost -S 6789 " [performCardAuth - authcard.p] P T AS 4GLTRACE Run createAuthMsg "John Doe Visa " [performCardAuth - authcard.p] P T AS 4GLTRACE Run sendAuthMsg "1000 Name=John Doe;Number= ;Type=Visa " [performCardAuth - authcard.p] P T AS 4GLTRACE Run disconnectAuthSvc "1000" [performCardAuth - authcard.p] P T AS AS Application Server disconnected. (8360) Reading Log Files P T AS AS Application Server connected with connection id: : :asbroker1::3090::b0d80cae72::1191a17d1f0:-7ffc. (8358) AS 4GLTRACE Run connectAuthSvc -H localhost -S 6789 [performCardAuth - authcard.p]

12 © 2008 Progress Software Corporation 12 Anatomy of the AppServer AdminServer - Required JAVA process Manages all OpenEdge Brokers and Servers Writes to admserv.log NameServer - Optional JAVA process Traffic manager from clients to AppServers Writes to.ns.log Supporting Processes

13 © 2008 Progress Software Corporation 13 Agenda Anatomy of the AppServer Diagnosing Problems Help Treating your AppServer

14 © 2008 Progress Software Corporation 14 Diagnosing Problems $DLC/bin/asbman -name asbroker1 -start OpenEdge Release 10.1C01 as of Fri May 9 21:58:30 EDT 2008 Connecting to Progress AdminServer using rmi://localhost:20931/Chimera (8280) Searching for asbroker1 (8288) Connecting to asbroker1 (8276) Unable to start asbroker1 (8297) Startup Problems

15 © 2008 Progress Software Corporation 15 Diagnosing Problems ===================================================================== P T-Main /usr1/stat/progress/101c/wrk/asbroker1.broker.log opened. P T-Main Logging level set to =2 P T-Main Log entry types activated: P T-Main 2 UB Basic ubroker version: v101c (07-May-08) (8038) P T-L UB Basic Started listenerthread: L (8043) P T-L UB Could not listen on port: 9090 (8044) P T-L UB java.net.BindException: Address already in use (errno:226) P T-L UB at java.net.PlainSocketImpl.socketBind(Native Method) P T-L UB at java.net.PlainSocketImpl.bind(PlainSocketImpl.java:359) P T-L UB at java.net.ServerSocket.bind(ServerSocket.java:325) P T-L UB at java.net.ServerSocket. (ServerSocket.java:186) Startup Problems -.broker.log

16 © 2008 Progress Software Corporation 16 Diagnosing Problems $DLC/bin/asbman -name asbroker1 -start Connecting to Progress AdminServer using rmi://localhost:20931/Chimera (8280) Searching for asbroker1 (8288) Connecting to asbroker1 (8276) Starting asbroker1. Check status. (8296) $DLC/bin/asbman -name asbroker1 -query Connecting to Progress AdminServer using rmi://localhost:20931/Chimera (8280) Searching for asbroker1 (8288) Connecting to asbroker1 (8276) Broker: asbroker1 not running (8313) Startup Problems

17 © 2008 Progress Software Corporation 17 Diagnosing Problems P T-S UB Basic Started server: /usr1/stat/progress/101c/dlc/bin/_proapsv -logginglevel 2 -logfile /usr1/stat/progress/101c/wrk/asbroker1.server.log -ubpid 435 -Ms 1 -logname asbroker1 -logentrytypes ASPlumbing,DB.Connects - logthreshold 0 -numlogfiles 3 -ASID 4 –ubpropfile /usr1/stat/progress/101c/dlc/properties/ubroker.properties -svrefresh - ipver IPv4 -db mydatabase (8108) P T-S UB Message from server : Startup Procedure Failed (8113) P T-S UB IOException reading message from server : java.io.EOFException: pipe to server broken (8117) P T-S UB Basic ERROR: cannot start server. (8100) Startup Problems -.broker.log

18 © 2008 Progress Software Corporation 18 Diagnosing Problems P T AS -- ** There is no server active for database mydatabase on -H cruz -S (704) P T AS -- Error initializing the application server. (5479) P T AS AS Application Server Shutdown. (5476) P T AS -- ** There is no server active for database mydatabase on -H cruz -S (704) P T AS -- Error initializing the application server. (5479) P T AS AS Application Server Shutdown. (5476) Startup Problems -.server.log

19 © 2008 Progress Software Corporation 19 Diagnosing Problems P T AS AS Starting application server for asbroker1. (5560) P T AS AS Application Server Startup. (5473) P T AS -- C:\tmp\ex08\roy\eg1\asstart.r Database sports2000 not connected. (1006) P T AS -- C:\tmp\ex08\roy\eg1\asstart.r startup procedure ended with an ERROR condition. (8025) P T AS AS Application Server Shutdown. (5476) Startup Problems -.server.log

20 © 2008 Progress Software Corporation 20 Diagnosing Problems All INITIAL agents must start or the AppServer will fail to start Set initial agents to start to zero –initialSrvrInstance=0 in ubroker.properties (IPv6 enabled on a machine can cause agents not to communicate with broker) Add –Djvmstart.debug=1 to the jvmargs= in AdminServerPlugins.properties View $WRKDIR/jvmStart.log file Startup Problems

21 © 2008 Progress Software Corporation 21 Diagnosing Problems Broker Name : asbroker1 Operating Mode : State-reset Broker Status : ACTIVE Broker Port : 3090 Broker PID : Active Servers : 5 Busy Servers : 0 Locked Servers : 0 Available Servers : 5 Active Clients (now, peak) : (0, 6) Client Queue Depth (cur, max) : (0, 11) Total Requests : 124 Rq Wait (max, avg) : (259 ms, 11 ms) Rq Duration (max, avg) : (5543 ms, 24 ms) PID State Port nRq nRcvd nSent Started Last Change CONNECTED May 19, :28 May 19, : AVAILABLE May 19, :28 May 19, : AVAILABLE May 19, :28 May 19, : CONNECTED May 19, :28 May 19, : AVAILABLE May 19, :28 May 19, :28 Phantom Agents

22 © 2008 Progress Software Corporation 22 Diagnosing Problems ps -ef | grep _proapsv statqa :28:47 ? 0:24 /usr1/stat/progress/101c/dlc/bin/_proapsv -logginglevel 2 -logf statqa :28:46 ? 0:56 /usr1/stat/progress/101c/dlc/bin/_proapsv -logginglevel 2 -logf statqa :28:45 ? 0:55 /usr1/stat/progress/101c/dlc/bin/_proapsv -logginglevel 2 –log Phantom Agents protrace protrace.25322

23 © 2008 Progress Software Corporation 23 Diagnosing Problems Look at log files.broker.log.server.log Database log files where agent is connected Increase logging levels srvrLoggingLevel=4 (extended) srvrLogEntryTypes=4GLTrace –UBNet - New for 10.1C Diagnosing Application problems

24 © 2008 Progress Software Corporation 24 Diagnosing Problems Broker Name : asbroker1 Operating Mode : Stateless Broker Status : ACTIVE Broker Port : 3090 Broker PID : Active Servers : 1 Busy Servers : 0 Locked Servers : 0 Available Servers : 1 Active Clients (now, peak) : (0, 1) Client Queue Depth (cur, max) : (0, 1) Total Requests : 11 Rq Wait (max, avg) : (11 ms, 11 ms) Rq Duration (max, avg) : (24 ms, 11 ms) PID State Port nRq nRcvd nSent Started Last Change SENDING Apr 4, :40 Apr 4, :41 Hanging Agents

25 © 2008 Progress Software Corporation 25 Diagnosing Problems P T AS AS Application Server connected with connection id: ::asbroker1::3090::b0d80cae72::1191a17d1f0:-7ffc. (8358) P T AS 4GLTRACE Run performCardAuth "John Doe Visa -H localhost -S 6789" [Main Block - authcard.p] P T AS 4GLTRACE Run connectAuthSvc "-H localhost -S 6789 " [performCardAuth - authcard.p] P T AS 4GLTRACE Run createAuthMsg "John Doe Visa " [performCardAuth - authcard.p] P T AS 4GLTRACE Run sendAuthMsg "1000 Name=John Doe;Number= ;Type=Visa " [performCardAuth - authcard.p] P T AS 4GLTRACE Run disconnectAuthSvc "1000" [performCardAuth - authcard.p] P T AS AS Application Server disconnected. (8360) Diagnosing Agent problems

26 © 2008 Progress Software Corporation 26 Agenda Anatomy of the AppServer Diagnosing Problems Help Treating your AppServer

27 © 2008 Progress Software Corporation 27 Help Treating your AppServer -query Get status and history of AppServer broker and agents -kill Shutdown an AppServer with busy or hanging agents May need to run twice in a row asbman

28 © 2008 Progress Software Corporation 28 Help Treating your AppServer Available on PSDN ABL source code available Read and Sort multiple log files Unsupported LogRead

29 © 2008 Progress Software Corporation 29 Help Treating your AppServer Dont connect using the startup parameters Any database down to a single database will cause your AppServer agents to be unresponsive Connect using the CONNECT call in the srvrStartupProc= srvrConnectProc= srvrActivateProc= Use IF CONNECTED ABL Database Connections

30 © 2008 Progress Software Corporation 30 Help Treating your AppServer New in 10.1B Described in ubroker.properties.README Read the CAUTION! Use only when directed by Tech Support Periodically force the shutdown of all agents and allow new agents to start when requested Lifespan

31 © 2008 Progress Software Corporation 31 Help Treating your AppServer OpenEdge Management

32 © 2008 Progress Software Corporation 32 D I S C L A I M E R Under Development The next slide includes information about potential future products and/or product enhancements. What I am going to say reflects our current thinking, but the information contained herein is preliminary and subject to change. Any future products we ultimately deliver may be materially different from what is described here. D I S C L A I M E R

33 © 2008 Progress Software Corporation 33 Help Treating your AppServer New in 10.2A Described in ubroker.properties.README List of all clients known to the AppServer, includes: Host/IP Port Connected Agent More! List AppServer Connections

34 © 2008 Progress Software Corporation 34 Help Treating your AppServer Technical Support Knowledge Base (kbase) PSDN Help from Progress

35 © 2008 Progress Software Corporation 35 AppServer Broker In Summary Understand your AppServer Diagnose your Problem Care for your Ailing AppServer Agent clien t Listening Port ClientsClients AgentsAgents

36 © 2008 Progress Software Corporation 36 Questions ?

37 © 2008 Progress Software Corporation 37 Thank You

38 © 2008 Progress Software Corporation 38


Download ppt "B7: Caring for an Ailing AppServer Diego Canziani Senior Technical Support Engineer."

Similar presentations


Ads by Google