dynamips icon indicating copy to clipboard operation
dynamips copied to clipboard

Console hangs up when trying to connect to 7200 router that was stopped/started in GNS3

Open brezular opened this issue 12 years ago • 3 comments

IOS: 12.4-24T5 (tested few IOSs with the same results Dynamips 0.2.8RC7 (I noticed the problem above version 0.2.8RC3 - included) GNS3 0.8.4-RC4

Problem can by reproduced anytime. Just stop 7206VXR router and start it again and try to connect to the console of the router. The bug is 7200 specific, other models run ok. Seems that bug is presented for all 7200 IOS. Problem is also described here:

http://forum.gns3.net/topic5022.html

This is the log:

GNS3 management console. Running GNS3 version 0.8.4-RC4. Copyright (c) 2006-2013 GNS3 Project.

=> 11:35:51: DEBUG (1): PORT TRACKER: registering additional local address 127.0.0.1 11:35:51: DEBUG (1): PORT TRACKER: registering additional local address ::1 11:35:51: DEBUG (1): PORT TRACKER: registering additional local address 192.168.0.153 11:35:51: DEBUG (1): PORT TRACKER: registering additional local address FE80::6A5D:43FF:FEAD:AFC5%wlan0 11:35:51: DEBUG (1): PORT TRACKER: registering additional local address 192.168.122.1 11:36:08: DEBUG (2): Running config: {} 11:36:08: DEBUG (2): Convert path /home/brezular/GNS3-work/test-dynamips2/configs to a relative path : configs 11:37:04: DEBUG (2): Use image: 127.0.0.1:/home/brezular/Downloads/GNS3-files/IOS/Unpacked-ios/c7200-adventerprisek9-mz.124-24.T5.bin.unpacked 11:37:04: DEBUG (2): Set default RAM: 512 11:37:04: DEBUG (2): Starting Dynamips with -H 7200 (old way with Dynamips version 0.2.8-RC3 and before) 11:37:04: DEBUG (2): Hypervisor manager: connecting on 127.0.0.1:7200 11:37:05: DEBUG (2): Hypervisor manager: connected to hypervisor on 127.0.0.1 port 7200 11:37:05: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> hypervisor version 11:37:05: DEBUG (1): returned -> ['100-0.2.8-RC3-amd64'] 11:37:05: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> hypervisor reset 11:37:05: DEBUG (1): returned -> ['100-OK'] 11:37:05: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> hypervisor working_dir "/home/brezular/GNS3-work" 11:37:05: DEBUG (1): returned -> ['100-OK'] 11:37:05: DEBUG (2): Hypervisor manager: create a new hypervisor on 127.0.0.1 port 7200 11:37:05: DEBUG (2): Hypervisor manager: hypervisor base UDP is 10000 11:37:05: DEBUG (2): Set image /home/brezular/Downloads/GNS3-files/IOS/Unpacked-ios/c7200-adventerprisek9-mz.124-24.T5.bin.unpacked 11:37:05: DEBUG (2): Set idlemax 1500 11:37:05: DEBUG (2): Set idlesleep 30 11:37:05: DEBUG (2): Enable mmap 11:37:05: DEBUG (2): Enable sparse memory 11:37:05: DEBUG (2): Enable Ghost IOS 11:37:05: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> vm create R1 0 c7200 11:37:05: DEBUG (1): returned -> ["100-VM 'R1' created"] 11:37:05: DEBUG (1): PORT TRACKER: allocate port 2001 11:37:05: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> vm set_con_tcp_port R1 2001 11:37:05: DEBUG (1): returned -> ['100-OK'] 11:37:05: DEBUG (1): PORT TRACKER: allocate port 2501 11:37:05: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> vm set_aux_tcp_port R1 2501 11:37:05: DEBUG (1): returned -> ['100-OK'] 11:37:05: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> c7200 set_npe R1 npe-400 11:37:05: DEBUG (1): returned -> ['100-OK'] 11:37:05: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> vm set_ios R1 "/home/brezular/Downloads/GNS3-files/IOS/Unpacked-ios/c7200-adventerprisek9-mz.124-24.T5.bin.unpacked" 11:37:05: DEBUG (1): returned -> ["100-IOS image set for 'R1'"] 11:37:05: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> vm set_ram R1 512 11:37:05: DEBUG (1): returned -> ['100-OK'] 11:37:05: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> vm set_sparse_mem R1 1 11:37:05: DEBUG (1): returned -> ['100-OK'] 11:37:05: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> vm set_ghost_status R1 2 11:37:05: DEBUG (1): returned -> ['100-OK'] 11:37:05: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> vm set_ghost_file R1 "c7200-adventerprisek9-mz.124-24.T5.bin.unpacked-127.0.0.1.ghost" 11:37:05: DEBUG (1): returned -> ['100-OK'] 11:37:05: DEBUG (2): Router R1 created 11:37:05: DEBUG (2): Applying IOS base config baseconfig.txt 11:37:05: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> vm push_config R1 IQohCmhvc3RuYW1lIFIxCiEKbm8gaXAgZG9tYWluIGxvb2t1cApubyBpcCBpY21wIHJhdGUtbGltaXQgdW5yZWFjaGFibGUKaXAgdGNwIHN5bndhaXQgNQohCmxpbmUgY29uIDAKIGV4ZWMtdGltZW91dCAwIDAKIGxvZ2dpbmcgc3luY2hyb25vdXMKIHByaXZpbGVnZSBsZXZlbCAxNQogbm8gbG9naW4KbGluZSBhdXggMAogZXhlYy10aW1lb3V0IDAgMAogbG9nZ2luZyBzeW5jaHJvbm91cwogcHJpdmlsZWdlIGxldmVsIDE1CiBubyBsb2dpbgohCiEKZW5kCg== 11:37:05: DEBUG (1): returned -> ["100-IOS config file pushed tm VM 'R1'"] 11:37:05: DEBUG (2): Running config: {'autostart': False, u'127.0.0.1:7200': {'workingdir': u'/home/brezular/GNS3-work', 'udp': 10000, '7200': {'image': u'/home/brezular/Downloads/GNS3-files/IOS/Unpacked-ios/c7200-adventerprisek9-mz.124-24.T5.bin.unpacked', 'ram': 512, 'sparsemem': True, 'ghostios': True}, 'ROUTER R1': {'console': 2001, 'aux': 2501}}} 11:37:12: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> vm create "ghost-c7200-adventerprisek9-mz.124-24.T5.bin.unpacked-127.0.0.1.ghost" 1 c7200 11:37:12: DEBUG (1): returned -> ["100-VM 'ghost-c7200-adventerprisek9-mz.124-24.T5.bin.unpacked-127.0.0.1.ghost' created"] 11:37:12: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> vm set_ios "ghost-c7200-adventerprisek9-mz.124-24.T5.bin.unpacked-127.0.0.1.ghost" "/home/brezular/Downloads/GNS3-files/IOS/Unpacked-ios/c7200-adventerprisek9-mz.124-24.T5.bin.unpacked" 11:37:12: DEBUG (1): returned -> ["100-IOS image set for 'ghost-c7200-adventerprisek9-mz.124-24.T5.bin.unpacked-127.0.0.1.ghost'"] 11:37:12: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> c7200 set_npe "ghost-c7200-adventerprisek9-mz.124-24.T5.bin.unpacked-127.0.0.1.ghost" npe-400 11:37:12: DEBUG (1): returned -> ['100-OK'] 11:37:12: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> vm set_ghost_status "ghost-c7200-adventerprisek9-mz.124-24.T5.bin.unpacked-127.0.0.1.ghost" 1 11:37:12: DEBUG (1): returned -> ['100-OK'] 11:37:12: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> vm set_ghost_file "ghost-c7200-adventerprisek9-mz.124-24.T5.bin.unpacked-127.0.0.1.ghost" c7200-adventerprisek9-mz.124-24.T5.bin.unpacked-127.0.0.1.ghost 11:37:12: DEBUG (1): returned -> ['100-OK'] 11:37:12: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> vm set_ram "ghost-c7200-adventerprisek9-mz.124-24.T5.bin.unpacked-127.0.0.1.ghost" 512 11:37:12: DEBUG (1): returned -> ['100-OK'] 11:37:12: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> vm start "ghost-c7200-adventerprisek9-mz.124-24.T5.bin.unpacked-127.0.0.1.ghost" 11:37:14: DEBUG (1): returned -> ["101 Warning: no console port defined for VM 'ghost-c7200-adventerprisek9-mz.124-24.T5.bin.unpacked-127.0.0.1.ghost'", "100-VM 'ghost-c7200-adventerprisek9-mz.124-24.T5.bin.unpacked-127.0.0.1.ghost' started"] 11:37:14: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> vm stop "ghost-c7200-adventerprisek9-mz.124-24.T5.bin.unpacked-127.0.0.1.ghost" 11:37:14: DEBUG (1): returned -> ["100-VM 'ghost-c7200-adventerprisek9-mz.124-24.T5.bin.unpacked-127.0.0.1.ghost' stopped"] 11:37:14: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> vm delete "ghost-c7200-adventerprisek9-mz.124-24.T5.bin.unpacked-127.0.0.1.ghost" 11:37:14: DEBUG (1): returned -> ["100-VM 'ghost-c7200-adventerprisek9-mz.124-24.T5.bin.unpacked-127.0.0.1.ghost' deleted"] 11:37:14: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> vm start R1 11:37:14: DEBUG (1): returned -> ["100-VM 'R1' started"] 11:37:21: DEBUG (2): Start console program /usr/bin/konsole -p tabtitle=R1 -e telnet 127.0.0.1 2001 >/dev/null 2>&1 & 11:37:21: DEBUG (2): R1 has 1 terminal program(s) connected to itself 11:37:27: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> vm stop R1 11:37:28: DEBUG (1): returned -> ["100-VM 'R1' stopped"] 11:37:33: DEBUG (1): sending to dynamips at 127.0.0.1:7200 -> vm start R1 11:37:34: DEBUG (1): returned -> ["100-VM 'R1' started"] 11:37:40: DEBUG (2): Start console program /usr/bin/konsole -p tabtitle=R1 -e telnet 127.0.0.1 2001 >/dev/null 2>&1 & 11:37:40: DEBUG (2): R1 has 1 terminal program(s) connected to itself

[brezular@K55VM ~]$ netstat -ne | grep 7200 tcp 0 0 127.0.0.1:37372 127.0.0.1:7200 ESTABLISHED 0 242998
tcp 1 0 127.0.0.1:7200 127.0.0.1:37371 CLOSE_WAIT 0 241421
tcp 0 0 127.0.0.1:7200 127.0.0.1:37372 ESTABLISHED 0 241424

brezular avatar Jun 21 '13 11:06 brezular

Tried and wasn't able to reproduce with:

  • IOS 12.4-11.T1
  • GNS3 0.8.4 RC4 64-bit standalone (windows)
  • Dynamips 0.2.8 RC7 (cygwin, 32-bit)

I don't have a more recent image so that's it for now

flaviojs avatar Jun 22 '13 15:06 flaviojs

I had the console hanging up with a c3725 IOS image a few times just after booting, the console would not accept any input and usually rebooting the IOS node in GNS3 is enough to pass the problem .

This is a random issue that some users reported on the forum and I think it was introduced with the release of dynamips-community 0.2.8 RC3, lot of code related to the console (actually just a Telnet connection) was changed in this version, all of it is in dev_vtty.c

grossmj avatar Jun 22 '13 16:06 grossmj

I made some more tests with different versions of Dynamips and IOS and these are my findings: IOS: 12.4-11.T1, Dynamips 0.2.8 RC2 and RC7 - problem is not presented. IOS 12.4-24T5, 15.1-4M2, 15.2-4S2, Dynamips 0.2.8 RC2 and RC7 - problem is presented permanently for bith veriosn of Dynamips. I was able to get some output as following:

Trying 127.0.0.1... Connected to 127.0.0.1. Escape character is '^]'. Connected to Dynamips VM "R2" (ID 1, type c7200) - Console port

This product contains cryptographic features and is subject to United States and local country laws governing import, export, transfer and use. Delivery of Cisco cryptographic products does not imply third-party authority to import, export, distribute or use encryption. Importers, exporters, distributors and users are responsible for compliance with U.S. and local country laws. By using this product you agree to comply with applicable laws and regulations. If you are unable to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at: http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to [email protected].

Cisco 7206VXR (NPE400) processor (revision A) with 491520K/32768K bytes of memory. %ALIGN-1-FATAL: Corrupted program counter 21:07:14 UTC Sat Jun 22 2013 pc=0x623A2EDCz , ra=0x623A2E9Cz , sp=0x652E4158

%ALIGN-1-FATAL: Corrupted program counter 21:07:14 UTC Sat Jun 22 2013 pc=0x623A2EDCz , ra=0x623A2E9Cz , sp=0x652E4158

21:07:14 UTC Sat Jun 22 2013: TLB (load or instruction fetch) exception, CPU signal 10, PC = 0x623A2EDC


Possible software fault. Upon recurrence, please collect

crashinfo, "show tech" and contact Cisco Technical Support.

-Traceback= $0 : 00000000, AT : 65800000, v0 : 659F0000, v1 : 00000000 a0 : 00000007, a1 : 7CFFFF60, a2 : 65B16ED8, a3 : 0000000D t0 : 00000020, t1 : 00000038, t2 : 00000000, t3 : 00000038 t4 : 00008000, t5 : FFFF00FF, t6 : 00000000, t7 : 00000000 s0 : 00000000, s1 : 623994F0, s2 : 650E0000, s3 : 650E0000 s4 : 00000001, s5 : 650E0000, s6 : 00000004, s7 : 00000034 t8 : 00000000, t9 : 623C7190, k0 : 65B16ED8, k1 : 00000000 gp : 653BAEC0, sp : 652E4158, s8 : 00000001, ra : 623A2E9C EPC : 623A2EDC, ErrorEPC : 00000000, SREG : 34008003 MDLO : 00001040, MDHI : 00000000, BadVaddr : 00000040 CacheErr : 00000000, DErrAddr0 : 00000000, DErrAddr1 : 00000000 TEXT_START : 0x60008EB0 DATA_START : 0x63C0A000 Cause 00000008 (Code 0x2): TLB (load or instruction fetch) exception

21:07:14 UTC Sat Jun 22 2013: TLB (load or instruction fetch) exception, CPU signal 10, PC = 0x623A2EDC


Possible software fault. Upon recurrence, please collect

crashinfo, "show tech" and contact Cisco Technical Support.

-Traceback= $0 : 00000000, AT : 65800000, v0 : 659F0000, v1 : 00000000 a0 : 00000007, a1 : 7CFFFF60, a2 : 65B16ED8, a3 : 0000000D t0 : 00000020, t1 : 00000038, t2 : 00000000, t3 : 00000038 t4 : 00008000, t5 : FFFF00FF, t6 : 00000000, t7 : 00000000 s0 : 00000000, s1 : 623994F0, s2 : 650E0000, s3 : 650E0000 s4 : 00000001, s5 : 650E0000, s6 : 00000004, s7 : 00000034 t8 : 00000000, t9 : 623C7190, k0 : 65B16ED8, k1 : 00000000 gp : 653BAEC0, sp : 652E4158, s8 : 00000001, ra : 623A2E9C EPC : 623A2EDC, ErrorEPC : 00000000, SREG : 34008003 MDLO : 00001040, MDHI : 00000000, BadVaddr : 00000040 CacheErr : 00000000, DErrAddr0 : 00000000, DErrAddr1 : 00000000 TEXT_START : 0x60008EB0 DATA_START : 0x63C0A000 Cause 00000008 (Code 0x2): TLB (load or instruction fetch) exception File bootflash:crashinfo_20130622-210714-UTC Device Error :Bad device info block File disk0:crashinfo_20130622-210714-UTC Device Error :No such device File disk1:crashinfo_20130622-210714-UTC Device Error :No such device File slot0:crashinfo_20130622-210714-UTC Device Error :Bad device info block File slot1:crashinfo_20130622-210714-UTC Device Error :No such device File bootflash:crashinfo_20130622-210714-UTC Device Error :Bad device info block File disk0:crashinfo_20130622-210714-UTC Device Error :No such device File disk1:crashinfo_20130622-210714-UTC Device Error :No such device File slot0:crashinfo_20130622-210714-UTC Device Error :Bad device info block File slot1:crashinfo_20130622-210714-UTC Device Error :No such device File bootflash:crashinfo_20130622-210714-UTC Device Error :Bad device info block

21:07:14 UTC Sat Jun 22 2013: TLB (load or instruction fetch) exception, CPU signal 10, PC = 0x623A2EDC


Possible software fault. Upon recurrence, please collect

crashinfo, "show tech" and contact Cisco Technical Support.

-Traceback= $0 : 00000000, AT : 65800000, v0 : 659F0000, v1 : 00000000 a0 : 00000007, a1 : 7CFFFF60, a2 : 65B16ED8, a3 : 0000000D t0 : 00000020, t1 : 00000038, t2 : 00000000, t3 : 00000038 t4 : 00008000, t5 : FFFF00FF, t6 : 00000000, t7 : 00000000 s0 : 00000000, s1 : 623994F0, s2 : 650E0000, s3 : 650E0000 s4 : 00000001, s5 : 650E0000, s6 : 00000004, s7 : 00000034 t8 : 00000000, t9 : 623C7190, k0 : 65B16ED8, k1 : 00000000 gp : 653BAEC0, sp : 652E4158, s8 : 00000001, ra : 623A2E9C EPC : 623A2EDC, ErrorEPC : 00000000, SREG : 34008003 MDLO : 00001040, MDHI : 00000000, BadVaddr : 00000040 CacheErr : 00000000, DErrAddr0 : 00000000, DErrAddr1 : 00000000 TEXT_START : 0x60008EB0 DATA_START : 0x63C0A000 Cause 00000008 (Code 0x2): TLB (load or instruction fetch) exception

-Traceback=

brezular avatar Jun 22 '13 16:06 brezular