microarmy icon indicating copy to clipboard operation
microarmy copied to clipboard

Microarmy bails out with 380 instances.

Open coredump opened this issue 12 years ago • 2 comments

Tried to use 380 and 200 instances for a big test, microarmy just stopped during the deploy phase. Instances where created but the command never returned. Manually added the microarmy tag to the created instances and used 'find_cannons', worked. Tried 'deploy' but after a long time got a long list of EOF exception (all the same traceback)

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/eventlet/hubs/hub.py", line 336, in fire_timers
    timer()
  File "/usr/lib/python2.7/site-packages/eventlet/hubs/timer.py", line 56, in __call__
    cb(*args, **kw)
  File "/usr/lib/python2.7/site-packages/eventlet/semaphore.py", line 95, in _do_acquire
    waiter.switch()
  File "/usr/lib/python2.7/site-packages/eventlet/greenthread.py", line 192, in main
    result = function(*args, **kwargs)
  File "/home/coredump/dev/microarmy/microarmy/firepower.py", line 155, in _setup_a_cannon
    ssh_conn = ssh_connect(hostname)
  File "/home/coredump/dev/microarmy/microarmy/communications.py", line 36, in ssh_connect
    transport.connect(username=ec2_ssh_username, pkey=rsa_key)
  File "/usr/lib/python2.7/site-packages/paramiko/transport.py", line 989, in connect
    self.start_client()
  File "/usr/lib/python2.7/site-packages/paramiko/transport.py", line 461, in start_client
    raise e
EOFError

coredump avatar May 29 '12 23:05 coredump

Fascinating. I have never tried this on so many instances!

Any idea what the system resources were like on your side?

I might have to try turning on this many computers for a conclusive answer... :D

On Tuesday, May 29, 2012 at 7:49 PM, José de Paula E. Júnior wrote:

Tried to use 380 and 200 instances for a big test, microarmy just stopped during the deploy phase. Instances where created but the command never returned. Manually added the microarmy tag to the created instances and used 'find_cannons', worked. Tried 'deploy' but after a long time got an EOF exception

Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/eventlet/hubs/hub.py", line 336, in fire_timers
timer()
File "/usr/lib/python2.7/site-packages/eventlet/hubs/timer.py", line 56, in __call__
cb(*args, **kw)
File "/usr/lib/python2.7/site-packages/eventlet/semaphore.py", line 95, in _do_acquire
waiter.switch()
File "/usr/lib/python2.7/site-packages/eventlet/greenthread.py", line 192, in main
result = function(*args, **kwargs)
File "/home/coredump/dev/microarmy/microarmy/firepower.py", line 155, in _setup_a_cannon
ssh_conn = ssh_connect(hostname)
File "/home/coredump/dev/microarmy/microarmy/communications.py", line 36, in ssh_connect
transport.connect(username=ec2_ssh_username, pkey=rsa_key)
File "/usr/lib/python2.7/site-packages/paramiko/transport.py", line 989, in connect
self.start_client()
File "/usr/lib/python2.7/site-packages/paramiko/transport.py", line 461, in start_client
raise e
EOFError

Reply to this email directly or view it on GitHub: https://github.com/j2labs/microarmy/issues/10

j2labs avatar May 30 '12 00:05 j2labs

I didn't really measure it but I didn't notice anything going wrong on my side.

coredump avatar Jun 08 '12 21:06 coredump