AMP icon indicating copy to clipboard operation
AMP copied to clipboard

Requiring a restart of ADS after timing out from sFTP

Open xLeviNx opened this issue 4 years ago • 21 comments

Bug Report

System Information

Operating System (Including distribution name and version number) Ubuntu 20.04 AMP version and build date (Always use the version number, 'latest' is not valid!) ADS is on 2.0.0.0 10/07/2020 21:34 This specific instance is on 2.0.2.0 17/07/2020 16:13 Which AMP release stream you're using (Mainline, Nightly or FastTrack) Release stream

I confirm:

  • [x] that I have searched for an existing bug report for this issue.
  • [x] that I am using the latest available version of AMP.
  • [x] that my operating system is up-to-date.

Symptoms

Connection to ADS via SFTP times out, requiring to restart the ADS via SSH to connect to the SFTP again. Currently using the latest build of Filezilla.

Reproduction

  1. Open SFTP server, let it hang for about 10 minutes or so.
  2. Come back after 10 minutes, move around in the server files and attempt to upload files.
  3. Server times out and continously tries to reconnect. Won't succeed (waited a solid half hour to make sure)
  4. Restart ADS by logging into SSH using ampinstmgr restart ADS01
  5. Wait till ADS restarts, able to connect to the SFTP again and upload files.

xLeviNx avatar Jul 20 '20 02:07 xLeviNx

You need to update to 2.0.2.0.

PhonicUK avatar Jul 20 '20 10:07 PhonicUK

Sorry forgot to update the thread. This is on 2.0.2.0 release stream 17/07/2020 16:13

Edit: updated thread

xLeviNx avatar Jul 20 '20 12:07 xLeviNx

@PhonicUK Can you reopen this? This is related to the latest build:

Application Name AMP
Application Version 2.0.2.0
Release Stream Release
Build Date 17/07/2020 16:13

xLeviNx avatar Jul 21 '20 02:07 xLeviNx

Are you able to login using an SSH client as opposed to an SFTP client? (same details)

PhonicUK avatar Jul 21 '20 09:07 PhonicUK

Are you able to login using an SSH client as opposed to an SFTP client? (same details)

I am, but any inactivity after let's say, 5-10 minutes, and reconnecting to the sftp, would require me to restart the ADS from ssh to get back in

xLeviNx avatar Jul 26 '20 19:07 xLeviNx

Hi @xLeviNx , can you update and give it a try?

miguemely avatar Sep 02 '20 19:09 miguemely

I can't reproduce this, what SFTP client are you using?

PhonicUK avatar Sep 06 '20 16:09 PhonicUK

I can't reproduce this, what SFTP client are you using?

Using Filezilla

Hi @xLeviNx , can you update and give it a try?

I've updated it. Currently having an issue with login, but once I figure it out, I will test it

xLeviNx avatar Sep 08 '20 16:09 xLeviNx

I can't reproduce this, what SFTP client are you using?

Using Filezilla

Hi @xLeviNx , can you update and give it a try?

I've updated it. Currently having an issue with login, but once I figure it out, I will test it

It looks like it still requires a restart if it times out. Tried it again with the latest build

xLeviNx avatar Sep 09 '20 01:09 xLeviNx

Can someone verify if this is still an issue? The external SFTP component has been updated a few times since.

PhonicUK avatar May 20 '21 10:05 PhonicUK

It still happens. It timeouts out, then trying to log back in requires a restart of the ads still.

I think adding #459 might help fix this problem

xLeviNx avatar May 21 '21 11:05 xLeviNx

Does ADS itself become unresponsive, or just the SFTP component?

PhonicUK avatar May 21 '21 13:05 PhonicUK

Just the sftp component

xLeviNx avatar May 21 '21 14:05 xLeviNx

Closing. Seems like it somehow resolved itself a few updates ago

xLeviNx avatar Nov 10 '21 20:11 xLeviNx

Seems like its happening again. Typically ends up happening if I delete a large amount of files. It times out, requiring a ADS01 restart to connect to the sftp again.

xLeviNx avatar Nov 22 '21 12:11 xLeviNx

Been happening to me on and off ever since I started using AMP. At first, it was only when I was copying a large number of files, but now it happens all the time, even when making edits to small files. I am using WinSCP, and yes, the entire ADS01 becomes unresponsive, including the web UI. Restarting ADS01 fixes the issue temporarily. image

LeehamElectronics avatar Feb 20 '22 04:02 LeehamElectronics

Have you checked AMPs logs to see if it's unhappy about something?

PhonicUK avatar Feb 20 '22 18:02 PhonicUK

Have you checked AMPs logs to see if it's unhappy about something?

I have looked through ADS01 logs but nothing stands out. Been about 24 hours since then and it hasn't happened since, I simply restarted the Ubuntu VM and it has been fine so far. It comes and goes...

LeehamElectronics avatar Feb 21 '22 03:02 LeehamElectronics

Can state that the latest update along with winscp is having the same issue.

Wondering if this is strictly a problem with Ubuntu 20.04.4 LTS

image

TaskCanceledException [0] (TaskCanceledException) : The operation was canceled. at AMPAPI.RemoteInstance.GetResponseDynamic (String Module, String Method, Object Parameters) at AMPAPI.RemoteInstance+API_Core.Login (String username, String password, String token, Boolean rememberMe) at InstanceManagerPlugin.RemoteInstanceManager.Login (String username, String password, String token) ObjectDisposedException [1] (ObjectDisposedException) : Cannot access a disposed object. Object name: 'MobileAuthenticatedStream'. at Net.Http.HttpConnection.FillAsync () at Net.Http.HttpConnection.ReadNextResponseHeaderLineAsync (Boolean foldedHeadersAllowed) Failed to authenticate: Could not connect to the remote instance at **website**. The operation was canceled.

Strike-out website for privacy

xLeviNx avatar Jun 08 '22 00:06 xLeviNx

Screenshot 2022-06-07 201526

Attached a screenshot of the box timing out. And then having to require an ADS restart for this to work.

xLeviNx avatar Jun 08 '22 00:06 xLeviNx

That doesn't tell me anything, I'd need the logs from the target itself. Not the controller.

PhonicUK avatar Jun 10 '22 22:06 PhonicUK

So far as I can tell this issue no longer exists. The SFTP component is from an upstream vendor so my guess is that the issue was fixed their end. This can be re-opened if it comes up again.

PhonicUK avatar Dec 16 '22 16:12 PhonicUK