Device Farm last version issues with videos and screenshots

[d4v1dk0n7]

trafficstars

Describe the bug

Hi,

The last version of Device Farm it is not storing the videos or showing the screenshots in the integrated Dashboard, with the "old" dashboard the videos were correctly stored and the screenshots correctly showed. Apart of this, with the old dashboard you don't needed to refresh the screen to see the new actions over the app, they were appearing automatically in the screen, with this integrated version is needed to refresh manually the screen to see new updates of the actions being taken in the app... Is this the expected behaviour?

Link to Appium logs

https://gist.github.com/d4v1dk0n7/24380ce04f2cf290480281d17295b608

Environment

1. Appium version (or git revision) that exhibits the issue: last
2. Last Appium version that did not exhibit the issue (if applicable):
3. Node.js version (unless using Appium.app|exe): last
4. Npm or Yarn package manager: last
5. Mobile platform/version under test: android/ios
6. Real device or emulator/simulator: simulator
7. Appium CLI or Appium.app|exe: cli

[saikrishna321]

@d4v1dk0n7 You need to add df:recordVideo in your caps. Also screenshots will only appear on any errors.

[d4v1dk0n7]

@d4v1dk0n7 You need to add df:recordVideo in your caps. Also screenshots will only appear on any errors.

Hmm, but with the "old" dashboard this was not necessary because df:recordvideo was enabled by default... In the documentation I also can see that the default value is "enabled"...

https://devicefarm.org/capabilities/

Maybe this has to be corrected or the documentation is wrong?

[saikrishna321]

@d4v1dk0n7 Does it work now ?

[d4v1dk0n7]

@saikrishna321 Adding this capability makes it work fine, now is storing the video (but with the "old" dashboard this was not needed). Anyway, I tried to make a test fail, and it's not showing the screenshots yet...

[d4v1dk0n7]

@saikrishna321 I'm taking a look at the old dashboard, and it wasn't taking screenshots just with the faling tests, it was taking screenshots while the test was running (several screenshots per test)...

I'm asking just to confirm, with this new integrated version, we have lost this feature of taking random screenshots while the test runs?

[saikrishna321]

it was taking screenshots while the test was running

@sudharsan-selvaraj Can you confirm if this was right ?

[Stefankoff]

it was taking screenshots while the test was running

@sudharsan-selvaraj Can you confirm if this was right ?

Yes, "old" takes screenshot every action as click, add text etc.

[saikrishna321]

@d4v1dk0n7 @Stefankoff will check on this!

[sudharsan-selvaraj]

@d4v1dk0n7 @Stefankoff I confirm that the behaviour has been slightly modified with the new integrated dashboard. Screenshots are now captured exclusively for failed actions to avoid the storage of multiple images. Should you deem it necessary to capture screenshots for all critical actions ("click," "setUrl," "setValue," "performActions") irrespective of their outcome, we can accommodate that request.

[mazis0]

@saikrishna321 any capabilities for see the network logs?

[saikrishna321]

@mazis0 you mean device logs and app profiling ?

[mazis0]

@saikrishna321 i mean network logs can see the api logs

[Stefankoff]

@d4v1dk0n7 @Stefankoff I confirm that the behaviour has been slightly modified with the new integrated dashboard. Screenshots are now captured exclusively for failed actions to avoid the storage of multiple images.

In my opinion that good optimization, cause we have video record and see every step.

Hope soon can use updated device-farm + new dashboard, cause have problem with database when update from 8.4.6 8.4.7

[d4v1dk0n7]

@d4v1dk0n7 @Stefankoff I confirm that the behaviour has been slightly modified with the new integrated dashboard. Screenshots are now captured exclusively for failed actions to avoid the storage of multiple images. Should you deem it necessary to capture screenshots for all critical actions ("click," "setUrl," "setValue," "performActions") irrespective of their outcome, we can accommodate that request.

Thanks @sudharsan-selvaraj, I was asking just to confirm.