ONE-vscode icon indicating copy to clipboard operation
ONE-vscode copied to clipboard

Prepare official release v0.5

Open jyoungyun opened this issue 1 year ago • 7 comments

What

Let's prepare official release v0.5.

To make release preparation stable, we will branch out first and modify codes in release candidate branch. Of course the change should be merged to main branch. It is to avoid code conflict or other unexpected issues during the SSAFY project. :)

Release schedule

  • Branch-out 9.26
  • Request for verification 10.10
  • Final release

Checklist

Functionality Checklist

OneExplorer

  • [x] Multiple model/cfg files are shown
  • [x] Refresh
  • [x] Hide&Show extra files
  • [x] Rename cfg/model
  • [x] Refactor
  • [x] Create cfg
  • [x] Delete directory/cfg/model
  • [x] Reveal in explorer view
  • [x] Show circle in CircleViewer
  • [x] Show onnx in CircleViewer
  • [x] Show tflite in CircleViewer
  • [x] Show cfg in CfgEditor
  • [x] Auto refresh on file creation/deletion/change (only on local mode)

Toolchain (Compiler)

  • [ ] Shows currently installed ONE/TRIV2 backend lists
  • [ ] Setting prerequisites
  • [ ] Setting default toolchain
  • [ ] Run cfg (sample.tflite)
    • [ ] ONE backend (onecc-docker)
      • [ ] import
    • [ ] tv2 backend (triv2-toolchain-latest)
      • [ ] import
      • [ ] codegen

Release Criteria

  • [x] TEM coverage (>80%)
  • [x] TCM (New NEgative / New Positive > 1)
  • [x] Svace & Coverity (critical = 0)
  • [x] SAM (> 4.0) #1566

Release

Release Action

  • [ ] Check Functionality Checklist
  • [ ] Check Release Criteria
  • [ ] Update Release Note
  • [ ] Update version
  • [ ] Branch out
  • [ ] Trigger release action

/cc @Samsung/one-vscode

jyoungyun avatar Sep 04 '23 09:09 jyoungyun

SAM Score

(main branch, cad87ff)

  • Typescript: 4.50 🟢
  • Javascript: 4.94 🟢

SAM Score, typescript, 2023-09-15 (main branch, cad87ff)

https://analysishub.sec.samsung.net/service/analyses/2373959

image

Thanks to @hseok-oh

Originally posted by @dayo09 in https://github.com/Samsung/ONE-vscode/issues/1566#issuecomment-1720732074

Javascript SAM Score, 2023-09-15 (main branch, cad87ff)

  • link: https://analysishub.sec.samsung.net/service/analyses/2373958#overview
  • analysis target id: 10774
  • analyzer policy: javascript.sr

image

Originally posted by @dayo09 in https://github.com/Samsung/ONE-vscode/issues/1566#issuecomment-1720742920

dayo09 avatar Sep 15 '23 06:09 dayo09

Potential Defects (SVACE)

Latest(09/26)

  • Typescript: 0 (CQM 5.0) 🟢
  • Javascript: 0 (CQM 5.0) 🟢
    • https://analysishub.sec.samsung.net/service/analyses/2402290

History (09/15)

  • Typescript: 0 (CQM 5.0)
  • Javascript: Critiacal 16, Major PPM 314 (CQM 3.2)

(1) Javascript https://analysishub.sec.samsung.net/service/analyses/2373958#overview image

(2) Typescript https://analysishub.sec.samsung.net/service/analyses/2373959 image

dayo09 avatar Sep 15 '23 06:09 dayo09

TCM Score

Latest (9/25)

https://analysishub.sec.samsung.net/service/analyses/2400704

  • Warnings: 0 🟢
  • Negative TC Ratio: 52.37% 🟢

image

History (9/15)

(main branch, https://github.com/Samsung/ONE-vscode/commit/cad87ff0d7b885dbc0e06efc543f0a3d5e4927de)

(9/15) https://analysishub.sec.samsung.net/service/analyses/2374926 (23 Warnings)

  • Warnings: ~~23~~ ->~~ 5~~ -> 0 🟢
    • ~~NOTE: Those 5 warnings looks like falsy warnings~~ workaround done https://github.com/Samsung/ONE-vscode/issues/1678
  • Negative TC Ratio: 51.61% 🟢
  • target id: 10491
  • anaylizer policy: tcchecker-tca.sr image image

dayo09 avatar Sep 15 '23 09:09 dayo09

TEM Coverage Report

🔴 Statements : 34.16% ( 2534/7416 ) Branches : 18.01% ( 471/2614 ) Functions : 16.29% ( 428/2626 ) Lines : 34.22% ( 2506/7323 )

0915-coverage

File % Stmts % Branch % Funcs % Lines Uncovered Line #s
All files 34.16 18.01 16.29 34.22
src 100 100 100 100
extension.ts 100 100 100 100
src/Backend 99 85.71 97.22 99
API.ts 95.45 75 66.66 95.45 40
Command.ts 100 100 100 100
Compiler.ts 100 100 100 100
Executor.ts 100 100 100 100
Spec.ts 100 100 100 100
Toolchain.ts 100 100 100 100
Version.ts 100 77.77 100 100 37-39
src/Backend/One 77.77 76.47 91.66 77.31
OneToolchain.ts 77.77 76.47 91.66 77.31 ...,103,135-180,200,206,277
src/Backend/ToolchainImpl 100 83.33 100 100
DebianToolchain.ts 100 83.33 100 100 101
src/CfgEditor 100 100 100 100
CfgData.ts 100 100 100 100
CfgEditorPanel.ts 100 100 100 100
src/CircleEditor 15.99 3.87 1.73 16.14
CircleEditorDocument.ts 2.37 0 0 2.4 39-841
CircleEditorProvider.ts 29.92 11.11 19.23 30.14 104-388,405-422
CircleType.ts 100 100 100 100
Editor.ts 30.35 16.66 80 30.72 ...-170,185-248,284-330,338
circle_schema_generated.ts 13.88 3.36 0.93 14 ...,15194-15602,15622-15649
src/CircleGraph 100 100 100 100
CircleGraphCtrl.ts 100 100 100 100
CircleViewer.ts 100 100 100 100
src/Execute 90.62 76.47 88.46 90.62
Device.ts 100 100 100 100
DeviceManager.ts 100 100 100 100
DeviceViewProvider.ts 89.38 73.33 85.71 89.38 154,187-189,199-206,213-218
src/Job 89 70.68 97.05 88.88
JobCommand.ts 100 100 100 100
JobRunner.ts 91.66 70 91.66 91.54 88-90,132-133,152
ToolArgs.ts 100 100 100 100
ToolRunner.ts 84 71.87 100 84 ...,199-200,207-208,235-240
WorkFlow.ts 87.5 50 100 87.5 35-36,68
WorkJobs.ts 100 100 100 100
src/Jsontracer 100 100 100 100
JsonTracerViewerPanel.ts 100 100 100 100
src/MPQEditor 58.66 33.33 58.06 58.18
MPQCircleSelector.ts 56.98 16.21 44.44 57.14 ...,251-281,293-307,315-316
MPQData.ts 88.4 78.57 82.14 87.69 120-125,130,144-148,165
MPQEditor.ts 50.82 24.28 48.93 50.62 ...,591-600,620-624,661-791
src/MetadataViewer 35.55 0 17.64 35.55
MetadataViewer.ts 100 100 100 100
MetadataViewerProvider.ts 30.95 0 17.64 30.95 29-81,107-123,156-168
src/MetadataViewer/example 50 100 0 50
MetadataExample.ts 50 100 0 50 22
src/Mondrian 100 100 100 100
MondrianEditor.ts 100 100 100 100
src/OneExplorer 84.95 59.73 89.56 85.01
ArtifactLocator.ts 98.36 93.75 100 98.33 145
ConfigObject.ts 85.22 50 91.42 85.22 100-101,128-154,254
OneExplorer.ts 89.33 66.66 80.95 89.33 ...-260,329-333,387-398,461
OneStorage.ts 71.68 43.63 86.11 71.55 ...,178-179,251-275,331-342
src/PartEditor 100 100 100 100
PartEditor.ts 100 100 100 100
PartGraphSelector.ts 100 100 100 100
src/Toolchain 81.13 66.66 74.72 84.73
DefaultToolchain.ts 100 91.66 100 100 43
JobConfig.ts 100 100 100 100
JobInstall.ts 100 100 100 100
JobPrerequisites.ts 100 100 100 100
JobUninstall.ts 100 100 100 100
ToolchainEnv.ts 76.27 50 72.91 84.84 200-204,216-220,232-236
ToolchainProvider.ts 78.81 64.06 68.75 78.81 ...,375-391,412-427,447-463
src/Utils 81.81 67.39 80 82.14
Balloon.ts 100 100 100 100
Hash.ts 100 100 100 100
Helpers.ts 60 50 66.66 59.67 ...84-86,91,112-117,136-170
Logger.ts 100 100 100 100
MultiStepInput.ts 100 100 100 100
PipedSpawn.ts 100 100 100 100
PipedSpawnSync.ts 100 100 100 100
src/View 95.71 96.87 86.36 95.52
InstallQuickInput.ts 95.45 96.87 85.71 95.31 352-354
PasswordQuickInput.ts 100 100 100 100
src/Visquv 100 100 100 100
VisqViewer.ts 100 100 100 100
----------------------------- --------- ---------- --------- --------- -----------------------------

=========== Coverage summary ================

Statements : 34.16% ( 2534/7416 ) Branches : 18.01% ( 471/2614 ) Functions : 16.29% ( 428/2626 ) Lines : 34.22% ( 2506/7323 )

dayo09 avatar Sep 15 '23 09:09 dayo09

(main branch, https://github.com/Samsung/ONE-vscode/commit/c91f9915327a58749b5c02640ce980ffec600cd7)

SAM Score

  • Typescript: 4.61 :green_circle:
    • DC: 4.55 :green_circle:
  • Javascript: 4.93 🟢
    • DC: 4.96 🟢
details

Typescript

https://analysishub.sec.samsung.net/service/analyses/2402774 sam_one_c91f9

Javascript

https://analysishub.sec.samsung.net/service/analyses/2402840 sam_one_js_c91f9

CMQ Score

  • Typescript: 5.0 :green_circle:
  • Javascript: 5.0 🟢
details

Typescript

https://analysishub.sec.samsung.net/service/analyses/2402774 cqm_one_c91f9

Javascript

https://analysishub.sec.samsung.net/service/analyses/2402840 cqm_one_js_c91f9

TCM Score

  • Warning: 0 :green_circle:
  • Negative TC Ratio: 52.24% :green_circle:
details https://analysishub.sec.samsung.net/service/analyses/2402758 ![tcm_one_c91f9](https://github.com/Samsung/ONE-vscode/assets/7223627/7d9effc8-5298-4093-93d2-94711ba5a31a)

TEM Score

  • 4.33 :green_circle:
details
09-26 14:48:09 tem_analyzer.py:123 | TEM Score of NNAS/ONE-vscode is 4.33
09-26 14:48:09 tem_analyzer.py:124 |   pass_rate         : 100.0% (412/412)
09-26 14:48:09 tem_analyzer.py:127 |   line_coverage     : 86.8% (1463/1686)
09-26 14:48:09 tem_analyzer.py:130 |   function_coverage : 86.6% (362/418)

one_vscode_coverge_391f9.tar.gz

jyoungyun avatar Sep 26 '23 06:09 jyoungyun

(main branch, https://github.com/Samsung/ONE-vscode/commit/74c67cf998d5c050c1b8bc0192ba515e89866778)

SAM Score

  • Typescript: 4.61 :green_circle:
    • DC: 4.55 :green_circle:
  • Javascript: 4.93 🟢
    • DC: 4.96 🟢
details

Typescript

https://analysishub.sec.samsung.net/service/analyses/2403363 sam_one_ts_74c67

Javascript

https://analysishub.sec.samsung.net/service/analyses/2403366 sam_one_74c67

CMQ Score

  • Typescript: 5.0 :green_circle:
  • Javascript: 5.0 🟢
details

Typescript

https://analysishub.sec.samsung.net/service/analyses/2403363 cqm_one_ts_74c67

Javascript

https://analysishub.sec.samsung.net/service/analyses/2403366 cqm_one_74c67

TCM Score

  • Warning: 0 :green_circle:
  • Negative TC Ratio: 52.24% :green_circle:
details

https://analysishub.sec.samsung.net/service/analyses/2403365 tcm_one_74c67

TEM Score

  • 4.33 :green_circle:
details
09-26 16:39:44 tem_analyzer.py:123 | TEM Score of NNAS/ONE-vscode is 4.33
09-26 16:39:44 tem_analyzer.py:124 |   pass_rate         : 100.0% (412/412)
09-26 16:39:44 tem_analyzer.py:127 |   line_coverage     : 86.8% (1463/1686)
09-26 16:39:44 tem_analyzer.py:130 |   function_coverage : 86.6% (362/418)

one-vscode_74c67_tem_report.tar.gz

jyoungyun avatar Sep 26 '23 07:09 jyoungyun

(release/0.5.0 branch, ONE-vscode/@4aed26f)

SAM Score

  • Typescript: 4.61 :green_circle:
    • DC: 4.55 :green_circle:
  • Javascript: 4.93 🟢
    • DC: 4.96 🟢
details

Typescript

https://analysishub.sec.samsung.net/service/analyses/2406453 sam_one_ts_4aed26f

Javascript

https://analysishub.sec.samsung.net/service/analyses/2406455 sam_one_js_4aed26f

CMQ Score

  • Typescript: 5.0 :green_circle:
  • Javascript: 5.0 🟢
details

Typescript

https://analysishub.sec.samsung.net/service/analyses/2406453 cqm_one_ts_4aed26f

Javascript

https://analysishub.sec.samsung.net/service/analyses/2406455 cqm_one_js_4aed26f

TCM Score

  • Warning: 0 :green_circle:
  • Negative TC Ratio: 52.24% :green_circle:
details

https://analysishub.sec.samsung.net/service/analyses/2406454 tcm_4aed26f

TEM Score

  • 4.33 :green_circle:
details
09-27 13:10:47 tem_analyzer.py:123 | TEM Score of NNAS/ONE-vscode is 4.33
09-27 13:10:47 tem_analyzer.py:124 |   pass_rate         : 100.0% (412/412)
09-27 13:10:47 tem_analyzer.py:127 |   line_coverage     : 86.8% (1463/1686)
09-27 13:10:47 tem_analyzer.py:130 |   function_coverage : 86.6% (362/418)

jyoungyun avatar Sep 27 '23 04:09 jyoungyun