PoseEstimation-TFLiteSwift
PoseEstimation-TFLiteSwift copied to clipboard
tucan9389
The baseline project for inferencing various Pose Estimation tflite models with TFLiteSwift on iOS
In pixelBufferFromImage(UIImageExtension), - https://github.com/tucan9389/PoseEstimation-TFLiteSwift/blob/e440b48bddb4459e7bf027b091a6213db4661a02/PoseEstimation-TFLiteSwift/UIImageExtension.swift CIContext is generated whenever pixelBufferFromImage called. I recommend to use shared CIContext object(But This isn't just meaning to make single-ton). Becauase, If CIContext is generated overly...
- [ ] Add gif demos for each model (1 image per model) - Video: `` - [ ] Add png demos for each model (3~4 images per model) -...
- [ ] Cocoapods - [ ] Carthage - [ ] Swift Package Manager - [ ] Manual Framework
## Related Comment - https://github.com/tucan9389/PoseEstimation-TFLiteSwift/pull/42#discussion_r417990478 ## Summary There are 5 steps on multi-pose estimation post-process. NMS step is separated as a class, but other steps aren't.
## Summary Couldn't run the model with `.metal` option on iPhone simulator after updating my Xcode to 11.4.1 ## Environment - macOS: Version 10.15.4 (19E287) - Xcode: Version 11.4.1 (11E503a)...
## Post-process Logic - [x] 1. Get points from confidence map (make nodes) #38 - [x] 2. Make a [bipartite graph](https://en.wikipedia.org/wiki/Bipartite_graph) with each part of points (make edges) #42 -...
## New UIs - Separate with sections - Part, Pair, Human - Control - Threshold of pair (Pair section) - Filter size using on NMS (Pair section) - Maximum number...
## Summary - `Nose-REye` and `Nose-LEye` matching is incorrect in the general situation ## Samples case 1 | case 2 | case 3 | case 4 --- | --- |...
## Dataset - [ ] with coco 2017 test set (http://cocodataset.org/#download) ## Metric - PCKH-0.5 (the most popular metric in [paperswithcode/pose-estimation-on-mpii-human-pose](https://paperswithcode.com/sota/pose-estimation-on-mpii-human-pose)) - implement reference: [edvardHua/PoseEstimationForMobile's benchmark.py](https://github.com/edvardHua/PoseEstimationForMobile/blob/master/training/src/benchmark.py) ### Define > ref:...