engine_web-ifc icon indicating copy to clipboard operation
engine_web-ifc copied to clipboard

Published Benchmark Results

Open cdiggins opened this issue 2 years ago • 18 comments

It would be very helpful to see a list of benchmark results published automatically to this web-site as a table:

I would suggest the following fields:

  • Input File Size
  • Number of IFC Entities
  • Total number of produced meshes
  • Total number of polygons
  • Processing Time
  • Processing Success
  • Error/Warning Count

cdiggins avatar Nov 30 '21 14:11 cdiggins

This issue is now a bounty. Whoever solves this will get $200. More information here.

agviegas avatar May 15 '22 23:05 agviegas

May I try to take this and start working on it?

GuyOnsight avatar May 19 '22 06:05 GuyOnsight

It's yours @GuyOnsight!

agviegas avatar May 20 '22 22:05 agviegas

::take command

Still in progress @agviegas @amirmiz

GuyOnsight avatar Aug 10 '22 06:08 GuyOnsight

::take

agviegas avatar Aug 10 '22 08:08 agviegas

🟢🟢🟢

::take

Hi, @agviegas! Thanks for taking this bounty! The due date is August 31, 2022 UTC.

If you need to submit some pull requests (PR) to complete the tasks, make sure that the last and only the last PR has a title that either starts with the bounty ID or is exactly the same as the bounty name. After the PR is merged, this bounty’s status will automatically changed to done.

If you do not need to make a PR, tell the manager @agviegas to run ::done command after your tasks is confirmed to be done.

Good luck!

agviegas avatar Aug 10 '22 08:08 agviegas

::drop

agviegas avatar Aug 10 '22 08:08 agviegas

🟢🟢🟢

::drop

Hi, @agviegas! Thanks for giving it a try! It’s now once again available for anyone to take.

agviegas avatar Aug 10 '22 08:08 agviegas

Can you please try again like I did @GuyOnsight ? Thanks!

agviegas avatar Aug 10 '22 08:08 agviegas

::take

Thanks for the opportunity @agviegas We will try another bounty when it will be possible for us

@amirmiz

GuyOnsight avatar Aug 15 '22 07:08 GuyOnsight

Hey @GuyOnsight the comment can only contain the ::take command, like I did. Can you please try again? Thanks a lot for your help!

agviegas avatar Aug 21 '22 16:08 agviegas

Hi just to recap. During the build process for a new version of web-ifc. We have to run a script locally and this script will write the results into a table ( see exemple below ).

Question : the table is injected in the readme or it should be in another file named benchmark.md ?

filename Input file size IFCEntities quantity Total number of produced mesh Total number of polygons Processing Time Error/Warning Count
duplex-apartment.ifc xxx Mo xxxxxxxxxxx xxxxxxxxxxx xxxxxxxxxx 2000 ms 0
test.ifc xx Mo xxxxxxxxx xxxxxxxxx xxxxxxxx 1000 ms 0

thanks @agviegas

TxTony avatar Sep 06 '22 06:09 TxTony

::take

arunkvijay avatar Sep 16 '22 04:09 arunkvijay

🟢🟢🟢

::take

Hi, @arunkvijay! Thanks for taking this bounty! The due date is October 7, 2022 UTC.

If you need to submit some pull requests (PR) to complete the tasks, make sure that the last and only the last PR has a title that either starts with the bounty ID or is exactly the same as the bounty name. After the PR is merged, this bounty’s status will automatically changed to done.

If you do not need to make a PR, tell the manager @agviegas to run ::done command after your tasks is confirmed to be done.

Good luck!

agviegas avatar Sep 16 '22 04:09 agviegas

::drop

arunkvijay avatar Oct 03 '22 23:10 arunkvijay

🟢🟢🟢

::drop

Hi, @arunkvijay! Thanks for giving it a try! It’s now once again available for anyone to take.

agviegas avatar Oct 03 '22 23:10 agviegas

::take

TxTony avatar Oct 05 '22 17:10 TxTony

🟢🟢🟢

::take

Hi, @TxTony! Thanks for taking this bounty! The due date is October 26, 2022 UTC.

If you need to submit some pull requests (PR) to complete the tasks, make sure that the last and only the last PR has a title that either starts with the bounty ID or is exactly the same as the bounty name. After the PR is merged, this bounty’s status will automatically changed to done.

If you do not need to make a PR, tell the manager @agviegas to run ::done command after your tasks is confirmed to be done.

Good luck!

agviegas avatar Oct 05 '22 17:10 agviegas

::extend

TxTony avatar Oct 25 '22 18:10 TxTony

🟢🟢🟢

::extend

Hi, @TxTony! The due date is successfully extended by 21 days to November 16, 2022 UTC.

agviegas avatar Oct 25 '22 18:10 agviegas

Hi @agviegas this is a first draft. I just need to add more ifc files and refactor some methods. the file is written on web-ifc root folder, so you will just have to add a link in the readme.md to benchmark.md. :relaxed: i just noticed the date and the web-ifc version, are missing i will add them under system information section i will add the units in the headers.

I can modify the output tell me if something is missing.

System informations

{"gpu":"","cpuName":"Intel(R) Core(TM) i7-3630QM CPU @ 2.40GHz","freeRam":1135.95703125,"totalRam":8088.74609375}


filename fileSize timeTakenToOpenModel timeSuccess numberOfIfcEntities totalNumberOfProducedMesh totalNumberOfGeometries totalNumberOfErrors
ifcfiles\example.ifc 0.4 19 46 6487 115 119 0

TxTony avatar Nov 05 '22 14:11 TxTony

Hey @TxTony thanks a lot! We'll review this and let you know 🙏

agviegas avatar Nov 12 '22 22:11 agviegas

@agviegas sorry for the delay this is not totally terminated, i was sick last week and i haven't spent time on this. I think i should load the models from another repo and do not overload this one with big ifc files just for benchmarking purpose. i'll come back to you really soon.

TxTony avatar Nov 16 '22 15:11 TxTony

🔴🔴🔴

Hi, @TxTony! The date is past due, your assignment has been revoked. It’s now available for anyone to take.

agviegas avatar Nov 17 '22 00:11 agviegas

::take

TxTony avatar Nov 17 '22 03:11 TxTony

🟢🟢🟢

::take

Hi, @TxTony! Thanks for taking this bounty! The due date is December 8, 2022 UTC.

If you need to submit some pull requests (PR) to complete the tasks, make sure that the last and only the last PR has a title that either starts with the bounty ID or is exactly the same as the bounty name. After the PR is merged, this bounty’s status will automatically changed to done.

If you do not need to make a PR, tell the manager @agviegas to run ::done command after your tasks is confirmed to be done.

Good luck!

agviegas avatar Nov 17 '22 03:11 agviegas

Hi @agviegas do you have one large ifc file i ran with one file of 2.5Mo and one with 12.Mo if you got a file of 60Mo or higher that could be integrated in the benchmark loop.

it will complete the following lines

System informations

{"gpu":"","cpuName":"Intel(R) Core(TM) i7-3630QM CPU @ 2.40GHz","freeRam":1154.71484375,"totalRam":8088.74609375}


filename Size (mo) Time to open model (ms) Time to execute all (ms) Total ifc entities Total meshes Total geometries total errors
ifcfiles\dental_clinic.ifc 12.6 286 1740 209259 2586 2626 0
ifcfiles\example.ifc 0.4 27 40 6487 115 119 0
thanks

TxTony avatar Nov 19 '22 11:11 TxTony

Hey @TxTony did you check this out?

agviegas avatar Nov 23 '22 08:11 agviegas

Hi @agviegas ok i'll grab some of them i publish the update tonight or tomorrow. thanks

TxTony avatar Nov 28 '22 07:11 TxTony

🔴🔴🔴

Hi, @TxTony! The date is past due, your assignment has been revoked. It’s now available for anyone to take.

agviegas avatar Dec 09 '22 00:12 agviegas