JSON Schema: `bowtie-perf`- a Performance Tester for JSON Schema implementations

[benjagm]

Project title

bowtie-perf: a Performance Tester for JSON Schema implementations

Brief Description

Bowtie is a tool which provides "universal access" to JSON Schema implementations, giving JSON Schema users a way to use any implementation supported by Bowtie.

A primary use case for Bowtie was to allow comparing implementations to one another, which can be seen on Bowtie's website and which gives anyone a way to see how correct a JSON Schema implementation is relative to the JSON Schema specification.

But it can do more! Let's write a performance tester using Bowtie, giving us a way to also compare performance of implementations by timing how long they take to do their work. This information could be used to do performance optimization, or as a second dimension that users could use when comparing implementations with one another.

Refs: bowtie-json-schema/bowtie#35

Expected Outcomes

• A new bowtie perf command which reports on implementation performance when executing its validation
• A small set of initial examples which can be used to compare results of timings
• Some way of viewing the results

Skills Required

• Comfortable ability with Python, which Bowtie's backend is written in
• Attention to detail, as performance testing can be a delicate exercise
• Basic knowledge of JSON Schema Validation

Mentors

@Julian

Expected Difficulty Hard

Expected Time Commitment 350 hour

Related issue in the JSON Schema project: https://github.com/json-schema-org/community/issues/605

[benjagm]

Thanks for your interest! Lets continue the discussion in this issue inside the JSON Schema project: https://github.com/json-schema-org/community/issues/605

[benjagm]

Thanks a lot for joining JSON Schema org for this edition of GSoC!!

Qualification tasks will be published as comments in the project ideas by Thursday/Friday of this week. In addition I'd like to invite you to a office hours session this thursday 18:30 UTC where we'll present the ideas and the relevant date to consider at this stage of the program.

Please use this link to join the session: 🌐 Zoom 📅 20124-02-29 18:30 UTC

See you there!

[Danimoz]

I'm skilled with Python, and would love to work on this for GSOC 2024

[benjagm]

🚩 IMPORTANT INSTRUCTIONS REGARDING HOW AND WHERE TO SUBMIT YOU APPLICATION 🚩

Please join this discussion in JSON Schema slack to get the last details very important details on how to better submit your application to JSON Schema.

See communication here.