msgpack-java
msgpack-java copied to clipboard
msgpack
Why is MessagePack slower than JSON in jackson-databind?
I wrote this crude benchmark to compare the performance of JSON and MessagePack. Consistently, JSON is faster during serialization, faster on deserialization, and MessagePack produces smaller payloads. Based on what I've read, I was expecting MessagePack to be faster during both serialization and deserialization in addition to producing smaller payloads. Are my expecations unrealistic or is there room for improvement here? On my machine, I'm getting this output:
==================================== OUTPUT ====================================
JSON serialized 1,000,000 times in 893ms
JSON size 360
MessagePack serialized 1,000,000 times in 1497ms
MessagePack size 304
JSON deserialized 1,000,000 times in 1496ms
MessagePack deserialized 1,000,000 times in 1777ms
=================================== SUMMARY ====================================
JSON serialization is %40.35 faster than MessagePack serialization
JSON deserialization is %15.81 faster than MessagePack deserialization
MessagePack is %15.56 smaller than JSON
Here are my dependency versions:
+- org.msgpack:jackson-dataformat-msgpack:jar:0.9.8:compile
| | +- com.google.http-client:google-http-client-jackson2:jar:1.44.1:compile
+- com.fasterxml.jackson.core:jackson-databind:jar:2.17.1:compile
| +- com.fasterxml.jackson.core:jackson-annotations:jar:2.17.1:compile
| \- com.fasterxml.jackson.core:jackson-core:jar:2.17.1:compile
+- com.fasterxml.jackson.datatype:jackson-datatype-guava:jar:2.17.1:compile
+- com.fasterxml.jackson.dataformat:jackson-dataformat-xml:jar:2.17.1:compile
| +- org.msgpack:jackson-dataformat-msgpack:jar:0.9.8:compile
| | | +- com.google.http-client:google-http-client-jackson2:jar:1.44.1:compile
| +- com.fasterxml.jackson.core:jackson-databind:jar:2.17.1:compile
| | +- com.fasterxml.jackson.core:jackson-annotations:jar:2.17.1:compile
| | \- com.fasterxml.jackson.core:jackson-core:jar:2.17.1:compile
| +- com.fasterxml.jackson.datatype:jackson-datatype-guava:jar:2.17.1:compile
| +- com.fasterxml.jackson.dataformat:jackson-dataformat-xml:jar:2.17.1:compile
Here is the code:
import com.fasterxml.jackson.annotation.JsonProperty;
import com.fasterxml.jackson.databind.ObjectMapper;
import org.msgpack.jackson.dataformat.MessagePackMapper;
import java.io.IOException;
import java.text.NumberFormat;
import java.util.List;
import java.util.Locale;
public class MessagePackMain {
private static final String SAMPLE_JSON = """
{
"glossary": {
"title": "example glossary",
"GlossDiv": {
"title": "S",
"GlossList": {
"GlossEntry": {
"ID": "SGML",
"SortAs": "SGML",
"GlossTerm": "Standard Generalized Markup Language",
"Acronym": "SGML",
"Abbrev": "ISO 8879:1986",
"GlossDef": {
"para": "A meta-markup language, used to create markup languages such as DocBook.",
"GlossSeeAlso": ["GML", "XML"]
},
"GlossSee": "markup"
}
}
}
}
}
""";
public static void main(String[] args) throws IOException {
ObjectMapper jsonMapper = new ObjectMapper();
ObjectMapper messagePackMapper = new MessagePackMapper();
int iterations = 1_000_000;
Item item = new ObjectMapper().readValue(SAMPLE_JSON, Item.class);
System.out.println("==================================== OUTPUT ====================================");
long startTime = System.currentTimeMillis();
byte[] jsonOutput = null;
byte[] messagePackOutput = null;
for (int i =0; i < iterations; i++) {
byte[] bytes = jsonMapper.writeValueAsBytes(item);
if (jsonOutput == null) {
jsonOutput = bytes;
}
}
long endTime = System.currentTimeMillis();
long jSerializeElapsedTime = endTime - startTime;
System.out.println("JSON serialized " + NumberFormat.getNumberInstance(Locale.US).format(iterations) + " times in " + jSerializeElapsedTime + "ms");
System.out.println("JSON size " + jsonOutput.length);
startTime = System.currentTimeMillis();
for (int i =0; i < iterations; i++) {
byte[] bytes = messagePackMapper.writeValueAsBytes(item);
if (messagePackOutput == null) {
messagePackOutput = bytes;
}
}
endTime = System.currentTimeMillis();
long mSerializeElapsedTime = endTime - startTime;
System.out.println("MessagePack serialized " + NumberFormat.getNumberInstance(Locale.US).format(iterations) + " times in " + mSerializeElapsedTime + "ms");
System.out.println("MessagePack size " + messagePackOutput.length);
String newJson = new String(jsonOutput);
startTime = System.currentTimeMillis();
for (int i =0; i < iterations; i++) {
jsonMapper.readValue(newJson, Item.class);
}
endTime = System.currentTimeMillis();
long jDeserializeElapsedTime = endTime - startTime;
System.out.println("JSON deserialized " + NumberFormat.getNumberInstance(Locale.US).format(iterations) + " times in " + jDeserializeElapsedTime + "ms");
startTime = System.currentTimeMillis();
for (int i =0; i < iterations; i++) {
messagePackMapper.readValue(messagePackOutput, Item.class);
}
endTime = System.currentTimeMillis();
long mDeserializeElapsedTime = endTime - startTime;
System.out.println("MessagePack deserialized " + NumberFormat.getNumberInstance(Locale.US).format(iterations) + " times in " + mDeserializeElapsedTime + "ms");
System.out.println("\n=================================== SUMMARY ====================================");
if (jSerializeElapsedTime > mSerializeElapsedTime) {
System.out.printf("MessagePack serialization is %%%.02f faster than JSON serialization\n", ((1.0 - (float) mSerializeElapsedTime / (float) jSerializeElapsedTime))*100.0);
} else {
System.out.printf("JSON serialization is %%%.02f faster than MessagePack serialization\n", ((1.0 - (float) jSerializeElapsedTime / (float) mSerializeElapsedTime))*100.0);
}
if (jDeserializeElapsedTime > mDeserializeElapsedTime) {
System.out.printf("MessagePack deserialization is %%%.02f faster than JSON deserialization\n", ((1.0 - (float) mDeserializeElapsedTime / (float) jDeserializeElapsedTime))*100.0);
} else {
System.out.printf("JSON deserialization is %%%.02f faster than MessagePack deserialization\n", ((1.0 - (float) jDeserializeElapsedTime / (float) mDeserializeElapsedTime))*100.0);
}
if (jsonOutput.length > messagePackOutput.length) {
System.out.printf("MessagePack is %%%.02f smaller than JSON\n", ((1.0 - (float) messagePackOutput.length / (float)jsonOutput.length))*100.0);
} else {
System.out.printf("JSON is %%%.02f smaller than MessagePack\n", ((1.0 - (float) jsonOutput.length / (float)messagePackOutput.length))*100.0);
}
}
private static class Item {
private Glossary glossary;
public Glossary getGlossary() {
return glossary;
}
public void setGlossary(Glossary glossary) {
this.glossary = glossary;
}
}
private static class GlossaryDef {
private String para;
@JsonProperty("GlossSeeAlso")
private List<String> seeAlso;
public String getPara() {
return para;
}
public void setPara(String para) {
this.para = para;
}
public List<String> getSeeAlso() {
return seeAlso;
}
public void setSeeAlso(List<String> seeAlso) {
this.seeAlso = seeAlso;
}
}
private static class GlossaryEntry {
@JsonProperty("ID")
private String id;
@JsonProperty("SortAs")
private String sortAs;
@JsonProperty("GlossTerm")
private String glossTerm;
@JsonProperty("Acronym")
private String acronym;
@JsonProperty("Abbrev")
private String abbrev;
@JsonProperty("GlossDef")
private GlossaryDef glossaryDef;
@JsonProperty("GlossSee")
private String glossSee;
public String getId() {
return id;
}
public void setId(String id) {
this.id = id;
}
public String getSortAs() {
return sortAs;
}
public void setSortAs(String sortAs) {
this.sortAs = sortAs;
}
public String getGlossTerm() {
return glossTerm;
}
public void setGlossTerm(String glossTerm) {
this.glossTerm = glossTerm;
}
public String getAcronym() {
return acronym;
}
public void setAcronym(String acronym) {
this.acronym = acronym;
}
public String getAbbrev() {
return abbrev;
}
public void setAbbrev(String abbrev) {
this.abbrev = abbrev;
}
public GlossaryDef getGlossaryDef() {
return glossaryDef;
}
public void setGlossaryDef(GlossaryDef glossaryDef) {
this.glossaryDef = glossaryDef;
}
public String getGlossSee() {
return glossSee;
}
public void setGlossSee(String glossSee) {
this.glossSee = glossSee;
}
}
private static class GlossaryList {
@JsonProperty("GlossEntry")
private GlossaryEntry glossaryEntry;
public GlossaryEntry getGlossaryEntry() {
return glossaryEntry;
}
public void setGlossaryEntry(GlossaryEntry glossaryEntry) {
this.glossaryEntry = glossaryEntry;
}
}
private static class GlossaryDiv {
private String title;
@JsonProperty("GlossList")
private GlossaryList glossaryList;
public String getTitle() {
return title;
}
public void setTitle(String title) {
this.title = title;
}
public GlossaryList getGlossaryList() {
return glossaryList;
}
public void setGlossaryList(GlossaryList glossaryList) {
this.glossaryList = glossaryList;
}
}
private static class Glossary {
private String title;
@JsonProperty("GlossDiv")
private GlossaryDiv glossaryDiv;
public String getTitle() {
return title;
}
public void setTitle(String title) {
this.title = title;
}
public GlossaryDiv getGlossaryDiv() {
return glossaryDiv;
}
public void setGlossaryDiv(GlossaryDiv glossaryDiv) {
this.glossaryDiv = glossaryDiv;
}
}
}
I have seen similarly less-than-optimal performance with tests on https://github.com/FasterXML/jackson-benchmarks -- I think there is room for improvement for jackson-dataformat-msgpack if anyone has time and interest.
We haven't focused on the performance of msgpack-jackson. There should be much room for improvement.
@john-boxcar Thanks for the heads-up! Based on our benchmark tests, the performance didn't seem too bad https://github.com/msgpack/msgpack-java/actions/runs/11042744800/job/30675681860#step:5:510, so I didn't notice the performance issue that you encountered with your test code. I'll take a look into it when I have time later.
@cowtowncoder Thank for the comment. Let me ask a quick question.
I noticed BeanPropertyWriter.serializeAsField() is consuming about half of the execution time in this profile:
However, this profile result doesn't show any further stack trace details. I'm wondering if the implementation of jackson-dataformat-msgpack could contribute to the duration of BeanPropertyWriter.serializeAsField(). What do you think?
I am not 100% sure but I suspect serializeAsField() timing just encapsulates call it makes to actual serialization. I don't remember it doing anything very complicated on its own. And not something that would be format-specific (locating dependant serializers, for example, would have same overhead regardless of format-specific JsonGenerator subtype.
But for sure that is on stack trace to most serialization activity so that in itself is not surprising. Just does not give much information.
Why timing details are not included; maybe due to JIT inlining? But that seems odd as it's likely some nesting, and should be calling JsonSerializers which in turn then call JsonGenerator.writeXxx() (sub-classes) methods. So inlining all of that seems unlikely.
@cowtowncoder Thanks for the reply! The information that serializeAsField() wouldn't be format-specific is really helpful for me. As for the hidden stack trace, yeah that's strange. I'll look into it a bit more.
I improved the performance of jackson-dataformat-msgpack to some extent in https://github.com/msgpack/msgpack-java/pull/866 without modifying msgpack-core. Based on the benchmark using https://github.com/FasterXML/jackson-benchmarks, the serialization performance improved by 60% in Java 8 and 4% in Java 21, and the deserialization performance improved by 39% in Java 8 and 21% in Java 21. But the performance of JSON serialization and deserialization is basically still better.
I think one of the performance challenges is that MessagePack's Map and Array need to store the number of child entries in the header. This requires the serializer to know the number of subsequent entries before moving forward since jackson-databind framework doesn't provide the number of child entries in advance.
I don't have any plan for further performance improvement at this moment, as the main purpose of jackson-dataformat-msgpack is to integrate jackson-databind and msgpack-core libraries.
@cowtowncoder
As far as I know, com.fasterxml.jackson.core.JsonGenerator#writeStartObject(java.lang.Object, int) exists, but the method doesn't seem to be called in typical jackson-databind use cases. Let me know if you have a plan to activate it for jackson-databind, so that jackson-dataformat-msgpack would take a more straightforward approach.
FYI: This is the detail of the benchmark:
$ uname -a
Linux onion 6.9.3-76060903-generic #202405300957~1732141768~22.04~f2697e1 SMP PREEMPT_DYNAMIC Wed N x86_64 x86_64 x86_64 GNU/Linux
$ lscpu
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: AuthenticAMD
Model name: AMD Ryzen 9 5900HS with Radeon Graphics
CPU family: 25
Model: 80
Thread(s) per core: 2
Core(s) per socket: 8
Socket(s): 1
Stepping: 0
CPU max MHz: 4680.0000
CPU min MHz: 400.0000
BogoMIPS: 6588.27
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid extd_apicid aperfmperf rapl pni pclmulqdq monitor ssse3 fma cx16 sse4_1 sse4_2 movbe popcn
t aes xsave avx f16c rdrand lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt tce topoext perfctr_core perfctr_nb bpext perfctr_llc mwaitx cpb cat_l3 cdp_l3 hw_pstate ssbd mba ibrs ibpb stibp vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid c
qm rdt_a rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local user_shstk clzero irperf xsaveerptr rdpru wbnoinvd cppc arat npt lbrv svm_lock nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold av
ic v_vmsave_vmload vgif v_spec_ctrl umip pku ospke vaes vpclmulqdq rdpid overflow_recov succor smca fsrm debug_swap
$ free -h
total used free shared buff/cache available
Mem: 30Gi 12Gi 6.7Gi 333Mi 11Gi 15Gi
Swap: 19Gi 0B 19Gi
# Original (0.9.8)
$ jenv global 1.8 && java -Xmx256m -jar target/perf.jar ".*StdWriteVan.*PojoMedia.*" -wi 3 -w 1 -i 3 -r 1 -f 3 -t 1
Benchmark Mode Cnt Score Error Units
c.f.j.p.avro.AvroStdWriteVanilla.writePojoMediaItem thrpt 9 489294.500 ± 4924.498 ops/s
c.f.j.p.bson.BSONStdWriteVanilla.writePojoMediaItem thrpt 9 681374.119 ± 8760.644 ops/s
c.f.j.p.cbor.CBORStdWriteVanilla.writePojoMediaItem thrpt 9 1697897.098 ± 61424.954 ops/s
c.f.j.p.csv.CsvStdWriteVanilla.writePojoMediaItem thrpt 9 1105202.397 ± 25253.241 ops/s
c.f.j.p.ion.IonStdWriteVanilla.writePojoMediaItem thrpt 9 533993.139 ± 19634.359 ops/s
c.f.j.p.json.JacksonJrStdWriteVanilla.writePojoMediaItem thrpt 9 1501644.460 ± 57205.124 ops/s
c.f.j.p.json.JsonStdWriteVanilla.writePojoMediaItem thrpt 9 1389623.325 ± 55563.787 ops/s
c.f.j.p.msgpack.MsgpackStdWriteVanilla.writePojoMediaItem thrpt 9 407974.511 ± 6631.502 ops/s
c.f.j.p.props.PropsStdWriteVanilla.writePojoMediaItem thrpt 9 404364.503 ± 8700.286 ops/s
c.f.j.p.protob.ProtobStdWriteVanilla.writePojoMediaItem thrpt 9 1792950.687 ± 35790.732 ops/s
c.f.j.p.smile.SmileStdWriteVanilla.writePojoMediaItem thrpt 9 1557336.040 ± 25948.417 ops/s
c.f.j.p.toml.TOMLStdWriteVanilla.writePojoMediaItem thrpt 9 696477.417 ± 13197.279 ops/s
c.f.j.p.xml.XMLStdWriteVanilla.writePojoMediaItem thrpt 9 628871.650 ± 11299.180 ops/s
c.f.j.p.yaml.YAMLStdWriteVanilla.writePojoMediaItem thrpt 9 121216.044 ± 1968.682 ops/s
$ jenv global 1.8 && java -Xmx256m -jar target/perf.jar ".*StdReadVan.*PojoMedia.*" -wi 3 -w 1 -i 3 -r 1 -f 3 -t 1
Benchmark Mode Cnt Score Error Units
c.f.j.p.avro.AvroStdReadVanilla.readPojoMediaItem thrpt 9 942882.086 ± 7936.068 ops/s
c.f.j.p.bson.BSONStdReadVanilla.readPojoMediaItem thrpt 9 325765.930 ± 9430.468 ops/s
c.f.j.p.cbor.CBORStdReadVanilla.readPojoMediaItem thrpt 9 763711.004 ± 37159.610 ops/s
c.f.j.p.csv.CsvStdReadVanilla.readPojoMediaItem thrpt 9 548974.931 ± 8903.669 ops/s
c.f.j.p.ion.IonStdReadVanilla.readPojoMediaItem thrpt 9 175297.535 ± 4229.962 ops/s
c.f.j.p.json.JacksonJrStdReadVanilla.readPojoMediaItem thrpt 9 763989.637 ± 16085.107 ops/s
c.f.j.p.json.JsonStdReadVanilla.readPojoMediaItem thrpt 9 743932.224 ± 8340.437 ops/s
c.f.j.p.msgpack.MsgpackStdReadVanilla.readPojoMediaItem thrpt 9 424294.124 ± 5798.284 ops/s
c.f.j.p.props.PropsStdReadVanilla.readPojoMediaItem thrpt 9 141666.034 ± 3170.434 ops/s
c.f.j.p.protob.ProtobStdReadVanilla.readPojoMediaItem thrpt 9 895467.969 ± 31109.949 ops/s
c.f.j.p.smile.SmileStdReadVanilla.readPojoMediaItem thrpt 9 962004.705 ± 4778.528 ops/s
c.f.j.p.toml.TOMLStdReadVanilla.readPojoMediaItem thrpt 9 162379.068 ± 1333.447 ops/s
c.f.j.p.xml.XMLStdReadVanilla.readPojoMediaItem thrpt 9 341984.361 ± 22479.115 ops/s
c.f.j.p.yaml.YAMLStdReadVanilla.readPojoMediaItem thrpt 9 53542.854 ± 298.744 ops/s
$ jenv global 21.0 && java -Xmx256m -jar target/perf.jar ".*StdWriteVan.*PojoMedia.*" -wi 3 -w 1 -i 3 -r 1 -f 3 -t 1
Benchmark Mode Cnt Score Error Units
c.f.j.p.avro.AvroStdWriteVanilla.writePojoMediaItem thrpt 9 604146.609 ± 12046.498 ops/s
c.f.j.p.bson.BSONStdWriteVanilla.writePojoMediaItem thrpt 9 511417.334 ± 5997.995 ops/s
c.f.j.p.cbor.CBORStdWriteVanilla.writePojoMediaItem thrpt 9 1394309.459 ± 31171.624 ops/s
c.f.j.p.csv.CsvStdWriteVanilla.writePojoMediaItem thrpt 9 1023008.232 ± 22729.656 ops/s
c.f.j.p.ion.IonStdWriteVanilla.writePojoMediaItem thrpt 9 441537.835 ± 34920.793 ops/s
c.f.j.p.json.JacksonJrStdWriteVanilla.writePojoMediaItem thrpt 9 1333207.671 ± 35654.686 ops/s
c.f.j.p.json.JsonStdWriteVanilla.writePojoMediaItem thrpt 9 1166001.914 ± 40842.917 ops/s
c.f.j.p.msgpack.MsgpackStdWriteVanilla.writePojoMediaItem thrpt 9 782189.492 ± 11111.575 ops/s
c.f.j.p.props.PropsStdWriteVanilla.writePojoMediaItem thrpt 9 625417.873 ± 13297.877 ops/s
c.f.j.p.protob.ProtobStdWriteVanilla.writePojoMediaItem thrpt 9 1263701.715 ± 17541.267 ops/s
c.f.j.p.smile.SmileStdWriteVanilla.writePojoMediaItem thrpt 9 1287249.122 ± 20395.253 ops/s
c.f.j.p.toml.TOMLStdWriteVanilla.writePojoMediaItem thrpt 9 621114.456 ± 9801.864 ops/s
c.f.j.p.xml.XMLStdWriteVanilla.writePojoMediaItem thrpt 9 535547.324 ± 20899.912 ops/s
c.f.j.p.yaml.YAMLStdWriteVanilla.writePojoMediaItem thrpt 9 100167.793 ± 5390.545 ops/s
$ jenv global 21.0 && java -Xmx256m -jar target/perf.jar ".*StdReadVan.*PojoMedia.*" -wi 3 -w 1 -i 3 -r 1 -f 3 -t 1
Benchmark Mode Cnt Score Error Units
c.f.j.p.avro.AvroStdReadVanilla.readPojoMediaItem thrpt 9 872757.955 ± 11472.128 ops/s
c.f.j.p.bson.BSONStdReadVanilla.readPojoMediaItem thrpt 9 355271.843 ± 7764.761 ops/s
c.f.j.p.cbor.CBORStdReadVanilla.readPojoMediaItem thrpt 9 728326.233 ± 27703.471 ops/s
c.f.j.p.csv.CsvStdReadVanilla.readPojoMediaItem thrpt 9 515646.544 ± 23481.202 ops/s
c.f.j.p.ion.IonStdReadVanilla.readPojoMediaItem thrpt 9 178573.660 ± 4258.389 ops/s
c.f.j.p.json.JacksonJrStdReadVanilla.readPojoMediaItem thrpt 9 711433.436 ± 4086.300 ops/s
c.f.j.p.json.JsonStdReadVanilla.readPojoMediaItem thrpt 9 669091.267 ± 34308.260 ops/s
c.f.j.p.msgpack.MsgpackStdReadVanilla.readPojoMediaItem thrpt 9 512168.824 ± 10254.230 ops/s
c.f.j.p.props.PropsStdReadVanilla.readPojoMediaItem thrpt 9 134767.718 ± 3292.295 ops/s
c.f.j.p.protob.ProtobStdReadVanilla.readPojoMediaItem thrpt 9 845397.669 ± 18762.979 ops/s
c.f.j.p.smile.SmileStdReadVanilla.readPojoMediaItem thrpt 9 927000.840 ± 32923.455 ops/s
c.f.j.p.toml.TOMLStdReadVanilla.readPojoMediaItem thrpt 9 185067.273 ± 3969.967 ops/s
c.f.j.p.xml.XMLStdReadVanilla.readPojoMediaItem thrpt 9 321863.934 ± 9639.973 ops/s
c.f.j.p.yaml.YAMLStdReadVanilla.readPojoMediaItem thrpt 9 48877.170 ± 221.066 ops/s
# Optimized
$ jenv global 1.8 && java -Xmx256m -jar target/perf.jar ".*StdWriteVan.*PojoMedia.*" -wi 3 -w 1 -i 3 -r 1 -f 3 -t 1
Benchmark Mode Cnt Score Error Units
c.f.j.p.avro.AvroStdWriteVanilla.writePojoMediaItem thrpt 9 484189.173 ± 18290.273 ops/s
c.f.j.p.bson.BSONStdWriteVanilla.writePojoMediaItem thrpt 9 671714.185 ± 12962.207 ops/s
c.f.j.p.cbor.CBORStdWriteVanilla.writePojoMediaItem thrpt 9 1640309.520 ± 43878.117 ops/s
c.f.j.p.csv.CsvStdWriteVanilla.writePojoMediaItem thrpt 9 1114543.921 ± 18094.287 ops/s
c.f.j.p.ion.IonStdWriteVanilla.writePojoMediaItem thrpt 9 541683.734 ± 30579.006 ops/s
c.f.j.p.json.JacksonJrStdWriteVanilla.writePojoMediaItem thrpt 9 1525445.080 ± 52410.043 ops/s
c.f.j.p.json.JsonStdWriteVanilla.writePojoMediaItem thrpt 9 1379044.699 ± 28883.095 ops/s
c.f.j.p.msgpack.MsgpackStdWriteVanilla.writePojoMediaItem thrpt 9 654176.058 ± 2607.457 ops/s
c.f.j.p.props.PropsStdWriteVanilla.writePojoMediaItem thrpt 9 402786.317 ± 3751.668 ops/s
c.f.j.p.protob.ProtobStdWriteVanilla.writePojoMediaItem thrpt 9 1827131.160 ± 85225.419 ops/s
c.f.j.p.smile.SmileStdWriteVanilla.writePojoMediaItem thrpt 9 1561782.089 ± 37587.722 ops/s
c.f.j.p.toml.TOMLStdWriteVanilla.writePojoMediaItem thrpt 9 701562.140 ± 4652.099 ops/s
c.f.j.p.xml.XMLStdWriteVanilla.writePojoMediaItem thrpt 9 626551.249 ± 8724.151 ops/s
c.f.j.p.yaml.YAMLStdWriteVanilla.writePojoMediaItem thrpt 9 121450.182 ± 1957.381 ops/s
$ jenv global 1.8 && java -Xmx256m -jar target/perf.jar ".*StdReadVan.*PojoMedia.*" -wi 3 -w 1 -i 3 -r 1 -f 3 -t 1
Benchmark Mode Cnt Score Error Units
c.f.j.p.avro.AvroStdReadVanilla.readPojoMediaItem thrpt 9 938416.088 ± 18279.461 ops/s
c.f.j.p.bson.BSONStdReadVanilla.readPojoMediaItem thrpt 9 311643.313 ± 36063.643 ops/s
c.f.j.p.cbor.CBORStdReadVanilla.readPojoMediaItem thrpt 9 774108.518 ± 35444.075 ops/s
c.f.j.p.csv.CsvStdReadVanilla.readPojoMediaItem thrpt 9 546327.588 ± 18188.808 ops/s
c.f.j.p.ion.IonStdReadVanilla.readPojoMediaItem thrpt 9 179408.792 ± 7192.140 ops/s
c.f.j.p.json.JacksonJrStdReadVanilla.readPojoMediaItem thrpt 9 777088.289 ± 14709.751 ops/s
c.f.j.p.json.JsonStdReadVanilla.readPojoMediaItem thrpt 9 754571.907 ± 19127.808 ops/s
c.f.j.p.msgpack.MsgpackStdReadVanilla.readPojoMediaItem thrpt 9 588950.979 ± 5973.814 ops/s
c.f.j.p.props.PropsStdReadVanilla.readPojoMediaItem thrpt 9 140065.414 ± 1545.586 ops/s
c.f.j.p.protob.ProtobStdReadVanilla.readPojoMediaItem thrpt 9 925366.247 ± 22674.691 ops/s
c.f.j.p.smile.SmileStdReadVanilla.readPojoMediaItem thrpt 9 926623.904 ± 97314.726 ops/s
c.f.j.p.toml.TOMLStdReadVanilla.readPojoMediaItem thrpt 9 158045.483 ± 10601.039 ops/s
c.f.j.p.xml.XMLStdReadVanilla.readPojoMediaItem thrpt 9 356776.693 ± 10042.345 ops/s
c.f.j.p.yaml.YAMLStdReadVanilla.readPojoMediaItem thrpt 9 53455.181 ± 495.742 ops/s
$ jenv global 21.0 && java -Xmx256m -jar target/perf.jar ".*StdWriteVan.*PojoMedia.*" -wi 3 -w 1 -i 3 -r 1 -f 3 -t 1
Benchmark Mode Cnt Score Error Units
c.f.j.p.avro.AvroStdWriteVanilla.writePojoMediaItem thrpt 9 613614.464 ± 10309.633 ops/s
c.f.j.p.bson.BSONStdWriteVanilla.writePojoMediaItem thrpt 9 517514.119 ± 31899.281 ops/s
c.f.j.p.cbor.CBORStdWriteVanilla.writePojoMediaItem thrpt 9 1446736.718 ± 16120.590 ops/s
c.f.j.p.csv.CsvStdWriteVanilla.writePojoMediaItem thrpt 9 1011013.776 ± 46175.560 ops/s
c.f.j.p.ion.IonStdWriteVanilla.writePojoMediaItem thrpt 9 451937.382 ± 20203.925 ops/s
c.f.j.p.json.JacksonJrStdWriteVanilla.writePojoMediaItem thrpt 9 1311307.741 ± 24259.011 ops/s
c.f.j.p.json.JsonStdWriteVanilla.writePojoMediaItem thrpt 9 1180875.496 ± 58935.735 ops/s
c.f.j.p.msgpack.MsgpackStdWriteVanilla.writePojoMediaItem thrpt 9 819188.508 ± 17924.771 ops/s
c.f.j.p.props.PropsStdWriteVanilla.writePojoMediaItem thrpt 9 635256.708 ± 8112.452 ops/s
c.f.j.p.protob.ProtobStdWriteVanilla.writePojoMediaItem thrpt 9 1268110.260 ± 58472.673 ops/s
c.f.j.p.smile.SmileStdWriteVanilla.writePojoMediaItem thrpt 9 1276079.005 ± 24722.019 ops/s
c.f.j.p.toml.TOMLStdWriteVanilla.writePojoMediaItem thrpt 9 634812.045 ± 42003.031 ops/s
c.f.j.p.xml.XMLStdWriteVanilla.writePojoMediaItem thrpt 9 538341.481 ± 17356.806 ops/s
c.f.j.p.yaml.YAMLStdWriteVanilla.writePojoMediaItem thrpt 9 101119.267 ± 4703.801 ops/s
$ jenv global 21.0 && java -Xmx256m -jar target/perf.jar ".*StdReadVan.*PojoMedia.*" -wi 3 -w 1 -i 3 -r 1 -f 3 -t 1
Benchmark Mode Cnt Score Error Units
c.f.j.p.avro.AvroStdReadVanilla.readPojoMediaItem thrpt 9 883358.344 ± 38473.482 ops/s
c.f.j.p.bson.BSONStdReadVanilla.readPojoMediaItem thrpt 9 356741.129 ± 1058.394 ops/s
c.f.j.p.cbor.CBORStdReadVanilla.readPojoMediaItem thrpt 9 707527.031 ± 30697.108 ops/s
c.f.j.p.csv.CsvStdReadVanilla.readPojoMediaItem thrpt 9 522711.729 ± 8845.077 ops/s
c.f.j.p.ion.IonStdReadVanilla.readPojoMediaItem thrpt 9 175897.184 ± 4307.639 ops/s
c.f.j.p.json.JacksonJrStdReadVanilla.readPojoMediaItem thrpt 9 706520.434 ± 10029.679 ops/s
c.f.j.p.json.JsonStdReadVanilla.readPojoMediaItem thrpt 9 678177.349 ± 12237.221 ops/s
c.f.j.p.msgpack.MsgpackStdReadVanilla.readPojoMediaItem thrpt 9 619370.674 ± 7608.224 ops/s
c.f.j.p.props.PropsStdReadVanilla.readPojoMediaItem thrpt 9 134554.208 ± 1254.830 ops/s
c.f.j.p.protob.ProtobStdReadVanilla.readPojoMediaItem thrpt 9 851437.188 ± 64361.233 ops/s
c.f.j.p.smile.SmileStdReadVanilla.readPojoMediaItem thrpt 9 938552.295 ± 31819.350 ops/s
c.f.j.p.toml.TOMLStdReadVanilla.readPojoMediaItem thrpt 9 185628.777 ± 1099.247 ops/s
c.f.j.p.xml.XMLStdReadVanilla.readPojoMediaItem thrpt 9 328655.048 ± 10535.818 ops/s
c.f.j.p.yaml.YAMLStdReadVanilla.readPojoMediaItem thrpt 9 48823.265 ± 924.303 ops/s
@komamitsu Nicely done!
On writeStartObject(Object. int)... It's tricky unfortunately. I know its implementation would help with many binary formats aside from MsgPack (Avro and Protobuf in particular, and in some ways CBOR too). So there is definitely desire to be able to call that variant.
But while in some cases entry count is known (simplest serializations), problem are dynamic filters (Views, @JsonFilter) which basically allow configured handlers to be called as part of serialization. Since these are evaluated incrementally (entry by entry) they won't be known at point where START_OBJECT is to be emitted. And at least some use delegation (that is, either block writes or pass, but won't change intermediate data structures).
It may be possible to use the entry-count-specifying variant for some serialization cases, where it can be guaranteed entry count is fully known. I hope this can be done in future.
But I suspect it is not possible/practical to try to make every writeStartObject pass entry count. So backends need to support both cases.
@cowtowncoder Thanks for the details! I didn't think about the dynamic filter, but yeah, it seems to matter...