JMH benchmark of Java object-to-object mapping frameworks
Object-to-object mapping framework microbenchmark
Multi-layered applications often require to map between different object models (e.g. DTOs and entities).
Writing such boiler plate mapping code is a tedious and error-prone task.
A lot of object-to-object mapping Java frameworks aims to simplify this work and automate it.
Some uses code instrospection (eg. Dozer). Other uses code generation (ex: MapStruct).
This micro-benchmark compares performance of 9 frameworks. Results could be compared to the benchmark of a code written manually.
Benchmark are powered by a tool called JMH or also known as “Java Microbenchmarking Harness”.
JMH is developed by the OpenJDK team.
Benchmarked object to object mapper frameworks
Contributing to benchmark
Github is for social coding platform: if you want to add another mapping framework or optimize an existing one, we encourage contributions
through pull requests from forks of this repository.
If you want to contribute code this way, please reference a GitHub ticket as well covering the specific issue you are addressing.
To add a new mapper, please add a unit test that extends the AbstractMapperTest class and declare your mapper into the MapperBenchmark class.
Data model
The data model used by this benchmark is very basic. It comes from the Comparison class from the ModelMapper framework.
It includes combinations which usually appear in Java Beans, such as:
- Object types
- Collections
Launch the benchmark
Pre-requisites: Maven 3.x and a JDK 8 (or above)
git clone git://github.com/arey/java-object-mapper-benchmark.git
mvn clean install
java -jar target/benchmarks.jar
Optional: To run a single benchmark, such as MapStruct, use java -jar target/benchmarks.jar -p type=MapStruct
Interpreting the Results
The benchmarks measure throughput, given in “ops/time”. The time unit used is seconds.
Generally, the score represents the number of graph object mapped per second; the higher the score, the better.
Results
Tests has been performed on:
- OS: macOS High Sierra
- CPU: 3.1 GHz Intel Core i7, 2 cores, L2 Cache (per Core): 256 KB, L3 Cache: 4 MB
- RAM: 16 GB 1867 MHz DDR3
- JVM: Oracle 1.8.0_74-b02 64 bits
| Benchmark | Mode | Samples | Score | Margin error (+/-) | Units |
|---|---|---|---|---|---|
| Manual | thrpt | 200 | 26 978 437 | 615 002 | ops/s |
| MapStruct | thrpt | 200 | 28 039 597 | 199 255 | ops/s |
| Selma | thrpt | 200 | 27 518 789 | 238 602 | ops/s |
| JMapper | thrpt | 200 | 24 531 754 | 123 945 | ops/s |
| Orika | thrpt | 200 | 4 565 378 | 24 947 | ops/s |
| ModelMapper | thrpt | 200 | 184 304 | 12 777 | ops/s |
| Dozer | thrpt | 200 | 89 860 | 462 | ops/s |
| BULL | thrpt | 200 | 178 027 | 679 | ops/s |
| datus | thrpt | 200 | 8 230 775 | 59 673 | ops/s |
Documentation
- Micro-benchmark of Java mapping object frameworks (french article)
Generating plot
- Run benchmark while exporting results to csv with
java -jar target/benchmarks.jar -rff results.csv -rf csv - Use gnuplot to generate plot with
gnuplot benchmark.plt. This will outputresults.png.