A Series of Posts on JLBH (Java Latency Benchmark Harness)

Introducing a set of 5 blog posts on JLBH

These set of posts should be useful for anyone responsible for creating or benchmarking real Java applications.

As well as introducing the open source JLBH benchmarking harness we go into some of the subtleties that underpin latency benchmarking in Java with real code examples.

1) JLBH - Introducing Java Latency Benchmarking Harness

• What is JLBH
• What was the motivation for JLBH
• Differences between JMH and JLBH
• Quick start guide

2) JLBH Examples 1 - Why Code Should be Benchmarked in Context

• A side by side example using JMH and JLBH for Date serialisation
• Measuring Date serialisation in a microbenchmark
• Measuring Date serialisation as part of a proper application
• How to add a probe to your JLBH benchmark
• Understanding the importance of measuring code in context

3) JLBH Examples 2 - Accounting for Coordinated Omission

• Running JLBH with and without accounting for coordinated omission
• An example to in numbers the effects of coordinated omission
• A discussion about flow control

4) JLBH Examples 3 - The Affects of Throughput on Latency

• A discussion about the effects of throughput on latency
• How use JLBH to measure TCP loopback
• Adding probes to test both halves of the TCP round trip
• Watching the effect of increasing throughput on latency
• Understanding that you have to drop throughput to achieve good latencies at high percentiles.

5) JLBH Examples 4 - Benchmarking QuickFix vs ChronicleFix

• Using JLBH to benchmark QuickFIX
• Observing how QuickFix latencies degrade through the percentiles
• Comparing QuickFIX with Chronicle FIX