Couchbase Server 3.0

Performance Status

02/26/2014

General news


  • Intelligent build-to-build comparison
  • Compaction tests enhancements
  • Specification/description of performance tests




improvements


  • 2-3x faster initial indexing (non-DGM/DGM)
  • 3x  faster incremental indexing (non-DGM/DGM)
  • 2x lower query latency (stale=false)
  • 2-3x faster rebalance with views
  • 2x  faster KV rebalance out/swap

Regression


  • MB-10273: View compaction doesn't catch up in basic non-DGM tests with view queries
  • MB-10301: Major drops (up to 30%) in ops/sec in write-heavy performance test
  • MB-10302: Bucket compaction doesn't catch up causing higher disk usage in write-heavy tests

NOT REPORTED REGRESSION


  • Higher memory overhead due to UPR (waiting for MB-9897)

STILL NOT CLOSED


  • MB-10259: Constant ep-engine crashes during load phase
  • MB-10250: Higher memory fragmentation in append only workloads
  • MB-10164 :  Warmup is 1.5 slower in recent 3.0 builds
  • MB-10162 :  Views produce empty index during workload with ongoing mutations/indexing
  • MB-10167 :  20-25% higher beam.smp memory utilization in cases with views (2.5 vs 3.0)
  • MB-10192:  ep-engine crashed when reading data through TAP 

2.x DebT


  • couchbase-bucket: 10 issues
  • xdcr: 4 issues
  • ns_server: 4 issues
  • view-engine: 2 issues
  • moxi: 1 issue

BACKLOG


  • Gathering input from PM team
  • Workloads based on customer cases
  • System stats collection on Windows

BLOCKERS


  • CBD-1222:  windows build fails for 3.0.0 branch
  • CBIT-296: client machines for regression tests
  • CBIT-707: client machines for Atlas cluster
  • CBIT-654: new cluster for continuous tests

3.0 Performance Status

By Pavel Paulau

3.0 Performance Status

  • 459