Benchmarking "omics" software: the common way

• A new method is available with a preprint
• No comparative evaluation is available at the time of release
• Peer review of the preprint does not improve this situation
• Months or years after release, the method may be independently evaluated

Benchmarking "omics" software: the LEMMI way

• A new method is available with a preprint
• An independent evaluation on generic problems is included at the time of release
• This facilitates peer review of the preprint, necessary to value the technical innovations specific to the methods
• As fixes or new versions of the method can have a major impact, they can be directly re-evaluated