Logging

at
LeShop.ch

looks like there was some trouble with logging at leshop


Fact before the project

  • Local storage
    • depending on the lunar geologic timescale 
  • Log rotation
    • it depend
  • Sometime
    • no log at all

Date


  • Started in January 2013
  • 8/20 days spent on the project 
  • Approximately 50% of the project completion

Actual numbers


Log line per month

1'000'000'000
10E9
1 billions

Average log line size

2.5 Mega Byte

logginG right now

  • Website tomcat server 
    • Prod
    • Acc
  • Mobile tomcat server v5 & v6
    • Prod
    • Acc
  • Part of bigip virtual server
  • Warehouse printing

Storage right now


30 days on server

5 day in elastic search

2 year in syslog-ng

Storage goals


30 DAYS ON SERVER

6-12 months IN ELASTIC SEARCH

2 YEAR IN SYSLOG-NG

Architecture


Important link

deck

By braoru

deck

  • 2,091