Feature #3379

Task #3374: Migrate all core modules from legacy Mentat

Implement mentat-statistician.py module

Added by Jan Mach over 2 years ago. Updated 12 months ago.

Status:ClosedStart date:03/22/2017
Priority:NormalDue date:
Assignee:Jan Mach% Done:


Category:Development - Core
Target version:2.0


Migrate, redesign and implements periodical system performance statistics module.

Associated revisions

Revision 6f1c2627
Added by Jan Mach about 2 years ago

Implemented prototype of mentat-statistician.py module.

Statistician is message post-processing module performing statistical calculations for given time frame and storing them to persistent storage and RRD databases. (Redmine issue: #3379)

Revision 1ce22719
Added by Jan Mach about 2 years ago

Improvements in IDEA statistics library.

Added library constants instead of literals within module code. Added more statistical calculations (min, max, sum, avg). (Redmine issue: #3379)

Revision d9961a80
Added by Jan Mach about 2 years ago

Fix: Added compatibility with Python version < 3.5.

In Python version older than 3.5 it was not possible to expand multiple lists into function call arguments. (Redmine issue: #3379)

Revision 5f761799
Added by Jan Mach almost 2 years ago

Overhaul of IDEA statistic calculation library and RRD manipulation library.

Improved code, documentation and unit tests in IDEA and RRD libraries related to mentat-statistician.py. (Redmine issue: #3379, #1017, #3361)

Revision 82969ae4
Added by Jan Mach almost 2 years ago

Added missing call for RRD chart generation into mentat-statistician.py module.

(Redmine issue: #3379)

Revision 48081ff3
Added by Jan Mach almost 2 years ago

Updated documentation for mentat-statistician.py module.

(Redmine issue: #3379,#3361)

Revision b1395452
Added by Jan Mach almost 2 years ago

Moved toplist calculation of message statistics into internal helper method.

(Redmine issue: #3379,#3361)

Revision b31f8e8b
Added by Jan Mach almost 2 years ago

Added toplist restriction to ASNs and Countries in calculated message statistics.

(Redmine issue: #3379,#3361)

Revision 543c9a62
Added by Jan Mach almost 2 years ago

Checked the mentat.stats.idea module with pylint.

(Redmine issue: #3379,#3443)

Revision dd733f52
Added by Jan Mach over 1 year ago

Changed mentat-statistician.py to work with PostgreSQL instead of MongoDB.

The change was more general, because in fact the storage application plugin and generic fetcher script were changed. (Redmine issue: #3379)


#1 Updated by Jan Mach almost 2 years ago

  • Status changed from New to In Progress
  • % Done changed from 0 to 80

#2 Updated by Jan Mach 12 months ago

  • Status changed from In Progress to Closed
  • % Done changed from 80 to 100

Current state of this module is sufficient for production environment. We are finally releasing 2.0 version of Mentat system, so the period of frantic coding and implementation chaos is over. Any further improvements of this module will be done as they should in separate Redmine issues.

Also available in: Atom PDF