Mozilla Developer Metrics

The current branch is ES6

FFOS Dashboard development is B2G

Objective

This project is designed to optimize the creation of dashboards using ElasticSearch data. Many tools like this exists, for example: Cognos, MicroStrategy, Pentaho and Tableau. Unlike these tools, MoDevMetrics is suited for programmers: Code, testability, and version control are important.

Benefits

• No Server - Dashboards are simply Javascript (AJAX) and HTML. There is no server to setup.
• No Schema - ElasticSearch stores JSON documents with little fixed schema. This is good for rapid prototyping, and makes it easy to annotate data without adding the complications of data migration.
• Code is versionable - Data topology and data queries are described in JSON, dashboard layout is HTML and CSS. This makes the code (and changes to the code) amenable to version control.
• Queries are JSON - Queries are in JSON structures, which are easily transmitted or serialized, and are easily handled by both Javascript and Python. The Qb query form provides an abstraction layer between the docstore/database holding the data and the charting/stats package performing the analysis.

Drawbacks

• No GUI tools - There is no drag-and-drop query builder, You must be proficient in SQL and other high level list comprehensions.
• NO GUI Layout - Layout of dashboard is done in HTML and CSS.
• Limited Charting (for now) - There are better charting libraries out there.

Requirements

Access to one of the bug clusters is required. Use ElasticSearch Head to test connectivity.

• Proxy to public cluster
  http://esfrontline.bugs.mozilla.org:80/public_bugs/bug_version
• Direct to public cluster (need VPN access)
  http://elasticsearch-zlb.bugs.scl3.mozilla.com:9200/public_bugs/bug_version
• Direct to private cluster (need VPN access)
  http://elasticsearch-private.bugs.scl3.mozilla.com:9200/private_bugs/bug_version

Install

git clone https://github.com/klahnakoski/MoDevMetrics.git

Cloning into 'MoDevMetrics'...
remote: Counting objects: 6563, done.
remote: Compressing objects: 100% (3142/3142), done.
remote: Total 6563 (delta 4485), reused 5226 (delta 3148)
Receiving objects: 100% (6563/6563), 17.89 MiB | 234 KiB/s, done.
Resolving deltas: 100% (4485/4485), done.
Checking out files: 100% (437/437), done.

Other Notes

The interesting code starts in ./html/es

• Tutorial on querying ElasticSearch
• Tutorial on MVEL and advanced querying
• Reference document covering the query format
• [Dimension Definitions](https://github.com/klahnakoski/Qb/tree/master/docs/Dimension Definitions.md)