MIT-NOV Hierarchy Analysis
I re-ran the simulations for a simplified set of paramets for MIT-NOV and Cambridge, to make better sense of the data, I ranked each parameter to HGCE (which correspond to different hierarchichal structures) for each metric – see table below:
MIT-NOV, HGCE, BubbleH Rankings - (Exp. Group: DATASET_EXPLORE)
| HGCE, M Paramater | Del.Ratio | Cost | Hops | Latency | Depth(not ranked) | Width (not ranked) | Score? |
|---|---|---|---|---|---|---|---|
| 0.001 | 8 | 5 | 7 | 5 | 3 | 15 | |
| 0.002 | 2 | 7 | 6 | 14 | 5 | 11 | |
| 0.003 | 13 | 3 | 4 | 4 | 3 | 13 | |
| 0.004 | 11 | 4 | 3 | 3 | 4 | 20 | |
| 0.005 | 1 | 2 | 2 | 12 | 2 | 17 | |
| 0.006 | 3 | 9 | 8 | 10 | 5 | 10 | |
| 0.007 | 6 | 12 | 12 | 9 | 5 | 14 | |
| 0.008 | 9 | 13 | 13 | 5 | 4 | 11 | |
| 0.009 | 4 | 11 | 10 | 8 | 5 | 14 | |
| 0.01 | 7 | 14 | 14 | 13 | 4 | 15 | |
| 0.02 | 14 | 7 | 9 | 1 | 3 | 16 | |
| 0.0 | 10 | 9 | 11 | 2 | 3 | 16 | |
| 0.1 | 5 | 1 | 1 | 11 | 5 | 16 | |
| 0.2 | 12 | 5 | 5 | 7 | 3 | 11 |
This table shows the relative rankings for Delivery Ratio, Cost, Hops and Latency for each parameter of M to HGCE (values were derived from the optimum parameters to KCLIQUE based on structure of its output communities, the same parameters were used for each CFA). (Table columns can be sorted by clicking on column headings).
Below is an image of the associated Community Hierarchies
MIT-NOV, HGCE Communities for different threshold values (parameter M to HGCE)
Show below are the four metrics in barchart form, for comparison of actual values:
Delivery Ratio vs Cost, and Hops vs Latency for MIT-NOV, HGCE, BubbleH
From the above we can see that generally, delivery ratio improves with more depth to the hierarchy, however, in this instance a shallow, broad structure does best overall. When ranking by latency, it appears that broad shallow structures perform best.
thought: should we run HGCE multiple times on the same data to see what the range of different structures it comes up with are? Also, we should get another hierarchical CFA (e.g. the other version of link clustering): Did this, and will post results soon.
thought: is there a way of scoring heirarchy based on depth, width and population of communities?