llvm-project/llvm/tools/opt-viewer
Adam Nemet 817e90f11e [opt-viewer] Reduce memory consumption by another 20-25%
The Args field of the remark which consists of a list of mappings in YAML is
translated into a list of (small) dicts on Python.  An empty dict is 280 bytes
on my system so we can save memory by using a tuple of tuples instead.

Making a tuple of tuples rather than a list of tuples allows Args to be shared
with the key of the remark.  This is actually an even greater saving. (Keys
are alive throughout the entire run in all_remarks.)

Here are a few opt-stats runs with different input sizes while measuring heap
usage with heapy.  Avg remark size is simply estimated as
heap-size / # of remarks:

  | # of files             |   60 |  114 |  308 |  605 | 1370 |
  | # of remarks           |  20K |  37K | 146K | 180K | 640K |
  | total file size (MB)   |   22 |   51 |  219 |  202 | 1034 |
  |------------------------+------+------+------+------+------|
  | Avg remark size before | 4339 | 4792 | 4761 | 4096 | 4607 |
  | Avg remark size after  | 3446 | 3641 | 3567 | 3146 | 3347 |
  | Rate                   | 0.79 | 0.76 | 0.75 | 0.77 | 0.73 |

Differential Revision: https://reviews.llvm.org/D35611

llvm-svn: 308538
2017-07-19 22:04:59 +00:00
..
CMakeLists.txt
opt-diff.py [opt-viewer] Reduce memory consumption by another 20-25% 2017-07-19 22:04:59 +00:00
opt-stats.py [opt-viewer] Print allocated memory per remark in opt-stats.py 2017-07-19 22:04:58 +00:00
opt-viewer.py [opt-viewer] Reduce memory consumption by another 20-25% 2017-07-19 22:04:59 +00:00
optpmap.py [opt-viewer] Flush stdout after progress update 2017-07-14 04:54:26 +00:00
optrecord.py [opt-viewer] Reduce memory consumption by another 20-25% 2017-07-19 22:04:59 +00:00
style.css