Memory allocation logging/tracing/metrics

[ndryden]

Support tracing (similar to our current GPU tracing infra) for memory activities.

Also support getting statistics on memory (e.g., total memory use).