[Feature Request] Optional Caching of Retrieved Data

[tylerdotrar]

To the best of my understanding, upon execution rusthound_ce stores objects and queries in the host's memory rather than any other caching methods.

In most cases this is fine, but unfortunately in very large environments it is very possible for the rusthound_ce executable to utilize excessive amounts of RAM (e.g., > 32GB). Upon resource exhaustion and without proper caching, hours of querying and processing is can be lost -- resulting in an "Error: EndOfStream" message.

Similar to AD-miner, a caching option would be nice. I understand this is more of an outlier / niche issue, but a simple toggle parameter, an option to cache every X objects (e.g. --cache 100000), an option caching if the tool fails mid-LDAP object retrieval, or really anything could be a nice quality of life improvment.

[g0h4n]

Indeed actually, this feature is one of the most essential in RustHound CE and requires thorough examination on my part. All help is welcome to develop this feature 💯