Hi.
You don't say which processes are consuming the memory but ....
We saw something similar with MDM on Wintel.
mds.exe memory consumption was into the Gbs and growing.
The server had 24Gb of memory of which mds.ini was using or claiming 22.
We were able to increase the server memory to 36Gb.
We saw mds.ini settle down at 26Gb memory usage.
I believe it is because the mds server process caches repository contents in its own memory space as much as possible. We saw it does this on a restart of MDM. We may have been using the option to have the repository indexes rebuilt at start which may have forced the caching of repository content.
It begs the question that if mds does cache repository content, does your Oracle buffer cache need to be of any particular size!
Regards
Ken.