Infinispan and Caching Notes
· 28 min read
Here's some notes I took a long time ago whilst studying Infinispan, an open-source, in-memory data grid and distributed key-value NoSQL database developed by Red Hat.

Here's some notes I took a long time ago whilst studying Infinispan, an open-source, in-memory data grid and distributed key-value NoSQL database developed by Red Hat.

I never write about caches and caching, so I thought I'd cover some basics on LLM caching. Covers inference and prompt caching.

Some notes on false sharing and cache line padding.

Some notes on the basics of CPU caches - covers locality, write policies, hierarchy and inclusion policies.
