Note that essentially all of this software is free and offline. You can get very similar functionality if you use ShareLatex.com, which has a splitscreen LaTeX+rendered output setup by default. This is free, but online. It is possible for you to configure a MathJax setup to make this work in a way very similar to how MathJax works on Math.SE. The changes between 2.3 and 2.4 are not relevant for the guide (though an update will be needed now that 2.5 is out). The 186MB "size" you note is probably "size-on-disk" which depends on the file system (and is due to the many small images in the TeX image fonts); still, v2.3+ is larger than 2.0 (which the outdated page is about) due to the optional fonts.

How to use MathJax in Anki & AnkiDroid (online and partially-offline) This method will be using MathJax’s CDN. For AnkiDroid, once you have loaded a card with MathJax while you are online, Android's WebView will cache it for you; meaning, you can now use MathJax offline. By becoming a MathJax Friend, organizations show the community that they support the goal of easy-to-use, high-quality mathematics display on the web for everyone, and are contributing in a very concrete way to help MathJax realize that goal. MathJax Friends will be listed on the MathJax Sponsors page. If you want MathJax to be available offline or without including resources from a third-party site, you have to download it and set this value to a different path. The path can be absolute or relative; if it is relative, it is relative to the _static directory of the built docs.