Hardware

Software

How it all ties together

I use Git CLI to interact with my github repos, and I use Visual Studio Code as my editor. In Visual Studio Code, I can open the whole repo folder and have access to all the files. With the Visual Studio Code Extension, Continue, I can interact with LLMs through a Chat interface or request code blocks directly in files using an inline prompt wizard. Continue also offers auto-completion functionality, but I have not enabled it here because it requires much more sustained processing, which generates more heat and uses more battery power than when I explicitly request some inferencing.

Why is it like this?

I wanted to get ahead of any potential tarrifs that could push the cost of a new computer up, and Apple had just released a new one that could pack 128GB of RAM onto a very capable processor. I decided now was the right time to invest in a new laptop.

How is it working out?

With 128GB of RAM, I was able to start using 70b parameter models, like Llama 3.1, Tulu 3, Reflection, and Llama 3.3. I found Llama 3.3 70b to be more useful than the 3.1 7b I was relying on in my previous environment. I still need to be careful on what to use for my context, but it seems like it is better at handling more complex requests.


I also installed Steam on it, and Warhammer 40k Rogue Trader, so while the laptop is capable of helping me develop more complex methods, it is also more capable of distracting me. This is an acceptable trade off for my personal projects, because I have no expectations or deadlines that I worry about me coming down on myself for missing.