Alright let's start off with the notion that making your own "JARVIS" is beyond viral at this point. As so many people have "made their own", but most of them are just fake. They're just wrappers of claude or maybe hermes ai, that do a fraction of what the 'real' JARVIS can actually do in the movies.

I tried finding a particular video to embed here, and this is what I saw:

Just to prove my point a little bit, there are a lot of fake gurus.

Here are the things that JARVIS and other AI's can do in the MCU:

As you can see, a LOT more than what these fake assistants can do.

Most of it does have to do with combat, OSINT, or other factors that the average person may not need. There is one factor that I think if you are well versed in geopolitics it might help and that being world monitoring. I.e. https://www.worldmonitor.app which is one of TWO DOZEN github repos.

Having that world context might be useful in some cases, understanding the global supply chain, and how that will trickle down to impacting you on the local level.

Maybe I'm projecting too much into this here though.

I made some posts in the past like My DeepDive of De-Googling and Going into Opensource, Linux, Personal Cloud, GrapheneOS, and my own JARVIS? or Your AI Companion, etc. Trying to discuss how to implement this kind of assistant in your life. To me the number one factor is that it needs to be LOCAL, which most of these "JARVIS" or "ai assistant" project repos fail to often account for, and they just again wrap around Claude or something.

Again I can't stress this enough, there are TONS of these types of projects. It is almost overwhelming, and I can't list them all or else that'll be half of the post. Maybe I'll make a dedicated post on it if you really want, so just let me know.


Why have an AI Assistant?

It is a matter of productivity.

When you have something that has access to all the same tools as you, but a large amount faster ability to access them. It is no longer a matter of interface, such as using particular plugins in Obsidian, but rather how fast you can process. How many parallel processes, etc.

The assistant becomes your digital brain, not a second brain (that's too old school), but rather an "Omni-Brain" as I call it.

Orchestrating ai agents, workflows, project management, working through skills you acquired or made yourself, and helping you accomplish your tasks.


How does PKM come into all of this?

PKM = personal knowledge management

I wanted to make this post for a few reasons, very much because of the rise of these "Claude OS" or "Claude.md" hype posts I keep seeing. Not to mention the repeated tech bro video of "openclaw" (which you should NOT use at all), or "hermes agents". I think having an agentic workflow system is very smart, and if you have a reason for it especially.

For every single person though it may be overkill, and just using an AI with mcp with an Obsidian Vault could be tremendously powerful. Technically you could use Logseq as well.

I've said this a number of times, but I'm going to say it again:

The BEST knowledge system is one that is catered towards the human and the AI. A framework that is conducive for manual entries, and automated readings.

Your knowledge vault should be local, synced across devices/backed up to the cloud, have MCP/hooks for a local LLM to read, and have everything you need to be productive with or without AI.

The ideal situation is that of what I just exclaimed, but how you go about doing that is a bit difficult to currently set up. While there are some options, like the aforementioned jarvis repos (which I do not endorse). For the most part there aren't any options that are super proven yet.

Which is why I am building my own technology stack, and there'll be more on that in due time.

Learn more about knowledge management:

🧠 PIOS Omni-Brain = Knowledge Management - Official Website for Dustin Miller PolyInnovator [LLC]
The lego-like all in one productivity system, that you can create your own life operating system or second brain. Following the principles of the Polymath Integration Operating System can help lead you to understanding yourself, and gaining huge levels of productivity! Sometimes also referred to as the Personal Innovation Operating System. Is the amalgam of all aspects behind change in your life, and at every level. ___ SCALE: Yearly >Quarterly > Monthly > weekly > Daily

What should you expect in the near future?

We aren't all going to be running around with our own Jarvis anytime soon, and even if we all have our own personal AI. I think the differentiating factor will be how smart said AI is. Google Gemini or Siri (which is powered by Gemini), are nothing like what I am describing here.

The phones, tablets, computers (particularly mini pc's), and other forms of NPU's. They will make having ai inference at home or on the go viable, the technology is almost there.

P.S. the rise of local AI technology!

Even on a decent graphics card you can run your own dumbed down version of GPT, but that's not ideal unless you have specific use cases for a dumbed LLM. I.e. an ai agent that doesn't need much brain power.

Mini computers are coming with NPU technology, and each generation they are getting stronger and stronger.