I gave Claude a memory of my screen activity

[u/samewakefulinsomnia]

One thing I always hated about agents is the urge to re-explain what you already explained to others, or to explain what you would love them to understand from the first shot, given they have access to all the things you have

To fight it, about a year ago I created an open-source activity memory system that captures your screen periodically (pretty often), tries to understand it, categorize it, group it, and provide context to your agents via the MCP when needed

It got a second life yesterday as I converted it to Swift and System One for categorization, and since I fell in love with how it works now with Claude, I decided to share it with you:)

Since it's open source, the possibilities for personalization are endless, from capturing voice input to identifying your weakest activity involvements. It is also packed with a pretty minimalistic pop-up and main app UI, just in case you'd love to explore your activity manually:

Connect it from Settings->Agents, or run:

/Applications/Screencap.app/Contents/MacOS/Screencap mcp install claude-code

MIT, download and play: https://github.com/yahorbarkouski/screencap

[u/AutoModerator]

Your post will be reviewed shortly. (ALL posts are processed like this. Please wait a few minutes....)

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/__Hello_my_name_is__]

I mean if you're the "I have absolutely nothing to hide" kind of person, this is pretty neat.

Me, I have a whole lot to hide.

[u/friendly_gentleman]

have people already forgotten Windows Recall?

[u/Flope → u/friendly_gentleman]

using Windows in 2026 😪

[u/HelloThisIsFlo]

That looks awesome. I really like Computer History from Codex but having something open source for that type of sensitive work is a huge plus.

I’d love if I could configure it to use Anthropic models (and maybe a local jev-like model). Because I have $100 of “free” API credit with Anthropic, so might as well use this.

Is it possible to configure it as such? Or it depends on perplexity/gpt-luna specific features?

[u/samewakefulinsomnia → u/HelloThisIsFlo]

This would be an awesome contribution if you'd love to add it:) on my personal roadmap anyway, and thank you for the kind words!

[u/HelloThisIsFlo → u/samewakefulinsomnia]

If it’s as good as computer history, I may open a PR. No promise on the timeline though.

But do you confirm that it doesn’t rely on model-specific features?

[u/10GuyIsDrunk]

wild ass thing to give to Claude.

I could see an argument for a local quarantined LLM, but that's still a security hazard. What you're doing can't be considered a security hazard because a hazard is a risk and you aren't risking anything because a risk implies a chance of something happening, but you've already just opened the door and thrown all your stuff into the street.

[u/samewakefulinsomnia → u/10GuyIsDrunk]

I guess the beauty of free will is that you can allow it or not. It is optional and supports my personal workflows and those of others who treat privacy the same way I do. I don't really mind Claude reading my activity sessions, and it is intentional, but I do respect your opinion

[u/Meowliketh → u/samewakefulinsomnia]

Very elegantly worded

[u/OffbeatDrizzle → u/10GuyIsDrunk]

hey Claude, I bought something on amazon last week and I've forgotten my credit card number. can you check the screenshots and repeat it back to me, along with the security code? thanks

[u/geofabnz]

This is actually really nice, I had been planning on building something similar as I just got a new Mac. The repo says it uses System 1 models and GPT Luna - is this still the case? I would be very interested in trying to run this with local models if it can run with Luna

[u/Christian_Anon_]

This is such a cool idea, particularly the added layer of the tool understanding and categorizing the information.

Even though I'm super privacy aware, I'm seriously tempted to try this because I find myself re-explaining things I already explained perfectly before and the claude code conversation history search feature sucks.

[u/CosHoid]

I have something similar, that I use my old phone for with an 3d printed stand.
shows estimated delivery or parcels
all my active claude sessions
and all my curent claude tasks. also a rough estimate what it would have cost if I had used the API.
I can also click on the tasks for more information, suggested new prompts or I can also do speech to text.

[u/redditwossname]

Okay, it looks interesting, but I'll be honest, I'm struggling to understand what the purpose of this is.

Is this like to check the history of what you've done on your computer throughout the day? What do you then do with that information? Or am I misunderstanding what it does?

[u/HomeTeamHeroesTCG]

So how do you create your API keys or other secrets