Remote vs local AI harness and model

I’m interested in moving more of my AI setup to local models and local agents. Part of my thinking about this is considering where data lives and where to consider keeping private data isolated from cloud providers.

Here’s a chart to help visualize where harnesses run, models infer, and data lives based on local vs remote:

Two by two chart. The vertical axis is where the harness runs, the horizontal axis is where the model runs. Local harness and local model: OpenCode with Ollama, LM Studio; your data stays on your Mac. Local harness and remote model: Claude Code CLI, Codex CLI, OpenCode with OpenRouter; your data is on your Mac but sent each turn. Remote harness and remote model: ChatGPT, Meta AI, claude.ai, Codex cloud, Claude Code on the web; your data is on their servers. Remote harness and local model is rare. Siri sits between local and remote models, and Cursor sits between local and remote harnesses.

The top left corner is the only place where everything is completely private and local.

Siri, for me, is the interesting one here, and it’s clear that Apple, ever the privacy-focused company, is thinking a lot about how to do inference locally and to keep your data private and on your devices (rather than in the cloud). Their Private Cloud Compute is designed to give people access to more computing power since compute/inference may be limited on your own devices, and PCC lets you take advantage of the beefier setup Apple can provide without losing privacy.

I mostly hang around the top right corner, where I spend my days chit-chatting with Claude Code. I’m still sending data about me each time I send a prompt to Claude. I’d much prefer not to, and hope to be able to stay in the top left corner or at least use PCC to do more of the work instead (c’mon, Apple!).

I’ve got friends who swear by the bottom right. And, hey, you get free compute from the big AI providers in their epic data centers with your plans, plus it’s a lot easier to not have to worry about keeping your laptop open to make sure your agents are still running.

I think we’re going to end up with a world where we have a mix of these. The trickier thing from a UX standpoint is how to help the user delineate when they’re sharing private data vs data that’s OK to send to a 3rd party provider. I think Apple’s already well suited for this, as they’ve been dealing with this when handling permissions for things like Contacts, Location, etc. The hard part may be in thinking how to protect the user in macOS more since agents on the Mac can pretty much read anything people give them access to.

/software-development #ai #local-ai #personal-ai #apple

Midnight Diner Season 1

Finished up the first season of Midnight Diner a couple days ago. Here are some of my thoughts, which may include spoilers.

When I lived in Japan, a fellow American friend once said it was so frustrating watching television as a poor student: every time you’d turn on the TV you’d see someone enjoying a delicious dish and yelling おいしい! or うまい! on some sort of variety show. Watching TV just got you so hungry. Well, this show doesn’t help.

Being reminded of the dishes in the show just really brings me back. Man, I haven’t had Ochazuke in a while. 懐かしいな

Love the music and the pacing. The way the intro starts in silence and the music and singing comes in just sets the mood from the very start of the whole series.

You never know if an episode is going to end on a feel-good note or more of a less-good note. I guess that’s what life is like, right?

In Episode 8 (Yakisoba), the actress looked super familiar to me. It was one of those things my mind couldn’t let go of, but I wasn’t able to remember on my own (thanks, AI brain rot). I finally had to look her up to figure out that, of course, she was one of the commentators for Terrace House: YOU.

It’s hard to say which episode was my favorite of the season. They each had their own charm. If I had to choose, it would be Neko Manma and Butter Rice. But the line from Tamago Sando: 「安く見るもんじゃないよ」…

Life is like a river… 人生なめんなよ。

/japan #reflection

Another thought about Touch on Mac: I find myself often describing something in a UI or in a screenshot to Claude like “Move the trailing button over or give it more padding” and it can be tedious to describe what I want. If I could circle and say to Claude what I want changed it would be a lot easier. I haven’t used AI in Figma or design apps yet, but I wonder if that’s already a thing. Anyhow, Touch on Mac can probably unlock some of the tedium from the current workflow of UI development.

/software-development #ai #apple #design #ios-development

What I see with the new Touch gestures for Mac is that it’s a testing ground for designing interactions for spatial computing (aka, augmented reality). The Vision Pro is part of this development, and the Mac seems to be part of this now too. Liquid Glass was also part of this. The market and apps aren’t yet ready, so Apple’s teaching consumers the new UX patterns and getting developers geared up on how to design for the interface incrementally.

/software-development #apple #design

Ready Time 3.14: Catch Your Flight

Got an upcoming flight? Feeling nervous about getting to it on time? I’ve been there. There always seems to be a million things to think about before the flight: getting to the airport, being there for boarding, allocating time for security, parking the car, etc etc etc. Oi, there’s way too much to keep in your head!

On Ready Time’s website, we’ve had airport plans to help set up Plans for various airports and departures, but we didn’t have the same setup in the app. Now, with Ready Time 3.14, you can choose Airport Departure in New Plan, pick from 57 airports in the US and Canada, and add your flight time. Your Plan ends at your flight’s departure time, and you’ll get reminders for every Step from the final pack to the gate.

Run a little over on a Step when its time is up? Tap “Still on last step” on the next reminder, or tap the Step that just ended. You get 5 more minutes, and Ready Time updates the start times after it. You can also ask Siri: “I’m still on my last Step in Ready Time”.

For Premium users, Ready Time’s app icon can now match your selected Theme.

You can download Ready Time on the App Store. Feedback? Bugs? Comments? Drop us a note.

/ready-time #ios-development #nerdtower

I’m not much a truck (or even a car) person, but there has been some times recently where I’ve floated around the idea of wanting a truck to help haul bulky things around. Honestly, this rarely happens. BUT, if I were to need to buy a truck, I’d love it to be a Kei Truck. Hope to see more of these on the roads (or maybe more realistically, maybe, on the ranch)!

/japan

Watched first episode of Midnight Diner. Oh, man, I can see myself getting into this. Last Japanese series was Terrace House, guess I’ve been itching for a new one to check out.

/japan

Apple Music Pronunciation

I Don't Care lyrics with katakana pronunciation Southern All Stars' Tsunami lyrics with romaji

Was playing music in Apple Music today and, to surprise, I saw pronunciation for an Ed Sheeran song in…katakana? Woah, when did this show up?

Of course, I had to check out J-pop and Cantopop songs too, and, ’lo and behold, pronunciation in the English alphabet! This is perfect for this ABC/multi-lingual karaoke-loving freak!

Looks like I’m gonna be spending some time karaoke’ing some songs. Cover your ears.

Beyond's 海闊天空 lyrics with Cantonese romanization The Show Pronunciation option in the lyrics menu

If you’d like to try it out yourself:

  1. Open Apple Music, start playing a song
  2. Tap the “lyrics” button on the bottom left of the player
  3. Tap the “translate” button on top of the song’s progress bar
  4. Select “Show Pronunciation”
  5. Sing your heart away!

/japan #apple #music #cantonese

Little Memory 2.3: Siri and Widgets

Who’s got time to use apps anymore, right? Can’t you just talk to AI to do things for you? We’ve got flying cars. Why can’t you write in your diary with just your voice?

Welp, Little Memory 2.3 is out, and you can write a memory without opening the app now. Say “Add a memory in Little Memory” and tell Siri what happened today. If you already saved a memory for the day, Siri will let you know and ask if you want to add to it. Ready Time got Siri last month, and Little Memory was next in line. Welcome to the future.

With Premium, the new On This Day widget shows you a memory from years ago on your Home Screen or Lock Screen. There’s a new Daily Quote widget too. Oh, and now you can find memories from Spotlight by the day or how they start.

Also new:

  • Last Week gives you a summary of the past week every Sunday.
  • With Premium, see the moon’s phase on each day.
  • Writing in Little Memory now counts as Mindful Minutes in Apple Health.
  • You can now swipe between the day’s photos in Photo Recap (I know, this was annoying me too).
  • On iPad, drag in photos from other apps. I haven’t been able to test this on the Duo yet, but in theory this should work there too.
  • A tip jar in Settings, if you’d like to support Little Memory (I’ve had some folks ask me how they can support me more, and here ya go! Thank you from this little indie app developer!).
Morning and evening notifications from Little Memory, and the On This Day widget on the Home Screen showing a memory from exactly 1 year ago

You can download Little Memory on the App Store. If you have feedback, I’d love to hear it. Drop me a note.

/little-memory #ios-development #nerdtower

Just when I thought I’d gotten my tools settled with Xcode 27.2 (and cleaned up needing to work with multiple Xcode versions, juggling between final and beta/RC builds), Apple brings us 27.3 with Siri AI Developer Preview! Siri now has… app skills? And we get Siri Evaluations. It’s definitely been a PITA to test Siri in Simulator (ergh… Device Hub) for the recent Little Memory and Ready Time releases, but without Apple Intelligence to test with in the sims, there’s still the tedious work of manual on-device testing that needs to be done. Hoping Siri Evaluations can help offload some of that so we can automate it.

/software-development #apple #ios-development

Apparently Halloween is the biggest pizza day in the US. I would have thought Super Bowl, but looks like currently Halloween is the winner.

#food

All Thoughts »