Aurora, the Raspberry Pi Smart Assistant

By . Updated on

Aurora, the Raspberry PI AI Assistant

Aurora is an open source smart assistant designed for the Raspberry Pi and functional on Windows, Mac and anything else that can run Python.

Aurora uses the OpenAI realtime API, and is pretty similar to the advanced voice mode in ChatGPT. The idea is a replacement for Amazon Alexa and Google Home that anyone can build and extend.

I have had this running for nearly a year. It was functional but the code was a mess. OpenAI just promoted their realtime API from beta, and that prompted me to refactor the project and get it into shape for a public release.

While Amazon is slowly rolling out an LLM version of Alexa, I'm not buying another device that just wants to show me ads. I also don't want an assistant that has been engineered to minimize costs. Aurora is an exercise in what is possible using the best models available combined with helpful tools.

The project has a plug-in architecture for tool support, so you can pick and choose what makes sense. This first release supports timers, Perplexity Sonar, Todoist and a kid conflict resolution system that in my house is known as 'cheese night'. I'll be adding more tools over time, and the architecture makes it easy to contribute (please do!).

When I first designed Aurora I used an Adafruit BrainCraft HAT which has a small display and some nice LEDs. This combined with a Raspberry Pi 4 and a couple of speakers makes for a compact assistant. The project contains interface code for this specific setup, and also a generic version that will run anywhere. As with tool support the interface can be extended to support other devices.

Check out Aurora on GitHub, contribute if you come up with a cool tool or UI, and please send me a photo if you build an assistant.

Updated 2025-09-13 21:56:

Added support for the Bay Area 511 API to provide arrival times. You configure an agency and stop ID and then can ask 'when is the next L' and get arrival times. This is really useful for me. There is a new tool calling image state for the Raspberry Pi version and times are now poems based on the timer name.

Updated 2025-09-21 19:44:

Recipe support added. Ask Aurora to cook with you and she will guide you step by step through a recipe.

LIFX light bulbs are also now supported. Add names and IDs to settings and then Aurora can switch lights on and off.

Also added OpenSCAD and STL files for 3D printing a case for the BrainCraft version.

Updated 2026-02-28 18:46:

Upgraded to the new gpt-realtime-1.5 model. Also added a setting so it's easy to go back to the original gpt-realtime if that's what you prefer.

Updated 2026-06-27 23:20:

Added a flash briefing tool. By default this downloads and plays the most recent episode of the BBC Global News Podcast. There is a setting to override this with the RSS feed for the podcast of your choice.

Aurora also now features native wake word detection (more details here). This should work reasonably well out of the box, but you can also train it to better recognize your voice and environmental false triggers. It's also possible to train a new wake word from scratch if you'd prefer a different name.

Updated 2026-08-08 16:24:

Aurora gets into a lengthy discussion with Alexa, which eventually gives up.

Updated 2026-10-25 22:46:

Moved from Realtime to GPT-Live. This makes for a much more natural experience with full duplex and task chaining - you can now ask Aurora to switch on a light, add a to do item and tell you a story in one request. There are some configuration changes so if upgrading check .env.example and see the new example backend instructions (GPT-Live has instructions for the model talking to you, gpt-live-1, and the model handling tool calls, gpt-5.6-luna by default). A new version of the OpenAI client library is required as well so upgrade based on requirements.txt.

Grewingk Glacier

By . Updated on

Grewingk Glacier

Hike to the Grewingk Glacier in Kachemak Bay State Park. Inaccessible by car, so it's a boat ride from Homer to across the trail and pick you up at the other end. Lots of varied forest and then the glacier is incredible.

Hike starts at: 59.612729, -151.190267. View in Google Earth.

Updated 2025-08-02 18:53:

Sunset Dunes

Sunset Dunes Park in San Francisco

Sunset Dunes is the newest park in San Francisco, created in the November 2024 election by a controversial ballot measure. It's a two mile stretch of the Great Highway that was often closed due to drifting sand. The road was also closed to traffic during the pandemic, a move popular enough to get enough support to convert it to a full time park. Many people are mad with this development due to traffic spilling onto neighboring streets and increased commute times, to the extent that there is a recall campaign against the local supervisor. I'm bored of recall campaigns and NIMBYs and voted in favor of the new park. 

The video below is a hyperlapse of the two miles from the Golden Gate Park to Sloat Boulevard through Sunset Dunes and then the two miles back on Ocean Beach. 

Not much has changed since the pandemic experience. This isn't surprising as the ballot measure didn't add any funding for the park. The two sides of the original Great Highway are divided into a slow lane and a fast lane which makes sense. There are a few street murals and art installations dotted along the road which are fine but seem beside the point. I hope this remains as a safe space to cycle, scoot, board and stroll.

Hike starts at: 37.767321, -122.509288. View in Google Earth.

L Taraval

SFMTA L Taraval Light Rail

Time lapse of the L Taraval light rail from West Portal station to the San Francisco Zoo. The L shut down during the pandemic and then years of construction replaced the tracks (and water lines, and sewers). It finally returned in September of 2024. I made a time lapse of the construction phase outside my house.