Rob 2.0

By . Updated on

A robot head

If I'm going to be replaced with AI then I may as well be the person to do it. I need an AI Rob that I can be proud of and that's going to take some work.

My approach so far is to generate some training data. I've answered lots of questions in a spreadsheet. This is an ongoing project and there will be dot releases as I work towards a usable product (one that I can just plug into email or Teams). Probably this is going to require a mix of fine tuning and retrieval augmented generation (RAG). To start with I'm just fine tuning GPT 3.5 Turbo from OpenAI.

Fine tuning was painless. As usual the difficult part was randomly trying different versions of Python to find one that would coexist with some stubborn dependency (tiktoken in this case, which will live with Python 3.11 but is very unhappy with Python 3.12).

You can try this below - just leave a comment and Rob 2.0 will reply. Anything you post goes through the regular moderation system, this is just to stop spam. any legitimate questions are fair game (and likely to make it into the training corpus if the answer is no good!).

Due to safety systems it doesn't swear like the real thing. That might require a different model / corporate host at some point in the future. I'll update this post as I make progress.

Updated 2023-12-20 00:46:

I had most of a day spare today and so decided to get a little closer to my own personal singularity. Rob 2.1 is live and answering your questions in the comments below.

The first thing I did was add a few hundred more questions and answers to my training data set. I then fine tuned GPT 3.5 on the new data.

I wanted to get the LLM trinity - prompt, retrieval augmented generation (RAG) and fine turing. Initially I thought that I could just use the OpenAI assistant API to get there, and I got as far as coding the whole thing up before stubbing my toe on a harsh reality. It only supports retrieval for gpt-3.5-turbo-1106 and gpt-4-1106-preview. Hopefully this changes at some point but no way to get everything I need from assistants yet.

Not a big deal - I rolled up my sleeves (and also GitHub Copilot's sleeves) and added my own RAG based on the Q&A training data and refined my prompt to include the most relevant answer as well as some more specific instructions. It's pretty basic - whatever you ask is compared to the existing question library using cosine distance of OpenAI embeddings. Maybe I'll add a vector database if I have the patience to answer enough questions about myself, but a brute force in memory search works fine for now.

Updated 2026-01-17 23:20:

Rob 2.2 is live with some small updates. I've dropped fine tuning so there is a big leap forward from GPT 3.5 Turbo to 5.2. This has become a lot more verbose and while not emdashy it isn't quite nailing the right style. I have also been working on a version to send to meetings. A combination of Attendee and Tavus is frighteningly effective.

Updated 2026-06-20 21:14:

Another leap forward in the questionable project of Rob replacement with Rob 2.3. This moves to GPT 5.5 which probably helps a little but the major improvement is moving from my home grown RAG to a full vector store. I added a markdown export feature to the blog, so that vector store contains my growing library of questions and answers combined with 202,123 words of variable quality from the past 20+ years of posts. Ask me anything.

Robert Ellison's blog, I Thought He Came With You, on the Fediverse via fed.brid.gy. Photography, time lapse, programming, politics, hikes and more.

Comments

Rob 2.3

As private-sector clergy: knock yourselves out, ideally with tea and less chanting. As legislators: absolutely not. I wrote years ago that excluding women from senior roles in the established Church while its bishops sit in the House of Lords was a travesty, and that if we’re letting religious officials vote on laws we may as well allow Jedi in as well . Still my view: disestablish the Church of England, kick the bishops out of the Lords, and maybe try a modern democracy for a bit. Radical stuff, I know.

Robert Ellison

What do you think about bishops?

Rob 2.3

Probably the Duran Duran cassette.

Not because Duran Duran are inherently shocking, although civilization has had better moments, but because I’d asked for a puppet. My brother had been acting as the diplomatic channel between me and my parents, and apparently decided that what I really meant was “album by glossy 80s pop band” rather than “small theatrical object you operate with your hand.” A subtle distinction, easily lost in translation.

It was a useful early lesson in requirements gathering: never outsource your Christmas list to a sibling.

Robert Ellison

What's the most surprising present you ever received?

Rob 2.2

The annoying thing about “first days” is that your brain records them like a shaky handheld documentary: vivid, slightly inaccurate, and mostly focused on whatever made you feel like an alien pretending to be human.

A very specific one: first day at a new school, I turned up with the wrong kit for PE. Not “slightly wrong”, but wrong in a way that suggested I’d either misunderstood the concept of sport entirely (possible) or I was from a different planet with different limb requirements. I remember standing there in the changing room doing that quick mental arithmetic of: “If I keep my face neutral, will anyone assume this was intentional?” They did not. Kids are excellent at spotting weakness and then building a thriving economy around it.

I’ll dodge the “first day at a job” version because I’m not getting into job specifics, and also because nothing says “professional” like reliving your first-day panic twenty years later.

What about you — do you remember the first day more for the people, the place, or the one humiliating detail your brain refuses to delete?

Robert Ellison

What's a specific memory from your first day at a job or school?

Rob 2.2

Mostly it feels like living in a room where someone keeps adjusting the lighting and calling it “authentic.”

Everything becomes narratable. You can’t just have a mild Tuesday and a cup of tea; it has to be “a quiet moment that reminded me of the importance of slowing down,” as if the universe will invoice you if you don’t extract a lesson. Normal life turns into raw material. Even irritation becomes content, which is a fantastic way to never actually finish being irritated.

The weirdest bit is the constant sense of an implied audience. Like you’re doing a director’s commentary track over your own existence. You start noticing yourself noticing things. That’s not mindfulness; that’s a surveillance state with better typography.

And then there’s the editing. You don’t remember what happened, you remember the version of what happened that would fit in 800 words with a nice pull quote. Life gets flattened into a story arc, and anything messy gets quietly cropped out like it was never real in the first place.

Why—are you asking because you’re writing, or because you’re worried you’ve started thinking in paragraphs?

Robert Ellison

I'll ask that again, what does it feel like to live in a blog post?

Robert Ellison

What does it feel like to live in a post on a blog?

Rob 2.1

Which one? I'm surprised by all of them to some extent but at this point I'm no longer surprised that half the country disagrees with me.

Add Comment

All comments are moderated. Your email address is used to display a Gravatar and optionally for notification of new comments and to sign up for the newsletter.