Six months ago, I gave my AI agent a name, a personality, and access to my entire digital life. It reads my emails, manages my calendar, monitors my servers, writes first drafts of content, and messages me on Telegram when something needs attention. Its name is Baibot, and it's the closest thing I have to a co-founder.
This isn't a story about ChatGPT. It's not about asking a chatbot clever questions. This is about building an autonomous AI agent that lives on a VPS, runs 24/7, and actually does work — not just answers questions about work.
Here's what happened, what works, what doesn't, and why I think every engineer should build one.
Why I Built It
I'm an engineer and maker. I run a small operation — consulting, hardware prototyping, a workshop, a few side projects. The usual indie founder juggling act. I was spending 2-3 hours a day on what I call "operational overhead": email triage, checking calendars, researching suppliers, writing updates, monitoring infrastructure.
None of this is hard. All of it is draining. And all of it follows patterns that a sufficiently capable AI could handle — not perfectly, but well enough to save me from the cognitive tax of context switching twenty times before lunch.
So I asked myself: what if I stopped using AI as a fancy search engine and started using it as a persistent collaborator?
The Architecture: Simpler Than You Think
Baibot runs on a single VPS. Here's the stack:
- A Linux server (4 vCPU, 8GB RAM) — nothing exotic
- Claude as the LLM backbone — via API, not the web interface
- A custom agent framework that handles sessions, memory, and tool execution
- Telegram as the primary interface — I talk to Baibot like I'd talk to a teammate
- File-based memory — daily logs, long-term memory files, semantic search
- Tool access — shell commands, file operations, web search, email, calendar, social media
No Kubernetes. No microservices. No vector database cluster. It's a single process on a single machine, and it handles everything I need. The entire infrastructure costs less than a nice lunch per month.
The Memory System
This is the part most people get wrong. A chatbot has no memory — every conversation starts from zero. An agent needs to remember.
Baibot maintains three layers of memory:
- Daily logs — raw events, conversations, decisions. One file per day.
- Long-term memory — curated facts, preferences, project states. Manually maintained (by the agent itself).
- Semantic search — a search index over all notes, so Baibot can recall context from weeks or months ago.
When Baibot starts a new session, it reads today's log, yesterday's log, and its long-term memory file. It knows what we discussed this morning, what tasks are pending, and what my preferences are. This is fundamentally different from a stateless chatbot.
What Baibot Actually Does Every Day
Let me walk through a typical day:
8:00 AM — Morning brief. Baibot runs what I call the ECNT process: Email triage, Calendar review, Notes/vault check, Tasks review. It summarizes what needs my attention, flags urgent items, and drafts responses for routine emails. I get a Telegram message with everything I need to start the day.
Throughout the day — Heartbeats. Every few hours, Baibot checks for new emails, calendar changes, and system alerts. If something important comes in, it messages me. If not, silence. This is key — a good agent knows when not to bother you.
On demand — Research and drafting. "Baibot, find three CNC suppliers in Germany that can do aluminum prototyping under 500 units." Or: "Draft a proposal for the client project, focus on the timeline." It searches, synthesizes, and delivers a first draft that I edit rather than write from scratch.
Infrastructure monitoring. Baibot keeps an eye on the servers — Syncthing sync status, disk space, service health. If Syncthing falls over at 3 AM, I find a message waiting when I wake up, not a mystery failure I discover two days later.
Content creation. This blog post started as a conversation with Baibot. I outlined the structure, Baibot helped research and draft sections, I rewrote and edited. It's not "AI-generated content" — it's a collaborative writing process, the same way you'd work with a human editor.
What Works Better Than Expected
Email triage is transformative. I used to spend 45 minutes every morning on email. Now Baibot categorizes everything, drafts responses for the routine stuff, and surfaces only what needs my brain. The time savings alone justified the entire project.
The Telegram interface is underrated. There's something about messaging your AI on the same app where you message humans. It feels natural. No special interface, no dashboard to check. Just a conversation thread that happens to be with an agent that can execute code, search the web, and manage files.
Memory compounds over time. After six months, Baibot knows my projects, my preferences, my writing style, my suppliers, my schedule patterns. Every interaction adds to a shared context that makes future interactions more efficient. This is the compound interest of personal AI.
What Doesn't Work (Yet)
I'm going to be honest because the AI hype machine isn't doing anyone favors:
Judgment calls are still mine. Baibot can draft a client email, but it can't decide whether to push back on a deadline. It can research suppliers, but it can't evaluate whether a supplier's quality claims are credible. The moment something requires nuance, experience, or relationship context, it's back to me.
Long-running tasks need babysitting. "Research this topic and write a report" works. "Manage this project over the next two weeks" doesn't. The agent is excellent at bounded tasks and unreliable at open-ended, multi-day workflows. It loses the thread.
Hallucinations are real. Baibot will occasionally invent email addresses, misremember dates, or cite sources that don't exist. I've learned to verify anything that matters. Trust but verify isn't just a saying — it's a workflow requirement.
Cost management is non-trivial. When you give an AI agent tool access and let it run autonomously, API costs can spike. A research task that involves twenty web searches and a long analysis chain can cost more than you'd expect. I've built in cost-awareness, but it's an ongoing challenge.
Why This Isn't Just ChatGPT With Extra Steps
People ask me: "Why not just use ChatGPT?" It's a fair question, and the answer comes down to three things:
Persistence. ChatGPT doesn't know what you did yesterday. Baibot does. It knows what you discussed at 9 AM, what tasks you completed, what's still pending. This continuity is not a feature — it's the foundation.
Agency. ChatGPT waits for you to ask. Baibot acts. It checks things proactively, alerts me to problems, and executes tasks without being prompted. The shift from "I ask, it answers" to "it monitors, it decides, it acts" is the entire point.
Integration. Baibot lives in my infrastructure. It can read my files, run shell commands, manage my servers, access my tools. ChatGPT lives in a browser tab. The difference between having a consultant on a call and having a teammate with access to the codebase.
What I'd Tell You If You Want to Build One
Start small. Don't try to build a general-purpose agent. Start with one workflow — email triage, or daily briefings, or research tasks. Get that working reliably before expanding.
Memory is everything. The quality of your agent depends almost entirely on how well it remembers context. Invest in the memory system first, tools second.
Choose the right interface. I use Telegram because it's always on my phone. Some people prefer Slack, Discord, or a custom web UI. Pick whatever you'll actually use daily.
Budget for mistakes. Your agent will do dumb things. It will send a malformed API request, misinterpret an instruction, or run a command you didn't expect. Build guardrails, use confirmations for destructive actions, and assume things will go wrong.
Don't expect a replacement for yourself. Expect a force multiplier. Baibot makes me 30-40% more productive on operational tasks. It doesn't replace my engineering judgment, my client relationships, or my creative decisions. It handles the stuff that was eating my time so I can focus on the stuff that actually matters.
Where This Is Going
We're at the very beginning. The current generation of AI agents — including Baibot — are roughly where smartphones were in 2008. Useful, clearly the future, but clunky and limited in ways that will seem laughable in five years.
What excites me isn't what Baibot can do today. It's the trajectory. Every model upgrade makes it more capable. Every month of accumulated memory makes it more useful. Every new tool integration expands what it can handle autonomously.
The engineers who build personal AI agents now — who learn the patterns, build the infrastructure, develop the intuitions — will have an enormous advantage as these systems get more powerful. This isn't about early adoption for its own sake. It's about building muscle memory for a world where every engineer has an AI collaborator.
That world is coming faster than most people think. I'd rather be building in it than reading about it.