Hacker Newsnew | past | comments | ask | show | jobs | submit | handfuloflight's commentslogin

I'll bite. How much capacity do you have or some examples of the capacity you're managing?

We have about 1000 cores right now.

We're really excited for the AMD EPYC Venice — 256 physical cores each -> 512 vCPUs -> 1024 vCPUS on a single board with dual-socket. It will probably be about $40k per machine with these RAM prices but we're definitely going to buy a few. A full data center on a single motherboard!

So we're limited on capacity since we own all our own hardware. Please do not use us for auto-scaling just yet. Our software would have no issue with us linking up other cloud machines such as AWS EC2 to our fleet and offering it there, which could help with auto-scaling, but we would not make any money on that and it would be a lot of engineering effort for us right now.


What's this costing you?

Could Beads be additive to Letta's memory? Or could you anticipate conflict or confusion paths?

I think it's mostly complimentary, in the same way a linear MCP would be complementary to a MemGPT/Letta-style memory system

I guess the main potential point of confusion would arise if it's not clear to the LLM / agent which tool should be used for what. E.g. if you tell your agent to use Letta memory blocks as a scratchpad / TODO list, that functionality overlaps with Beads (I think?), so it's easy to imagine the agent getting confused due to stale data in either location. But as long as the instructions are clear about what context/memory to use for what task, it should be fine / complementary.


Great response, thank you. Will experiment then with projects that have already initialized Beads.

That's significant, you can improve it in your own environment then.

Yeah exactly - it's all just tokens that you have full control over (you can run CRUD operations on). No hidden prompts / hidden memory.

They still have to manage state between their servers and yours.

Absolutely.

The generosity of the Max plans indicates otherwise.

God bless these generously benevolent corporations, giving us such amazing services for the low low price of only $200 per month. I'm going to subscribe right now! I almost feel bad, it's like I'm stealing from them.

That $200 a month is getting me $2000 a month in API equivalent tokens.

I used to spend $200+ an hour on a single developer. I'm quite sure that benevolence was a factor when they submitted me an invoice, since there is no real transparency if I was being overbilled or not or that the developer acted in my best interest rather than theirs.

I'll never forget that one contractor who told me he took a whole 40 hours to do something he could have done in less than that, specifically because I allocated that as an upperbound weekly budget to him.


> That $200 a month is getting me $2000 a month in API equivalent tokens.

Do you ever feel bad for basically robbing these poor people blind? They're clearly losing so much money by giving you $1800 in FREE tokens every month. Their business can't be profitable like this, but thankfully they're doing it out of the goodness of their hearts.


I'm not sure that you actually expect to be taken seriously if you're going to assert that these companies don't have costs themselves to deliver their services.

Even 500 would be cheap, if it can replace one developer

Sleep time compute architectures are changing this.

Get a grep!

This is a great drill down.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: