We're really excited for the AMD EPYC Venice — 256 physical cores each -> 512 vCPUs -> 1024 vCPUS on a single board with dual-socket. It will probably be about $40k per machine with these RAM prices but we're definitely going to buy a few. A full data center on a single motherboard!
So we're limited on capacity since we own all our own hardware. Please do not use us for auto-scaling just yet. Our software would have no issue with us linking up other cloud machines such as AWS EC2 to our fleet and offering it there, which could help with auto-scaling, but we would not make any money on that and it would be a lot of engineering effort for us right now.
I think it's mostly complimentary, in the same way a linear MCP would be complementary to a MemGPT/Letta-style memory system
I guess the main potential point of confusion would arise if it's not clear to the LLM / agent which tool should be used for what. E.g. if you tell your agent to use Letta memory blocks as a scratchpad / TODO list, that functionality overlaps with Beads (I think?), so it's easy to imagine the agent getting confused due to stale data in either location. But as long as the instructions are clear about what context/memory to use for what task, it should be fine / complementary.
God bless these generously benevolent corporations, giving us such amazing services for the low low price of only $200 per month. I'm going to subscribe right now! I almost feel bad, it's like I'm stealing from them.
That $200 a month is getting me $2000 a month in API equivalent tokens.
I used to spend $200+ an hour on a single developer. I'm quite sure that benevolence was a factor when they submitted me an invoice, since there is no real transparency if I was being overbilled or not or that the developer acted in my best interest rather than theirs.
I'll never forget that one contractor who told me he took a whole 40 hours to do something he could have done in less than that, specifically because I allocated that as an upperbound weekly budget to him.
> That $200 a month is getting me $2000 a month in API equivalent tokens.
Do you ever feel bad for basically robbing these poor people blind? They're clearly losing so much money by giving you $1800 in FREE tokens every month. Their business can't be profitable like this, but thankfully they're doing it out of the goodness of their hearts.
I'm not sure that you actually expect to be taken seriously if you're going to assert that these companies don't have costs themselves to deliver their services.
reply