API

OrdinaryMix4013

maybe this chat is the equivalent of taco API... its diretctly connected to bank algos feeding them with secret retail strategies

ningendearukoto

We would know the reason, alas none of us paid for the API

rygypi

🥭 API just dropped, so this has to be a pump and dump

trumpdiego

he's just letting his API frontrun the rapid downfall isnt he

playerthegreat

Truth social API launch

OrdinaryMix4013

taco API seems to be doing alot of lifting today lmao

Utilize3372

If you pay $100k a month for the T Social API, do you also get early access to when he goes on meme spree shit post sprees? Asking for a friend.

cbusoh66

Breaking: Barron Trump is offering a $200,000 per month service for screenshots of his dad's tweets BEFORE they are sent out. No API needed.

Ltiform

I'm glad 80% of my portfolio is long shares because the paid for Truth Social API has these MMs inversing every call/put i make immediately

Traditional-Cloud154

How is the early access API thing legal?

meatsmoothie82

They were just testing out the ROI on the $100,000 per month Truth Social insider API

Traditional-Cloud154

Someone get API access and post up here. Thanks

Spursdy

This. There have been some open source projects that stream models into memory that significantly lower the memory footprint needed tor inference. Paying $5000.for a Mac studio starts to look like good value against paying API fees. I have just gone long.

WordsHappenedHere

Does anyone really need shitty truth social API? I mean you get what like a 1/10th of a second edge on his shitposting? And the occasional market moving tweet? Just watch the damn chart and wait for a big candle either way. Then check his shitty platform for the tweet. There is no real Alpha to be gained from this. Just another grift

dljmonkeyboiz

He's charging $100k for this tweet API, you bet he's gonna tweet 500x this week.

jesusislambda

Just wait till that Truth API hits

bodyreddit

I asked ai if this was true and it said: ‘Yes, Donald Trump's media company is selling real-time, millisecond-fast subscription access to high-profile Truth Social accounts, including Trump's own. The service is called Truth API and costs up to $100,000 per month.’

HighwayExotic2808

It’s 9:35 on Monday morning. You get a notification from your Truth Social API. You spend $100k a month to get market moving posts before everyone else so you frantically login to check…and 🥭 has posted yet another AI slop photo of him taking Kharg Island. You log out. Waste of time. Moments later, everyone else gets the notification. SPX instantly hits a circuit breaker.

moosewithamuffin

Can’t wait to buy my Truth API account!

OldWonder5865

Koreans don’t have the truth social API?

qrqrafafzvzv

Truth API, a glimpse at mark-moving policies. Only for $100,000 a month. How do they keep getting away with this?

Le_pants_de_marche

I'll save you the $100k API fee: >!Calls!<

WordsHappenedHere

BREAKING: The White House is selling API access to mangos browser history. The totally legal and groundbreaking move will pave the way for unprecedented transparency. I’ve already preordered and here was the first json response object: { "apiVersion": "v47.45.1", "endpoint": "/api/v1/executive/browser-history", "classification": "TOP SECRET // EYES ONLY // TOTALLY PUBLIC", "user": "POTUS", "searchHistory": \[ { "time": "07:12:08", "query": "\\"Barack Hussein Obama\\" }, { "time": "07:12:51", "query": "proof Barack Hussein Obama birth certificate } { "time": "07:18:02", "query": "where is Iran?" }, { "time": "07:18:41", "query": "where is the Straight of Hormooz and }, { "time": "07:19:04", "query": "google maps directions to Hormooz" }, { "time": "07:24:15", "query": "can Air Force One run on bleach }, { "time": "07:31:42", "query": "best Sharpie for changing golf scorecards" }, { "time": "07:36:58", "query": "are adult diapers normal" } \], "cookies": \[ { "name": "covfefe\_session", "expires": "Never" } \], "responseHeaders": { "X-Cache": "MISS", "X-Fake-News-Filter": "DISABLED", "X-Mulligans-Remaining": 18 }, "error": { "code": 418, "message": "Bigly” } }

hakim37

So I agree that not all engineers need top level access but only small organisations can get away with cheap plans as Anthropic forces API rates after 150 seats. I wouldn't call myself a whale, off memory my usage puts me in the top 20% of token spend. Yes I use Claude code heavily and can freely use Opus (no fable access) but the top 1% of spend is like 10k per month. There's top tier hedge funds or other high value orgs where employees will exclusively use fable or Opus on fast mode and basically not place any restrictions on usage as long as outcomes are worth it. I remember the article on the excessive cost of Claude code at (I think) Uber and their remedy was to put a $1500 cap per user month. So even cost adverse orgs still have high caps.

dogefool88

Truth API at work

IvoryTowerResident

just in time for Trump Truth API

hakim37

Off memory Opus 3 was the only model more expensive than fable but I would say the average cost per token via API has gone up as most people wouldn't have used Opus 3 back then.

hakim37

As an individual I would probably spend $200 a month if I had to. Hell if we're literally talking about have any AI access at all then maybe $500 although open source means that would never happen. As an employee I currently spend about $1000-$1500 a month on Claude code plus probably another $200 across other corporate AI subscriptions. API pricing is massively profitable for Anthropic and OpenAI. You can run the numbers through yourself and find gross margins above 85%. In terms of whether it's sustainable, personally I think it is. My Claude spend not only 3x my ability in tasks that I consider myself an expert in but also allows me to do tasks I wouldn't normally be able to. For about 10% the wage of a software engineer you get a multi x productivity boost, as long as you've deployed your AI enabled engineer correctly at least.

OldWonder5865

Gotta work on getting the Truth Social API bundled with the IRGC Social API

Iron-condor-6050

I figured out what this 🌮 Saturday was all about. Those who paid the 100k subscription for the Truth API, got a real world demo of much faster they get the post.

on_hype

The framing is misleading. These are not lump sum debts, they are multi-year spend commitments spread over 4-10 years. At $25B revenue growing 100%+ YoY, run it forward: $50B in 2026, $100B in 2027, even at 60% growth you are at $250B+ annual revenue by 2029. $1.4T over 5-10 years against cumulative revenue potentially north of $1T is not as insane as the headline sounds. The real question is margins. Revenue means nothing if unit economics stay negative. Right now they are burning cash on every API call. If gross margins never get above 50%, then yes, the math breaks. But if they hit software-like margins at scale (70%+), it works. Also half these "deals" have optionality baked in. They are not legally obligated to spend $600B at Nvidia. These are frameworks, not purchase orders. Still would not touch it at a $1T IPO valuation though. You would be paying for perfection in execution over a decade with zero margin of safety.

BapeGeneral3

“Trump Media and Technology Group, which owns the platform, launched the new high-speed data feed called “Truth API,” describing **it as giving firms “a direct, licensed, real-time feed of the platform’s most market-moving Truths.”** Per the article. For the people saying “well someone will just repost it” need to do some research on how much time and money was spent on attempting to receive information milliseconds earlier than the rest of the market by having the fastest internet speeds and software possible. This is the same idea. By the time someone has reposted an “early access” Market Moving post, you already missed the boat

hecho2

twitter is like "why we dont do the same". it is free money, like 100k$ a month for the API to give a few seconds head start. does not change anything for us, unless you are citadel.

english_fool

You’re paying the subsidised subscription price then huh? No one paying the API based prices would be saying this BS.

bobjoylove

That’s what we like about the Fed. Nice clear signals and slow moves. I don’t want to pay for the API for your tweets, I want a photo leaked on a Friday at 4pm after the market closed, like the old days

Equivalent_Net_3752

it’s API access. So is having a Bloomberg terminal insider trading too?

Utilize3372

I saved $100k a month of the Truth Social API, but just following a very predictable pattern. A DEAL IS CLOSER THAN YOU COULD EVEN IMAGINE!... just kidding!on repeat.

gutster_95

Basicly use a Claude subscription to the maximum Limit and Show how much the Tokens would cost if you would use the API. So basicly you would have 5000$ worth of token usage every month for 200$. Of couse this doesnt mean that Antropic would lose that much Money all the time, simply because we dont know how they actual internal costs are for them. But it gives a Insight that this Business cant be sustainable at all.

rasselbido

Ant and OpenAI still have a massive legal and psychological moat among their main customers (other US tech companies buying API credits) Imagine how the administration would react to Apple announcing they will spend a billion dollars on Chinese model tokens

rasselbido

most of their income is from other US tech companies using API tokens. These companies are struggling to get even use of US frontier models approved (due to lack of zero data retention on frontier, i.e antjeopic requires all fable output to be stored for 30 days), their legal departments are still far approving up chinese models

gizamo

It could be half that, and they'd still make a fortune. The HFTs have the API, they'll get fed some key words in the post, and their algos will beat everyone to the play by at least a few minutes. They're going to make so much money that they'll buy moon docks for their nestable yachts.

gizamo

Doesn't matter. The high-frequency traders will have already placed all their trades before any of us could even read it. They have access to the API. They don't even need a human involved. There will just be some simle code words as signals that their algos can use.

gainsusmaximus

Today was day 1 of the Truth API, first ones frees regards

abroadbroadband

So much for that early API access, he must have forgotten it's Saturday

Mission-Educator-697

Gotta maker sure Truth API provides value for the 100k/year. This week will be straight pumps

Mission-Educator-697

Gotta maker sure Truth API provides value for the 100k/year. This week will be straight pumps

ResultAfraid8340

Starting Saturday, for a fee of up to $100,000 a month, trading firms can access "Truth API" to get a glimpse of the president's often market-moving announcements about economic policy and global affairs before the rest of the world.

SherbertMindless8205

They gotta be undercutting, the API price for V4 flash is like less than the electricity it takes to run.

Sylvers

This is such a unique situation, though. Because at its heart, even OS LLMs are super expensive to train. And the fact that we have so many viable and powerful OS models available for free (or for very cheap on API) is arguably an unprecedented development in such a new tech. It's such a win for all of us. But man, we were very close to having an entirely closed AI ecosystem where 2-3 companies control the entire market with barely any competition. You won't catch me praising the Chinese gov, but I will heap praise on the Chinese researchers and companies that brought us the early democratization of AI tech.

FrynyusY

The argument was cheaper energy prices in China to serve the models. Yes US hyperscalers can run it and have ran Deepseek models before but they are in US using US energy prices and costs to customers many times over than if using official Deepseek API from China

KittyLover-7

I can just smell the “at the request of Pakistan and others I have ordered a halt to the planned attacks to allow for negotiations” tweet 5 seconds before Futes open Those with the $100k API access get it 5 minutes before LMAO

Moxisxsx

Truth API is the new Bloomberg terminal

kemar7856

Truth API is real 🫪

1098duc_w_the_termi

None of this will matter. Every bank, hedge fund, firm will have access to this. The move will be to auto buy any bad news that come from this dumbass API. So, like always, buy calls

joepez

“…most market-moving Truths…” literally not even bothering to hide the corruption. I’m sure there’s an API endpoint to post back what market you need manipulated and deposit your kickback payment. 

NightOfTheLivingHam

10 bucks says people find a way to get access to the API without paying $100,000 because the security will be complete garbage

SkyDragonVTX

Paying the Truth API to beat Jane Street. LFG!

Technical-Plastic-26

Please explain to me like I'm 5 how this works. If I am on truth social and Trump posts something, do I not see it in real time whether or not I have the API paid feature?

zorrick44

He's basically saying, you can avoid my shitty website, and get the API access instead. Because the only reason people are on there is to get his Rando thoughts.

DivorcedGremlin1989

I'm really curious as to how this works. If it's an API, that likely means I have to query it. Maybe it's a webservice and they are going to send things to me unprompted. Okay. . . . But, what is being selected for transmission via the API? Unless the API has access to every Truth on the platform (useless), someone is manually flagging or AI flagging Truths as market-moving. So, blatant market manipulation. Also, webscraping tools exist already, so are they going to publish Truths early via the API? Probably. Giving institutions additional seconds to make automated trades.

_Doomer_Wojack_

Y’all paying for it ? BREAKING: Trump Media has officially launched its new paid data service, providing faster access to Truth Social posts from President Trump. The new service is called "Truth API" which gives firms "a direct, licensed, real-time feed of the platform’s most market-moving Truths," the company's CEO said in a press release. The service reportedly costs as much as $100,000/month.

LtUnsolicitedAdvice

> Starting Saturday, for a fee of up to $100,000 a month, trading firms can access "Truth API" to get a glimpse of the president's often market-moving announcements about economic policy and global affairs before the rest of the world. It's a small fee if you are big enough entity. But I think the real market movers know this shit well ahead of when he posts it. This isn't as much of an advantage. 

OptionsProOfficial

Others already mentioned this (@ken385), but CBOE DataShop is the exchange source. If you specifically want API access, look at ThetaData. They cover the SPX global trading hours session. You pull the overnight window by setting the rth parameter to false. dxFeed is another API option worth a look, but make sure it has that 8:15pm-9:25am block before you pay anything.

pink_ego_box

The only reason why this forum had this valuation was because they'd supposedly sell their API for AI training for billions, and they ended up doing it for tree fiddy lmfao

andsto2

Anyone with a truth social API know what’s happening?

Fauster

I mentioned it in this comment: https://old.reddit.com/r/stocks/comments/1v9xflp/what_is_really_behind_the_recent_ai_semiconductor/p0hyf8r/?context=3 >" Plus, I think MM's want virtually all stocks a lot higher by Friday. They aren't fighting the waterfall yet, but we could see their hand on Friday." If this is an options question, Citadel has different supposedly siloed verticals, but their most important role is to act as MM and provide liquidity to options markets. When you see bids and asks in options markets, a lot of those are theirs. They have to pay out all the puts and all the calls every Friday. There is is something called an open interest chart that has all the puts and all the calls. Every week, the MM wants to bundle and cancel all the longs and shorts. The point where the shorts perfectly balance the longs, and Citadel doesn't have to pay out much at all is called max pain. It is painful for options holders. It screws the most people I won't hold options to expiry because I've seen their shenanigans. This is especially true for low-volume low-float stocks. I mainly use put options for hedging and I usually avoid holding to expiry. Many times, when I first started trading options, I thought I was safely in the money (ITM), then late on Friday the stock starts rally, I look at the OI chart, and I see, Oh no, a lot of people are about to make money on puts and Citadel et. al don't want that. Citadel will post and then yank/move their options bids and do whatever then can to make sure they pay as little as possible. At 12:59 PST Friday, the price jumps right over my strike level for the Friday close on a dog of a stock before abandoning the position again, which continues its downward trend until Monday. I won't hold to expiry anymore unless a bear spread went to near-zero when I didn't notice and didn't roll. I won't trade 0 DTE options anymore so I don't have to deal with that. 4-6 months out is the minimum duration for spreads. A spread that is year-out is even better: more expensive up front, but with dramatically less cost per day and dramatically less vulnerability to MM fuckery. Without getting into the math, we were in a situation called negative gamma where citadel keeps needing to hedge more, buy more puts, so they don't get cleaned out. But that is not what Ken wants. I pull OI data from IBKR pro's "API", and earlier this week, every single semi stock was solidly in negative gamma. Ken will have to pay a TON of money to traders who had been buying puts AT SCALE for weeks. So, it was transparent logic that we would see Ken step in and some point and start to see these stocks rally... Usually late Friday, it's time to ask where max pain is for all your volatile stocks, and this will tell you where the MM will drive the price. OI plots are stale, so the puts and calls have changed, and you don't know exactly the MM book, but you can cross reference that with strike levels that the price just sticks too, and understand that if a price spent a long time at an options level with a lot of bids and calls, then that part of the OI chart is probably changing. This was a Value at Risk (VaR) waterfall, where risk compliance officers tell people you have too much margin, you are too volatile, you need to sell, and of course margin calls for people who were long and at 100% of their allowed margin. Citadel didn't want to have to buy all those puts though. Citadel makes money if stocks end a lot higher, then they don't care as much until late in the next week. tl;dr: It was a given that Citadel would show their hand by the end of the day. On Thursday, Citadel/MMs fought no strike levels. I assumed MMs were buying puts to hedge to avoid even more substantial losses. But, instead, yesterday, we saw probably the biggest MM intervention to save their bleeding book in a market where fund managers have been stacking puts to hedge. Citadel helped save their own book buy buying all of Leo's SW shorts at a fraction of their value, and buying up all their leveraged longs, driving the price up, getting them closer to max pain. If Citadel didn't do this in a giant overnight darkpool, and traded in public markets like us plebs, we would have seen the MM-sponsored rally. So I don't get sued: some of these statements on what Citadel wanted are speculation but I would argue very informed speculation.

wombweed

I have to wonder if Google cloud growth could be explained by the simple fact that the Gemini API tokens you get included as part of a Workspace subscription end up being billed by the GCP business unit. I’m a Google holder and have faith they will continue to grow but so much of this seems like marketing and accounting tricks rather than tangible fundamental growth

demonhunterking

Openai and Claude API price decreased over competition increased from china ai. If revenue decrease, circular financing will have impact

JerkyChew

Maybe you stop fucking over apps that want to use the API, and stop requiring logins for old.reddit.com, and us old affluent farts in the 20-year-club will stop selling your stock and it will go back to $300+. But hey, what do I know.

CavillOfRivia

It worked for a long while after reddit pulled the API changes out of their asses. Last month it completely stopped working for me and I couldnt be bothered to find out if I can make it work again. I refuse to visit this dump without an adblocker so no app for me and just use it while im on pc.

marinuss

Trump selling access to Truth Social API should be a wake up call for Reddit. Reddit could be selling early API access to /r/wallstreetbets posts so financial firms can put trades in opposite of whatever is posted there to profit before people even see the posts.

baydude510

How many years will they have negative cash flow? When will all this capex taper down? Is it worth it to build all this capacity when open source Chinese models are having great performance but orders of magnitude cheaper and more efficient? I'm switched to using Deepseek now for most of my API calls because its so much cheaper than US providers and models. I only use US models when I really need privacy, like working with data in my company's databse, so I don't get in trouble with my company.

Sensitive-Radish-292

Because their user growth is fake and it's just pakistani bots that create new accounts because the old ones got banned. Their advertising is more one-shot than actually reoccuring income, most marketing agencies drop reddit after they realize there is practically zero return on investment. The last thing they have is the data licensing / API licensing (which is very predatory) and that is slowly going to hell, because most of reddit is now just bots talking to each other (just visit any major subreddit and check for yourself).

Important-Agent2584

I'm not talking about ads, I'm taking direct selling of data (comments, etc.) via API

CommandSmart4318

Soon you'll be able to purchase exclusive access to the API and find out about new wars before anyone else

skilliard7

What do you mean they uncap to generate hype? We pay based on API rates just like most organizations do. There are API rate limits, but we don't run into them. You can clearly see that prior to Opus 5 launching a couple days ago, GPT 5.6 sol offered the best value for the cost by far: https://deepswe.datacurve.ai/ It's a close tie now with Opus 5 out, but for most of July, OpenAI had a huge lead when compared to Fable 5 or Opus 4.8.

skilliard7

A lot of their revenue growth is in high margin areas like their API.

skilliard7

Yeah plus at $20/month is IMO the best value of any LLM provider. The real money printer for OpenAI though is their API, especially for coding. Organizations don't pay for Codex(which is subsidized), they pay API rates based on usage. Companies are spending hundreds/thousands per month on the API for developers. And as they worry about cost, a lot of them are moving from Anthropic to OpenAI because OpenAI offers much better prices relative to performance. Anthropic did close the gap a bit a few days ago with Opus 5, but OpenAI is still very much my go to.

OurNewestMember

I think CBOE. also, why API access? It's historical data. Might be cheaper and easier in the medium term to get batch files and aggregate them and just work off of that. Point being, CBOE has a variety of data product offerings plus sales staff, etc, that can help get what you need. Not sure what your budget is. I'm also assuming you truly need SPX and can't make it work with other products that might have cheaper data alternatives. Lastly, I saw SPX (presumably with SPXW) but not SPXW only on CBOE. This is not API access, but... here's a $138/mo/symbol offering for minutely data (includes open interest but not additional Greeks): - https://datashop.cboe.com/option-quote-intervals Using 1hr aggregations instead cost $86 per trading month for the 1 symbol. Also note that this product no longer includes ticks without a price change (ie, size change only)

legible_print

Sorry this is a rant, but Generative Engine Optimization. Instead of SEO. AI isn’t going to just affect work. It’s going to affect commerce. There’s a possibility that any task that that uses an API or browse shopping mechanism will no longer require a site. It will just be a search bar that you talk to. Either through the company itself or a huge third-party LLM like ChatGPT or Claude. Want a flight? A hotel? A restaurant recommendation? A savings account with the best APR for your situation? How about a food delivery? You won’t even browse. You will have a faster conversation with something, something that knows your budget and preferences will find it for you. Like a hotel concierge. That is just one of the commercial applications of this new technology. Businesses are already reorganizing their online footprint to appeal to how LLMs read the internet.

EH_Story

Sorry but you have no idea what you are talking about. Meta Pixel / Conversions API tracking are embedded and linked directly within your website or CRM. When you pay for ads, you always set up an objective within the ads manager which is most often leads (CPL) or conversions (CPC) which can't be faked. Neither CPL or CPC would change based on bottled views and these metrics are how people determine their adspend.

nickkon1

Business since many pay for the Microsoft suite anyway its much easier to add copilot compared to adding completely new software into a large corporation. Plus a lot of companies use azure to then use the opanai API in the background instead of buying ChatGPT enterprise

greytoc

I expect that it's personal preference based on use-case. An active investor vs an active trader will have very different requirements on content. Not everyone cares about a pundit's analysis. And there is a lot of noise out there. I tend to prefer primary sources - ie. actual filings and data releases. But it also depends on what you mean by "news". Some data like analyst reports and consensus information is great to see but curated datasets are usually not free. And some will have distrbution restrictions. Ultimately - it entirely depends on the demographic that you plan to target. Not everyone is going to care about generic news. And for a casual investor - they are not likely to want to pay a premium for such a service. There is a spectrum of news services that target different investor use-cases and demographics. Something like a free financial news aggregator like a Yahoo/Google/CNBC is very different than a Bloomberg terminal. And there are services like those offered by brokers to their customers that vary greatly like the services from brokers like Fidelity/Schwab/etc to services like real-time news API from brokers like Alpaca. And there are services like eSignal that not just aggregates news but integrates other datasets, etc. All of these services that I mentioned already have the ability to filter and personalize the news feed - so simply offering personalization is not a competitive advantage. That's just table stakes and expected basic functionality.

Moxmox1337

Some of you didn't buy the $1,000,000/month early FED decision API and it shows.

FullOf_Bad_Ideas

It's less efficient to run models locally. When you serve a model on serious hardware, you can have concurrency around 20-200 sessions per GPU. That's at least what I aim for. This way you utilize compute and bandwidth. If you have dope 4x RTX 6000 Pro rig and you use it yourself as a coding agent, during token generation you're generating just 30 t/s while those GPUs could have been serving 3000 t/s total to 100 different people. GPUs tend to use up 50% of full power during decoding even if they're using just 1% of compute (single user inference) and the output speed is bottlenecked by memory. This is down to generation being autoregressive. Prefill isn't really impacted by this, and in local settings prefill isn't 2-10x times cheaper than output like on API model, it's 100x cheaper in terms of energy use per token than decode. It's like flying a plane by buying a ticket to fly commercial airlines vs finding and hiring a pilot with a cesna to fly you somewhere, or even buying a cesna and becoming that pilot. Plane can take more people so unless you're very rich you will go with mass transit. In the end you get transported from A to B so there's no huge reason to buy a cesna. I have 8x 3090 ti rig, I'm a hobbyist turned professional, and the best things to run on it is training and batch inference, week long workloads that heat up my whole apartment. I get 10x cheaper compute than renting 8 x H100 rig this way, while it's only 4x slower during training (40x cheaper per hour, 4x slower, so 10x cheaper per unit of work done). I do single user inference too, but the ROI on it isn't as clear.

phunky_1

Which makes them no money. Enterprises in general don't use meta's models with pay for token use of an API.

FullOf_Bad_Ideas

I have a 10k 4000W Nvidia rig and I considered my choices before getting hardware, Apple hardware wasn't in the picture. >apples studios and mac minis are great for local AI There are two main usecases for Apple and AI 1. Machine that an agent can use as their own. Inference runs on cloud Nvidia/AMD/Google/Amazon accelerator, you need local server just to have an OS that agents can use easily and it's nice to have your files locally. It can be a potato as long as it has MacOS in recent version and is stable. AI isn't local. 2. Mac Studio - they look great on Youtube videos when they're used in short context tasks, there are Mac Studio SKUs with 256/512GB of RAM, 400-800 GB/s bandwidth and M3 Ultra. The downside? Prefill speed on interesting models is really low. On DeepSeek V3.2 it was like 20 t/s prefill and 10 t/s decode, something like that. If you ask it to do a web search for you it's fine. If you want it to reason through some math problem, it's ok but you'll have to wait. If you want to use it in a coding assistant like Claude Code or OpenCode, you open up the window and write "Hi", your harness will hit local LLM API and will send a 8000-15000 token prompt. So, assuming 20 t/s prefiil, you'll be waiting 6-13 mins to get "Hey, how can I help you today?". Most power users will want to use LLMs for coding. And slow prefill just makes it unusable for serious coding where model need to read existing code files and docs often. Apple M5 chips have a much better profile, plus models with hybrid attention are making prefill less taxing on compute, but I don't think there are any M5 chips that you can pair with 256GB or 512GB of unified RAM, so I think Apple can start making good AI hardware in the near future. Or it could, before DRAM prices went up to the point where they would make majority of the BOM. So, Apple being a local AI hardware company is something that could happen in the future but it's absolutely not this way right now. There's also PFLash but I am not sure how many models are supported - this could help existing M3 Ultra 512GB owners get more out of their hardware. If you want to run basic local AI image/video/text gen and you don't want to spend a lot of money, cheap CPU + DDR4 + RTX 5070 Ti or used RTX 3090 are the best options.

FullOf_Bad_Ideas

Those $850 Mac Minis aren't running LLMs locally, they're just calling API that is running inference on Nvidia cards somewhere in a data center. I mean they can run some LLMs locally, but not those that are good enough for OpenClaw/Hermes. > Also the data centers are using $30K Nvidia, not your PC GPUs. What’s your point? here's a data center cluster made out of 1600 RTX 5090s https://gpulist.ai/detail/81440e4

greytoc

You are entirely misunderstanding the market tremendously. Investors don't care about those things. And you asked about trading tools that would appeal to traders who may trade with hedgefund like tactics. These are not retail traders that would look to an app for educational materials. They tend to be people who have a lot of experience in trading and understand what they need. And yes - they will pay for it. Someone that wants hedge fund like services doesn't care about stuff like what you have proposed or even your analysis unless it's end-user customizable and programable. It's always about the data and how easy it is to access that data. I dont' care about your analysis. I care about my analysis. And I would want a frameworks so that I can build my analytical model. So such a tool would basically be a development harness and framework that provides easy access to data. For example - look at these products. These are products that I would and have paid for: QuantConnect - with datasets and a framework with integration to brokers TradingView, eSignal, Wealthlab - with chart focus and a decent programming language Or look at brokerage API's like from Schwab, ETrade, Ibrk, Alpaca, etc. Or look at brokerage integration platforms with external data and a programmable plugins like Tradestation, Metatrader, NinjaTrader. There are literally dozens of solutions.

jutlanduk

Agreed. Big firms will invest time and resources to build their own solutions - my own scaled customers Increasingly just want API / MCP data dumps and could give a crap about our tooling. Small and mid-size firms are where SAAS has opportunity imo; to your point they can’t maintain customer solutions, even if they can cobble something together. All that said, it’s still early days with AI and easy to forget where it was 3 years ago vs today. Unless there’s a “wall” that stops this stuff improving I’m hesitant to invest in SAAS. It very well could hit a wall, either on capability or no improvements to token $ efficiency, but not sure I’m willing to bet on that at the current moment. Good luck and thank you for posting the thread, interesting stuff.

ap1618

Create a sub, want to follow for API

rebel-capitalist

I’m planning to expose the data via a free API as soon as everything is ready. You’ll be able to integrate with it and use it however you like

MKeo713

The revolutionary change happening is the result of two core capabilities: 1. LLMs were trained to understand language, a whole bunch of them, including machine-specific languages. That means they have an understanding of the core underlying concepts of language and how those get expressed in different forms. 2. LLMs are generalists that can have their “attention” tailored to whatever specific context is relevant. This means both it can be presented with new information and act accordingly (learning over time) Previously ML models were trained to produce a narrow set of outputs in a specific, scoped domain of inputs. You have a new problem? You gotta train a new model. The inputs / outputs can span many forms and domains? The problem is unsolvable. LLMs are flexible, can create novel output in a variety of forms, and can be applied to specific tasks through context provisions rather than retraining the weights. To me there are two big unlocks that stem from this: 1. Consolidation of inconsistent, sparse, and / or distributed information. The real world is messy, sometimes sources conflict, sometimes only 75% of the information is there and we need to infer, and many times the entire set of data we need is spread across many sources. Yes part of this is a more efficient google search process, but this applies to so many situations it’s absurd. Any information gathering step, which is tedious, is a candidate for improvement with LLMs. The amount of startups targeting this exact use case in a variety of domains shows how great of an opportunity this is. People are still necessary to act on the information presented, but it allows us to become better informed in a shorter amount of time. 2. Humans can now interface with machines through natural language. This is stuff like Claude code, where I lay out a  task roughly in regular language, and it turns it into specific code. Same goes for any form of machine language like json, or a call to a specific API. It can also translate back from what a machine produces to a form easily digested by a person. And it’s conversational, iterative, rather than a bunch of one-off translations. Let’s say I’m an analyst and I want to know some facts about the users of our application, i can ask it to an LLM and it’ll turn that into specific queries to execute on our internal databases, giving me the results and maybe even providing a level of interpretation to make it easier to read. The world is built upon information and software and LLMs fundamentally improve how we interact with these. It absolutely has its limits: it’s probabilistic by nature so flows where accuracy is essential can’t be fully automated, and if you chain too many LLMs together without re-grounding them they can easily go off the rails. They’re also slower and more expensive than regular code, so plugging them in where a trained ML mode or well structured code would suffice is just silly. But there are core capabilities that simply weren’t possible before that are fundamentally shifting how we learn and work. Brushing off “a better way to consolidate information from the Internet” as a mediocre use ignores the magnitude of what that actually entails.

International_Bag319

Schwab secretly has a decent API for data.

RuleSafe6767

The capex alone is 1T, however there's still property taxes, operating expenses, and G&A overhead. Let's say those costs come to only 6%/yr, or all in around 1.3T over 5 years. To pay for all that plus earn another 10% on all those costs, they need to earn about 23% of total/yr, or about 300B. Assuming there are 3 B Internet users willing to pay $100/USD/yr for AI, then they will be profitable. But what if most users are very price sensitive and will simply stop using the service if they have to pay *any* amount (like me)? Let's say they accounts for about 9 in 10 users. So maybe there are only 300 M users willing to pay. They will need to pay $1000 USD/yr, which is around $84/mo. Maybe that's reasonable? I think which API access to China, users will find way to say a lot more, so realistically I think the majority of users will spend a lot less than $80 USD/mo.

anonymous985

Open weight models are about 6 months behind the frontier models. Soon enough you can get an Opus 4.8 capable model working for you, only paying CapEx to acquire the hardware to run it and power.  If you were to make a product that depends on AI to function, would you want to base it on an API where you literally have no clue how much it will cost to provide per user, as token usage can vary wildly? Larger companies building AI workflow will soon enough start hosting their own AI models instead of paying for the increasingly expensive token cost, as it will give them a fixed cost instead of varied cost based on the amounts of tokens consumed. There will be a place for frontier models, but it will be a niche. 

ExpiringWorthless

I'm not aware of any significant long term revenue agreements they have? They literally get the money from subscriptions and from enterprise token spend at API prices, which isn't a deal based

9tacos

100k per month API access for these generative miracles

DonkeyTron42

Someone pay $100k for a month of TruthSocial API access and let us know what🥭 is up to.

Olangotang

That's cute. Too bad most of the people paying for the API (including corporations) are dumb fucks who use it for emails, or fucking up their codebase. *The worst developers love AI. The best one use it as a part of the process, instead of the whole job.* I want to make myself clear: I am not against AI, and I have an ML degree + understand how these models that the *finance bros* don't understand, works. The point is that Anthropic is now against EVERYONE because they acknowledge that open source is a better model. If you are a pure AI lab, you are completely fucked by Frontier model training costs.