@awelonblue i don't disagree
our system prompt is always cached, so i think it's roughly free from a $ perspective
Notes
- @awelonblue What do you think of this? https://x.com/stevekrouse/status/1849162024476942642/photo/1
- @awelonblue That's better, I'm going to use this!
- i can't believe this got zero likes. clearly my followers are not hip to the newest musicals https://open.spotify.com/track/0pQoPdJJ7fLgEIqDcl45S9?si=c0a9878a85ea4039
- New addition I'm trying in Townie's system prompt: avoid try...catch https://x.com/stevekrouse/status/1849157685867909434/photo/1
- @BorisBerenberg @vercel Let's do it!
- what is happening here google maps?! is this an ad for a coding school ON TOP OF an add for an asian meat restaurant? https://x.com/stevekrouse/status/1849138474579795991/photo/1
- @simonw @elliot_braem @alexalbert__ @sammcallister @RobertHaisfield oh damn this is awesome! thank you! https://x.com/stevekrouse/status/1849098444503212528/photo/1
- @sandyasm @elder_plinius yes! thank you! https://x.com/elder_plinius/status/1848781117714788694
- @elliot_braem @alexalbert__ @sammcallister @RobertHaisfield @simonw the diffs are often invalid unfortunately
- Does anyone have the new anthropic system prompt that includes notes about artifacts?
- claude sonnet 3.5 oct 22 seems to not want to write 500+ lines of code all in one go (more so than previous sonnet 3.5) anyone else notice this? anyone have suggestions on how to prompt around it? cc my prompting friends @alexalbert__ @sammcallister @RobertHaisfield @simonw… https://x.com/stevekrouse/status/1849086788930810133/video/1
- the new claude system prompt has a whole section about counting letters https://x.com/stevekrouse/status/1849081347576373281/photo/1
- it was the warriors! the warriors! the warriors shot cyrus!
- as per usual @simonw explains the new tech better than the companies making it https://simonwillison.net/2024/Oct/22/computer-use/
- Claude 3.5 Sonnet 10/22 (aka Sonnet 3.6) is now deployed on Val Town's Townie We haven't seen a big improvement in our evals or by playing around with it ourselves (yet), but try it out and let us know what you think! http://val.town/townie
- @BorisBerenberg @vercel Let's do it together on a livestream with Townie!
- it seems like the new haiku is the model we've been dreaming of: about claude 3.5 sonnet smarts but way faster does anyone know how fast haiku is vs sonnet?
- @NickADobos yes this 100x
- The evals are running!!! https://x.com/alexalbert__/status/1848743088463986700
- http://x.com/i/article/1848717257368641536
- @mattschaar @jdan i don't know if people know i'm joking https://x.com/stevekrouse/status/1848715747922411852/photo/1
- @jdan how'd you make up your mind? it's a tough call for me
- @BorisBerenberg Thanks for trying! Will look into it!
- @BorisBerenberg Huh! I don't see that very often. Will investigate!
- claude prompt caching is 34% cheaper in production for us https://x.com/stevekrouse/status/1848334615208960214/photo/1
- RT @breckyunits: just trying out http://val.town. amazing to see how far its come since the last time i tried it. you can tell the…
Reposted by Steve
Text may be partial · Read original
- @BTConnector_ @ValDotTown @triggerdotdev I'm not sure - I don't think anyone's done that yet. What kind of job are you thinking about?
- @alexalbert__ question for you about prompt caching costs Should we ignore usage.input_tokens? In some testing, we keep getting back 4 Should we just look at usage.cache_read_input_tokens & usage.cache_creation_input_tokens?
- a val to play with it http://val.town/v/stevekrouse/anthropicCaching
- I'm embarrassed it took us this long to roll out prompt caching with anthropic. It's free money & a latency improvement! Run don't walk to "cache_control": {"type": "ephemeral"}
- RT @0thernet: my crazy keyboard arrived today and i immediately cracked open @ValDotTown to generate a custom typing practice app https://t…
Reposted by Steve
Text may be partial · Read original
- RT @CerebrasSystems: Announcing Llamapalooza NYC on Oct 25! 🦙 Join Cerebras for a one-of-a-kind event around fine-tuning and using llama m…
Reposted by Steve
Text may be partial · Read original
- @punkpeye @daniel_levine @tmcw @ValDotTown Agreed! An embedded val town would be 🔥 Our blog has a lot of our learnings: https://blog.val.town/ For now, I'd recommend @deno_land Deploy as the best alternative
- @JacobColling Not your fault! Still appreciated!
- @JacobColling So far this has saved us $0 and wasted many hours of engineering time. I am blow away by how terrible AWS is at selling cloud services
- my favorite new app in recent months: http://maccy.app by @p0deje once you have clipboard history, you'll never understand how you were able to live without it https://x.com/stevekrouse/status/1846257984873095637/video/1
- @madhu___s I'll give a talk on js!
- does anyone know when this shows up? ie how many tokens? https://x.com/stevekrouse/status/1846200125514822033/photo/1
- @patife Yep!








