- RuntheAI
- Posts
- Personalized AI Chat Bot In Your Writing Style 🥶
Personalized AI Chat Bot In Your Writing Style 🥶
Plus: Wall Street Banks Ban ChatGPT
Good Morning AI Runners 🏃♂️
Here's what we've got for you today:
The True Cost Behind Training State-of-the-Art LLM Models
Personalized AI Chat Bot In Your Own Writing Style
Wall Street Banks Ban ChatGPT
How much does it cost to train a state of the art LLM? A whopping $4 million, that's how much!
For example, Facebook's LLaMA model took 21 days to train using 2048 Nvidia A100 GPUs, which cost around $4 million at $3.93 per hour on Google Cloud Platform.
Google's PaLM model is even more expensive - it needed 6144 v4 TPUs for 1200 hours and then 3072 TPUs for 336hrs, which came to a total of about $27 million at $3.22 per hour.
Now don't get me wrong but this a lot less than I would've imagined it cost to train LLMs. Come on $4 million? I would have guessed mid to high 8 figures.
Today, while scrolling on Twitter, I came across Linus's tweet showing how he made his own chatbot using open-source language models and his own writing (Blog), and gave it to iMessage to communicate with it.
The best part? It's personalized to his writing style and experience. It's like messaging yourself, how cool is that? Linus used a model called cosmo-xl for text generation and gave it his own prompt. He's planning to write up a guide so you can do it yourself but for now you can check his tweet with screenshots of his iMessage chat ... with his virtual clone.
Instead of just having generic AI tools integrated into everything, having an AI that's trained on your own writing style and personalized to your needs is the future.
Who wouldn't want a virtual clone of themselves........
Wall Street banks are cracking down on ChatGPT. Banks like Bank of America, Citigroup, and Goldman Sachs have recently banned their employees from using ChatGPT for business purposes.
(These bans on ChatGPT could be because it hasn't been given the green light under the usual rules/standards for using third-party software in major banks.)
Pic Media of the day:
No Picture of the day today but we have something cooler you NEED to check out. We won't explain just go and watch the video linked below (TikTok):
That's it from RunTheAI for today.
THANK YOU FOR READING AND SEE YOU TOMORROW, SUBSCRIBE TO STAY UPDATED!
P.S. if you made it this far, hit “reply” and tell me what you think of today's newsletter...what’d you love? What was boring?