#ai - April 2023

@Erik Osterman (Cloud Posse) has joined the channel

set the channel description: Discuss all things related to AI

@Jim Park has joined the channel

@Andriy Knysh (Cloud Posse) has joined the channel

@johncblandii has joined the channel

@venkata has joined the channel

@Stephen Richards has joined the channel

My personal pet project has been to take something like Waiting for Godot, a “tragicomedy in 2 acts” by Samuel Beckett, and see if I can coerce an LLM to produce a third act. What I discovered is that when I prompt ChatGPT to do so, it gets the theme right, but uses modern generic English, and doesn’t “sound like” Waiting for Godot. When I dig into why, I essentially that the problem has to do with retrieval. There’s not enough working memory for a model to store the whole body of what it learns, it just encodes token relationships in many parameters (but far fewer parameters than represents the whole corpus). Retrieval is what permits a generalized model to bring in relevant context to fill in the gaps... 🧵

@Zoltan K has joined the channel

@Dariusz Panasiuk has joined the channel

@Igor M has joined the channel

@Sebastian Macarescu has joined the channel

@Jim Park has joined the channel

@Alencar Junior has joined the channel

LAION, an open source competitor to OpenAI, has released open-assistant, but it's not as good as M$ backed OpenAI. Probably due to lack of the huge dataset that GPT-3.5 and GPT-4 have.

TIL about “Cerebral Valley”, a growing community in Hayes Valley where AI hacker houses are sprouting up.

@Eduardo Wohlers has joined the channel

@Ahmed Moawad has joined the channel

This Tesla Engineer built a tool called "InfraGPT", which permits him to troubleshoot servers and restart processes! https://twitter.com/tejasybhakta/status/1648621554341933057

Makes me think of https://infracopilot.io/

@Hao Wang has joined the channel